-- Logs begin at Wed 2022-08-24 07:19:40 UTC, end at Wed 2022-08-24 08:26:33 UTC. -- Aug 24 07:49:09.442512 dv-cinder-852211-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 07:49:09.451160 dv-cinder-852211-5-smb devstack@keystone.service[81592]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 07:49:09.453501 dv-cinder-852211-5-smb devstack@keystone.service[81592]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 07:49:09 2022] *** Aug 24 07:49:09.453501 dv-cinder-852211-5-smb devstack@keystone.service[81592]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 07:49:09.453501 dv-cinder-852211-5-smb devstack@keystone.service[81592]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 07:49:09.453501 dv-cinder-852211-5-smb devstack@keystone.service[81592]: nodename: dv-cinder-852211-5-smb Aug 24 07:49:09.453501 dv-cinder-852211-5-smb devstack@keystone.service[81592]: machine: x86_64 Aug 24 07:49:09.453501 dv-cinder-852211-5-smb devstack@keystone.service[81592]: clock source: unix Aug 24 07:49:09.453501 dv-cinder-852211-5-smb devstack@keystone.service[81592]: pcre jit disabled Aug 24 07:49:09.453501 dv-cinder-852211-5-smb devstack@keystone.service[81592]: detected number of CPU cores: 4 Aug 24 07:49:09.453501 dv-cinder-852211-5-smb devstack@keystone.service[81592]: current working directory: / Aug 24 07:49:09.453501 dv-cinder-852211-5-smb devstack@keystone.service[81592]: detected binary path: /usr/bin/uwsgi-core Aug 24 07:49:09.453501 dv-cinder-852211-5-smb devstack@keystone.service[81592]: your processes number limit is 47680 Aug 24 07:49:09.454096 dv-cinder-852211-5-smb devstack@keystone.service[81592]: your memory page size is 4096 bytes Aug 24 07:49:09.454096 dv-cinder-852211-5-smb devstack@keystone.service[81592]: detected max file descriptor number: 2048 Aug 24 07:49:09.454096 dv-cinder-852211-5-smb devstack@keystone.service[81592]: lock engine: pthread robust mutexes Aug 24 07:49:09.454096 dv-cinder-852211-5-smb devstack@keystone.service[81592]: thunder lock: enabled Aug 24 07:49:09.454096 dv-cinder-852211-5-smb devstack@keystone.service[81592]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 07:49:09.454096 dv-cinder-852211-5-smb devstack@keystone.service[81592]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 07:49:09.493089 dv-cinder-852211-5-smb devstack@keystone.service[81592]: Python main interpreter initialized at 0x564c1c3a89c0 Aug 24 07:49:09.493089 dv-cinder-852211-5-smb devstack@keystone.service[81592]: python threads support enabled Aug 24 07:49:09.493089 dv-cinder-852211-5-smb devstack@keystone.service[81592]: your server socket listen backlog is limited to 100 connections Aug 24 07:49:09.493089 dv-cinder-852211-5-smb devstack@keystone.service[81592]: your mercy for graceful operations on workers is 90 seconds Aug 24 07:49:09.493397 dv-cinder-852211-5-smb devstack@keystone.service[81592]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 07:49:09.493513 dv-cinder-852211-5-smb devstack@keystone.service[81592]: *** Operational MODE: preforking *** Aug 24 07:49:09.493772 dv-cinder-852211-5-smb devstack@keystone.service[81592]: *** uWSGI is running in multiple interpreter mode *** Aug 24 07:49:09.493772 dv-cinder-852211-5-smb devstack@keystone.service[81592]: spawned uWSGI master process (pid: 81592) Aug 24 07:49:09.493964 dv-cinder-852211-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 07:49:09.499154 dv-cinder-852211-5-smb devstack@keystone.service[81592]: spawned uWSGI worker 1 (pid: 81602, cores: 1) Aug 24 07:49:09.499154 dv-cinder-852211-5-smb devstack@keystone.service[81592]: spawned uWSGI worker 2 (pid: 81603, cores: 1) Aug 24 07:49:09.499154 dv-cinder-852211-5-smb devstack@keystone.service[81592]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 07:49:13.914222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:49:13.914222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: from cryptography.utils import int_from_bytes Aug 24 07:49:13.915016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:49:13.915016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: from cryptography.utils import int_from_bytes Aug 24 07:49:13.915016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:49:13.915016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: from cryptography.utils import int_from_bytes Aug 24 07:49:13.915528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 07:49:13.915528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: from cryptography.utils import int_from_bytes Aug 24 07:49:13.977522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:49:13.977715 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:49:13.977893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] command line args: [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:49:13.978221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:49:13.978373 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ================================================================================ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:49:13.978626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] admin_token = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.978754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 07:49:13.978870 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] config_dir = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.978950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 07:49:13.979056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.979145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] command line args: [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 07:49:13.979228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] config_source = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.979398 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 07:49:13.979484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] debug = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.979579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ================================================================================ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 07:49:13.979661 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.979883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] admin_token = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.979962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.980090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] config_dir = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.980173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.980292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.980411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.980515 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] config_source = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.980619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.980733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] debug = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.980830 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.980937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.981058 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_config_append = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.981169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.981266 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.981367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.981473 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_dir = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.981473 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_file = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.981672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.981782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.981911 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.982027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.982147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.982147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_config_append = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.982380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.982501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.982623 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.982733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_dir = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.983063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.983184 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.983306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.983439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.983556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.983556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.983784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.983919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.983919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.984248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.984358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.984358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.984596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.984704 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.984825 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.984947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.985052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.985178 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.985301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.985301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.985494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.985615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.985746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] publish_errors = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.985870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.985990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.986111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.986232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.986232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.986462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.986583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.986704 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.986825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.986941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.987066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] standard_threads = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.987182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.987297 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.987297 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.987517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.987706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.987830 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] publish_errors = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.987975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_journal = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.987975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_json = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.988200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.988316 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_stderr = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.988436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.988563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] use_syslog = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.988679 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.988793 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.988916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.989033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.989148 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.989261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.989382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] standard_threads = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.989506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.989628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.989743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.989883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.990006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.990123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.990123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_journal = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.990347 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.990467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_json = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.990583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.990703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_stderr = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.990824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.991000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] use_syslog = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.991000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 07:49:13.991188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.991188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.991372 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.991372 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.991568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.991666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.991775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.998215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.998327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.998327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.998528 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.998528 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.998665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.998736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.998813 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.998891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.998973 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.999052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.999130 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.999208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.999285 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.999357 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.999436 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.999436 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.999566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.999637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.999708 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.999708 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.999877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:13.999963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.000038 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.000115 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.000187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.000259 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.000338 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.000338 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.000468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.000539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.000609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.000679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.000765 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.000839 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.000910 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.000979 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.001050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.001120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.001267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.001342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.001413 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.001484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.001560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.001681 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.001767 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.001840 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.001911 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.001982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.002052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.002133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.002211 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.002283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.002354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.002430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.002503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.002583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.002662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.002734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.002804 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.002874 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.002944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.003025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.003097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.003174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.003174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.003303 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.003373 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.003452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.003525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.003595 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.003671 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.003671 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.003829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.003989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.004070 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.004143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.004222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.004295 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.004405 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.004512 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.004611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.004715 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.004812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.004908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.005010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.005116 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.005227 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.005326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.005431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.005531 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.005628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.005731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.005838 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.005943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.006030 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.006098 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.006171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.006238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.006318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.006400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.006479 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.006558 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.006676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.006766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.006849 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.006924 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.007047 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.007119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.007192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.007264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.007390 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.007468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.007541 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.007657 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.007734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.007807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.007995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.008115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.008193 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.008309 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.008392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.008478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.008553 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.008679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.008752 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.008825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.008941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.009017 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.009096 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.009177 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.009251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.009369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.009445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.009525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.009672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.009748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.009820 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.009891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.009963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.010024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.010149 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.010227 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.010299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.010416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.010500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.010618 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.010707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.010794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.010879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.010953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.011025 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.011097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.011214 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.011291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.011373 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.011448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.011526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.011606 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.011679 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.011752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.011831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.011967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.012045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.012117 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.012117 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.012247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.012331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.012407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.012479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.012551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.012688 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.012797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.012904 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.012992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.013060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.013133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.013251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.013329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.013410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.013495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.013576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.external = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.013649 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.013720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.013791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.013791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.013937 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.014557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.014637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.014710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.014790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.password = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.014790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] auth.token = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.014929 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.015048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.015128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.015128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.015267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.015267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.015427 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.015513 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.015513 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.015646 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.015719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.015791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.015920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.016046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.016126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.016296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.external = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.016419 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.016540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.016648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.016846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.016931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.017084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.017167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.017321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.password = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.017411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.017555 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.017637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] auth.token = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.017801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.017882 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.018043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.018137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.018277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.018360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.018527 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.018607 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.018787 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.018876 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.019041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.019123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.019276 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.019358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.019517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.019606 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.019771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.019872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.020031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.023113 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.023194 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.023282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.023361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.023435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.023435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.023565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.023638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.023722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.023803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.023974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.023974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.024115 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.024188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.024343 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.024430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.024506 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.024579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.024652 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.024725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.024810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.024887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.024961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.025041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.025115 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.025189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.025269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.025344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.025418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.025498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.025574 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.025648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.025728 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.025803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.025876 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.025949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.026022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.026095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.026178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.026254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.026327 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.026401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.026473 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.026546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.026627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.026702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.026781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.026856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.026928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.027009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.027084 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.027158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.027231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.027304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.027376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.027456 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.027532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.027605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.027678 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.027752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.027825 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.027979 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.028060 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.028134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.028208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.028281 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.028354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.028435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.028510 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.028583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.028656 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.028728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.028802 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.028883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.029006 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.029088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.029162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.029235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.029308 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.029379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.029453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.029527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.030298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.030470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.030753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.030846 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.031039 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.031189 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.031277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.031480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.031563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.031733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.031816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.031986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.032069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.032228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.032323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.032468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.032552 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.032703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.032783 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.032940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.033022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.033178 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.033262 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.033421 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.033502 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.033668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.033749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.033903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.033985 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.034132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.034213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.034399 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.034487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.034661 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.034744 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.034898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.034980 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.035133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.035237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.035368 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.035475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.035598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.035721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.035838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.035983 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.036229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.036313 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.036463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.036544 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.036706 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.036786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.036949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.037191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.037273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.037443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.037528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.037696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.037787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.037932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.038013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.038168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.038249 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.038405 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.038489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.038642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.038724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.038872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.038954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.039114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.039196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.039354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.039436 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.039612 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.039700 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.039834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.039957 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.040102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.040248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.040330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.040495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.040588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.040754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.040837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.041009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.041089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.041345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.041449 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.041527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.041601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.041769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.041851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.042013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.042103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.042249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.042330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.042490 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.042571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.042720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.042809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.042965 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.043048 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.043199 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.043287 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.043432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.043523 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.043667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.043749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.043926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.043992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.044164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.044323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.044458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.044585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.044710 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.044835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.044959 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.045092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.045235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.045363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.045363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.045599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.045723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.045918 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.046045 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.046180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.046307 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.046433 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.046557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.046690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.046816 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.046933 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.047024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.047144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.047226 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.047381 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] role.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.047463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.047622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.047702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] role.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.047901 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.051640 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.051781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.051881 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.051959 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.052034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.052107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.052180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.052266 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.052342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.052416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.052489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.052561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.052634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.052709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.052783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.052857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.052934 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.053007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.053080 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.053161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.053236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.053309 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.053382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.053455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.053537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.053612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.053685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.053685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.053804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.053877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] role.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.053957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.054032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] role.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.054104 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.054177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.054249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.054321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.054401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.054476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.054549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.054622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.054688 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.054760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.054841 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.054916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.054990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.055062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.055134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.055206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.055286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.055362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.055434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.055506 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.055578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.055650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.055731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.055806 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.055932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.056009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.056082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.056155 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.056241 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.056241 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.056376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.056449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.056521 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.056594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.056675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.056750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.056823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.056896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.056968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.057041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.057122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.057197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.057271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.057343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.057422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.057504 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.057580 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.057652 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.057724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.057796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.057869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.057949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.058025 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.058098 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.058171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.058243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.058416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.058556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.058688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.058816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.058945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.059093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.059223 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.059359 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.059487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.059615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.059615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.059875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.060002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.060137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.060281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.060443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.060567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.060693 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.060828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.061137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.061266 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.061403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.061403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.061795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.061923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.061923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.062159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.062293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.062421 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.062546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.062672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.062798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.062938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.063032 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.063206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.063330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.063456 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.063581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.063706 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.063839 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.063839 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.064114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.064242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.064370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.064499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.064638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.064776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.064905 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.065033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81602) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:49:14.065162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.065162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.065162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.065605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.065605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.065848 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.065975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.066134 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.066375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.066617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.066869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.067111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.067362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.067606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.067875 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.068123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.068378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.068615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.068861 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.069102 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 07:49:14.069274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81603) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 07:49:14.094622 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.094847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.095074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.096166 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.096406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.096638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.103582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.104984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.132891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.133117 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.135791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.136056 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.187886 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.188892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.238431 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.238605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.238695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.238775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.400745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.401003 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.401171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.401398 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.401622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.401844 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.402270 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.402547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.402772 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.402992 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.403222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.403426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.435328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.435561 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.435659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.435802 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.436780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.436780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.437008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.437091 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.437168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.437244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.437320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.437404 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.437481 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.437643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.454056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.454168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.467060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.467528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.467750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.468006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.468227 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.468430 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.468534 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.468638 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81602) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.468739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.468881 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.469107 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.469328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.469547 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.469764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81603) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 07:49:14.485348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.485558 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:49:14.486655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.486748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.486826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:49:14.486902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:49:14.486978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.487053 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.487138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.487215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 07:49:14.487215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.487349 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.487423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.487506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.487817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.488110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.496682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.496958 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.497229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.497453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.497538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.497739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.498019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.498821 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.505217 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.506126 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.508102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.508386 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.508668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.508953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.509037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.509236 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.509321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.509498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.509581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.509769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.509854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.510044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.510127 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.510392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.510481 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.510671 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.510753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.510953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.511034 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.511343 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.511627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.511936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.534212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.535698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.535798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.540254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.540346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.540346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.540701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.541216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.541524 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.542180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.542468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.542760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.548728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.549015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.550108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.550403 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.553104 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.553396 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.553678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.553960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.554234 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.554511 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.554597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.554780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.554872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.555051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.555137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.555525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.555645 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.555975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.556257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.556533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.572992 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.573273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.574685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.574971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.577143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.579239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.580393 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.580690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.582481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.582784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.584881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.586987 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.588009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.592062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.592171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.592171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.592171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.592421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.592701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.593044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.594726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.595036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.595347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.595653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.595970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.596273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.609947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.610236 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.610503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.610768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.613469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.613766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.614039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.614306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.617711 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.619212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.619524 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.621210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.622156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.622447 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.622737 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.622827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.623023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.623113 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.624031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.626563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.626858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.627153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.627461 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.630586 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.635629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.635936 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.636221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.636505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.636782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.637055 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.637327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.639137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.639632 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.639955 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.640251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.640545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.640831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.641114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.653265 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.656332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.656953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.659362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.660013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.660822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.662274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.662557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.662849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.662932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.664378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.665855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.666144 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.666446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.669352 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.671524 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.673767 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.674398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.674689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.674978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.675244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.675332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.678181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.678479 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.678773 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.679069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.683286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.683580 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.683880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.688390 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.688685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.688970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.691459 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81602) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.691741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.692048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.692323 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.692611 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.692884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.693165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.693430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.693705 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.693978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.694246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.694513 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.694788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.695046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81602) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.695904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81603) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 07:49:14.696196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.696483 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.696764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.697060 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.697338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.697616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.697890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.698181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.698458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.698744 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.699025 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.699305 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.699572 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81603) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 07:49:14.729495 dv-cinder-852211-5-smb devstack@keystone.service[81602]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564c1c3a89c0 pid: 81602 (default app) Aug 24 07:49:14.733485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433120ed-76e7-448e-afe6-c5c931821421 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:14.733794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433120ed-76e7-448e-afe6-c5c931821421 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:14.734065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433120ed-76e7-448e-afe6-c5c931821421 None None] PATH_INFO: `/v3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:14.735099 dv-cinder-852211-5-smb devstack@keystone.service[81603]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x564c1c3a89c0 pid: 81603 (default app) Aug 24 07:49:14.738214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Wed Aug 24 07:49:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:22.051642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0826e-0127-43ac-a48a-5dc5b6d87c72 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:22.052232 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0826e-0127-43ac-a48a-5dc5b6d87c72 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:22.052232 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef0826e-0127-43ac-a48a-5dc5b6d87c72 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:22.056471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:49:22.063717 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcabcf7-f4ab-44be-ba97-1c4de70687e6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:22.064158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcabcf7-f4ab-44be-ba97-1c4de70687e6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:22.064282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcabcf7-f4ab-44be-ba97-1c4de70687e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:22.133890 dv-cinder-852211-5-smb devstack@keystone.service[81602]: INFO dbcounter [None req-9fcabcf7-f4ab-44be-ba97-1c4de70687e6 None None] Registered counter for database keystone Aug 24 07:49:22.152512 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG oslo_db.sqlalchemy.engines [None req-9fcabcf7-f4ab-44be-ba97-1c4de70687e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81602) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:49:22.158749 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writer thread running {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:49:22.335594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG passlib.handlers.bcrypt [None req-9fcabcf7-f4ab-44be-ba97-1c4de70687e6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81602) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 07:49:22.335955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG passlib.handlers.bcrypt [None req-9fcabcf7-f4ab-44be-ba97-1c4de70687e6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81602) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 07:49:22.390797 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9fcabcf7-f4ab-44be-ba97-1c4de70687e6 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:22.392439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9fcabcf7-f4ab-44be-ba97-1c4de70687e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:22.518287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 07:49:22.932108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0826e-0127-43ac-a48a-5dc5b6d87c72 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:23.000046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: INFO dbcounter [None req-eef0826e-0127-43ac-a48a-5dc5b6d87c72 None None] Registered counter for database keystone Aug 24 07:49:23.021992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG oslo_db.sqlalchemy.engines [None req-eef0826e-0127-43ac-a48a-5dc5b6d87c72 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81603) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 07:49:23.028098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writer thread running {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 07:49:23.153661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef0826e-0127-43ac-a48a-5dc5b6d87c72 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:23.158207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380d080-209f-445f-a2c6-2c8b88c5899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:23.158826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380d080-209f-445f-a2c6-2c8b88c5899d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:23.159105 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380d080-209f-445f-a2c6-2c8b88c5899d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:23.159378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380d080-209f-445f-a2c6-2c8b88c5899d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:23.167340 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380d080-209f-445f-a2c6-2c8b88c5899d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:23.218685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6380d080-209f-445f-a2c6-2c8b88c5899d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 07:49:23.218971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380d080-209f-445f-a2c6-2c8b88c5899d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:23.228362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1324 bytes} [Wed Aug 24 07:49:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:49:23.234351 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcabcf7-f4ab-44be-ba97-1c4de70687e6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:23.249405 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcabcf7-f4ab-44be-ba97-1c4de70687e6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:23.253885 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec5d0d4-cfa1-435a-a932-3b34a6eb1315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:23.255786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5d0d4-cfa1-435a-a932-3b34a6eb1315 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:23.256110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5d0d4-cfa1-435a-a932-3b34a6eb1315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:23.256394 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5d0d4-cfa1-435a-a932-3b34a6eb1315 admin admin] PATH_INFO: `/v3/projects/853a156fb9564ec38e1fef2222e14a94` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:23.258038 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5d0d4-cfa1-435a-a932-3b34a6eb1315 admin admin] RBAC: Authorizing `identity:get_project(project_id=853a156fb9564ec38e1fef2222e14a94)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:23.310062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2ec5d0d4-cfa1-435a-a932-3b34a6eb1315 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 07:49:23.310404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec5d0d4-cfa1-435a-a932-3b34a6eb1315 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:23.315627 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 3/5] 10.222.0.62 () {56 vars in 1207 bytes} [Wed Aug 24 07:49:23 2022] GET /identity/v3/projects/853a156fb9564ec38e1fef2222e14a94 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:25.183603 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3dce9-6885-48d8-a987-34795a0a1f5c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:25.184154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3dce9-6885-48d8-a987-34795a0a1f5c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:25.184154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3dce9-6885-48d8-a987-34795a0a1f5c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:25.188920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 3/6] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:25.194314 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ceaac-1856-49b6-a196-0c27744493a7 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:25.194729 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ceaac-1856-49b6-a196-0c27744493a7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:25.194856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ceaac-1856-49b6-a196-0c27744493a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:25.214507 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7d0ceaac-1856-49b6-a196-0c27744493a7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:25.216045 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7d0ceaac-1856-49b6-a196-0c27744493a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:25.224119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 07:49:25.489468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3dce9-6885-48d8-a987-34795a0a1f5c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:25.501487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3dce9-6885-48d8-a987-34795a0a1f5c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:25.505712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6ec2ba-bf5e-4a63-8719-0b30e92a4c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:25.506309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec2ba-bf5e-4a63-8719-0b30e92a4c4a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:25.506594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec2ba-bf5e-4a63-8719-0b30e92a4c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:25.506871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6ec2ba-bf5e-4a63-8719-0b30e92a4c4a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:25.514519 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ec2ba-bf5e-4a63-8719-0b30e92a4c4a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:25.516329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6ec2ba-bf5e-4a63-8719-0b30e92a4c4a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:25.524895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1324 bytes} [Wed Aug 24 07:49:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:49:25.530749 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ceaac-1856-49b6-a196-0c27744493a7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:25.539738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ceaac-1856-49b6-a196-0c27744493a7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:25.544286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5ea27-c90b-4a17-9416-d55699d1fcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:25.544913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ea27-c90b-4a17-9416-d55699d1fcbc admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:25.545762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ea27-c90b-4a17-9416-d55699d1fcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:25.546031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5ea27-c90b-4a17-9416-d55699d1fcbc admin admin] PATH_INFO: `/v3/users/5ed7209395664f8f80ff40e9951b896e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:25.547352 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5ea27-c90b-4a17-9416-d55699d1fcbc admin admin] RBAC: Authorizing `identity:get_user(user_id=5ed7209395664f8f80ff40e9951b896e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:25.549189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5ea27-c90b-4a17-9416-d55699d1fcbc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:25.550711 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 5/9] 10.222.0.62 () {56 vars in 1198 bytes} [Wed Aug 24 07:49:25 2022] GET /identity/v3/users/5ed7209395664f8f80ff40e9951b896e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:27.521548 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaeb5a-e5f0-43c6-9586-c7e262d8a5ca None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:27.522060 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaeb5a-e5f0-43c6-9586-c7e262d8a5ca None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:27.522145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caaeb5a-e5f0-43c6-9586-c7e262d8a5ca None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:27.523414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:49:27.528494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8bd28-eba2-447b-a72b-addc4450c3c2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:27.528875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8bd28-eba2-447b-a72b-addc4450c3c2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:27.529044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8bd28-eba2-447b-a72b-addc4450c3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:27.535959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77adf1-368b-4106-9f17-a95db38b3bdb None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:27.536253 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77adf1-368b-4106-9f17-a95db38b3bdb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:27.536535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77adf1-368b-4106-9f17-a95db38b3bdb None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:27.537822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 6/11] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:49:27.542741 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0a7bc-de8c-41a2-a0ab-9577caa5353c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:27.543019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0a7bc-de8c-41a2-a0ab-9577caa5353c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:27.543302 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0a7bc-de8c-41a2-a0ab-9577caa5353c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:27.547789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4ed8bd28-eba2-447b-a72b-addc4450c3c2 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:27.548993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4ed8bd28-eba2-447b-a72b-addc4450c3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:27.586152 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG passlib.handlers.bcrypt [None req-e8d0a7bc-de8c-41a2-a0ab-9577caa5353c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81603) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 07:49:27.586573 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG passlib.handlers.bcrypt [None req-e8d0a7bc-de8c-41a2-a0ab-9577caa5353c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81603) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 07:49:27.628892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 6/12] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:27.632857 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e8d0a7bc-de8c-41a2-a0ab-9577caa5353c None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:27.634428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e8d0a7bc-de8c-41a2-a0ab-9577caa5353c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:27.732644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 7/13] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:49:27.892440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8bd28-eba2-447b-a72b-addc4450c3c2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:27.915853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:27.995581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8bd28-eba2-447b-a72b-addc4450c3c2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:28.007353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0a7bc-de8c-41a2-a0ab-9577caa5353c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:28.030841 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d9639-1702-4d0c-b5f6-c876a3d9e113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:28.031450 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d9639-1702-4d0c-b5f6-c876a3d9e113 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:28.031735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d9639-1702-4d0c-b5f6-c876a3d9e113 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:28.032038 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d9639-1702-4d0c-b5f6-c876a3d9e113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:28.100585 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d9639-1702-4d0c-b5f6-c876a3d9e113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:28.102067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d9639-1702-4d0c-b5f6-c876a3d9e113 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:28.109180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0a7bc-de8c-41a2-a0ab-9577caa5353c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:28.111422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:28.125679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:28.146469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42188d-abf1-4beb-8207-6712fecba5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:28.147511 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42188d-abf1-4beb-8207-6712fecba5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:28.147796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42188d-abf1-4beb-8207-6712fecba5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:28.148098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e42188d-abf1-4beb-8207-6712fecba5f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:28.160998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e42188d-abf1-4beb-8207-6712fecba5f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5e42188d-abf1-4beb-8207-6712fecba5f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:28.169445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:28.170904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:28.171682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:28.171682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:28.171682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:28.171682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:28.171682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:28.171682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:28.171682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:28.171682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:28.171682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:28.171682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:28.171682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:49:28.171682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:49:28.171682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 8/14] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:49:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:49:28.176972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42188d-abf1-4beb-8207-6712fecba5f9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:28.202201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 7/15] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:49:28.207605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d9639-1702-4d0c-b5f6-c876a3d9e113 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:28.278834 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e42188d-abf1-4beb-8207-6712fecba5f9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:28.307069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d9639-1702-4d0c-b5f6-c876a3d9e113 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:28.312436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0063c53-21b4-4452-9822-c8ff5cfd504d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:28.313040 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0063c53-21b4-4452-9822-c8ff5cfd504d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:28.313322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0063c53-21b4-4452-9822-c8ff5cfd504d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:28.313596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0063c53-21b4-4452-9822-c8ff5cfd504d None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:28.314260 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0063c53-21b4-4452-9822-c8ff5cfd504d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:28.314559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0063c53-21b4-4452-9822-c8ff5cfd504d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:28.316020 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0063c53-21b4-4452-9822-c8ff5cfd504d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:28.328265 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 9/16] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:28.329063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:28.333861 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0063c53-21b4-4452-9822-c8ff5cfd504d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:28.340361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab3c3a-9213-4560-a27f-5ec2d6a3a70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:28.341010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3c3a-9213-4560-a27f-5ec2d6a3a70b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:28.343581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3c3a-9213-4560-a27f-5ec2d6a3a70b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:28.343581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3c3a-9213-4560-a27f-5ec2d6a3a70b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:28.352854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab3c3a-9213-4560-a27f-5ec2d6a3a70b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:28.354582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab3c3a-9213-4560-a27f-5ec2d6a3a70b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:28.361218 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-98ab3c3a-9213-4560-a27f-5ec2d6a3a70b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:49:28.372545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:28.374361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:49:28.375225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:49:28.375225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:49:28.375225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:49:28.375225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 8/17] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:49:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:49:28.379980 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab3c3a-9213-4560-a27f-5ec2d6a3a70b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:28.436623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0063c53-21b4-4452-9822-c8ff5cfd504d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:28.470659 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6fcae-ec36-4fd0-b0fe-be9cb0f3cdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:28.471296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6fcae-ec36-4fd0-b0fe-be9cb0f3cdb6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:28.471578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6fcae-ec36-4fd0-b0fe-be9cb0f3cdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:28.471879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc6fcae-ec36-4fd0-b0fe-be9cb0f3cdb6 None admin] PATH_INFO: `/v3/users/5ed7209395664f8f80ff40e9951b896e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:28.473367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6fcae-ec36-4fd0-b0fe-be9cb0f3cdb6 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed7209395664f8f80ff40e9951b896e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:28.474809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc6fcae-ec36-4fd0-b0fe-be9cb0f3cdb6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:28.476418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 10/18] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:28 2022] GET /identity/v3/users/5ed7209395664f8f80ff40e9951b896e => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:28.480649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab3c3a-9213-4560-a27f-5ec2d6a3a70b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:28.482046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6fcae-ec36-4fd0-b0fe-be9cb0f3cdb6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:28.515464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c74ab-bc16-468c-b8e0-f0b009f9bc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:28.516093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c74ab-bc16-468c-b8e0-f0b009f9bc14 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:28.516372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c74ab-bc16-468c-b8e0-f0b009f9bc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:28.516644 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48c74ab-bc16-468c-b8e0-f0b009f9bc14 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:28.517279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c74ab-bc16-468c-b8e0-f0b009f9bc14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:28.517583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c74ab-bc16-468c-b8e0-f0b009f9bc14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:28.518940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48c74ab-bc16-468c-b8e0-f0b009f9bc14 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:28.536068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 9/19] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:49:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:28.582075 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:28.589211 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc6fcae-ec36-4fd0-b0fe-be9cb0f3cdb6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:28.626600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8ac28-6928-477b-86b5-75010649e6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:28.627311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ac28-6928-477b-86b5-75010649e6b7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:28.627591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ac28-6928-477b-86b5-75010649e6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:28.627891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8ac28-6928-477b-86b5-75010649e6b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:28.629047 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8ac28-6928-477b-86b5-75010649e6b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:28.630489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8ac28-6928-477b-86b5-75010649e6b7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:28.632101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 11/20] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:49:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:28.638161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c74ab-bc16-468c-b8e0-f0b009f9bc14 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:28.675134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:28.742036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48c74ab-bc16-468c-b8e0-f0b009f9bc14 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:28.777902 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60225cd9-e078-4891-9d00-ea7db8962bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:28.778693 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60225cd9-e078-4891-9d00-ea7db8962bbc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:28.778976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60225cd9-e078-4891-9d00-ea7db8962bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:28.779901 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60225cd9-e078-4891-9d00-ea7db8962bbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:28.780656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60225cd9-e078-4891-9d00-ea7db8962bbc None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.domain.id=default, user.id=5ed7209395664f8f80ff40e9951b896e) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:28.780965 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60225cd9-e078-4891-9d00-ea7db8962bbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:28.782397 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60225cd9-e078-4891-9d00-ea7db8962bbc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:28.789770 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 10/21] 10.222.0.62 () {56 vars in 1322 bytes} [Wed Aug 24 07:49:28 2022] GET /identity/v3/role_assignments?user.id=5ed7209395664f8f80ff40e9951b896e&scope.domain.id=default&role.id=68b1888f7bb644a39938b8d41006a813 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:30.748553 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd18627-01bd-4a51-9a41-2802c9c03b8a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:30.749634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd18627-01bd-4a51-9a41-2802c9c03b8a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:30.750140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd18627-01bd-4a51-9a41-2802c9c03b8a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:30.751702 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 12/22] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:30.757397 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5972a-8a51-4ee4-96ce-d73e3f61cd96 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:30.758273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5972a-8a51-4ee4-96ce-d73e3f61cd96 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:30.758802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df5972a-8a51-4ee4-96ce-d73e3f61cd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:30.788899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6df5972a-8a51-4ee4-96ce-d73e3f61cd96 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:30.790479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6df5972a-8a51-4ee4-96ce-d73e3f61cd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:30.879326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 11/23] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:30.930412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d1c9e-8eab-4bb8-b037-f1333dba8211 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:30.931067 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d1c9e-8eab-4bb8-b037-f1333dba8211 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:30.931557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d1c9e-8eab-4bb8-b037-f1333dba8211 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:30.933129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 13/24] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:30.939009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9ccf5-89a5-409a-a0f5-79c50a34798a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:30.939548 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9ccf5-89a5-409a-a0f5-79c50a34798a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:30.940054 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce9ccf5-89a5-409a-a0f5-79c50a34798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:30.964815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5ce9ccf5-89a5-409a-a0f5-79c50a34798a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:30.966376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5ce9ccf5-89a5-409a-a0f5-79c50a34798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:30.994608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:31.053272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 12/25] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:31.241853 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ef84d-5424-457e-b281-fa0a31c2c1b8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:31.242491 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ef84d-5424-457e-b281-fa0a31c2c1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:31.243109 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ef84d-5424-457e-b281-fa0a31c2c1b8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:31.244854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 14/26] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:31.250754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc797-6ffe-42c5-9afa-0a6d19709ed5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:31.251293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc797-6ffe-42c5-9afa-0a6d19709ed5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:31.251771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc797-6ffe-42c5-9afa-0a6d19709ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:31.276805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a16fc797-6ffe-42c5-9afa-0a6d19709ed5 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:31.278498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a16fc797-6ffe-42c5-9afa-0a6d19709ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:31.336337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ef84d-5424-457e-b281-fa0a31c2c1b8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:31.397337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 13/27] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:31.499725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ef84d-5424-457e-b281-fa0a31c2c1b8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:31.500095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81393d13-c0ae-43f0-869c-eab80a872128 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:31.500330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81393d13-c0ae-43f0-869c-eab80a872128 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:31.500610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81393d13-c0ae-43f0-869c-eab80a872128 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:31.501945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 14/28] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:49:31.510341 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f98ab9-1d9d-444a-bee4-e10fb9b127e1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:31.510626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f98ab9-1d9d-444a-bee4-e10fb9b127e1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:31.510904 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f98ab9-1d9d-444a-bee4-e10fb9b127e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:31.541724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-14f98ab9-1d9d-444a-bee4-e10fb9b127e1 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:31.543049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-14f98ab9-1d9d-444a-bee4-e10fb9b127e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:31.547656 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9da3f-37d2-4102-81dd-19dc7e468d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:31.548332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9da3f-37d2-4102-81dd-19dc7e468d14 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:31.548611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9da3f-37d2-4102-81dd-19dc7e468d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:31.548883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9da3f-37d2-4102-81dd-19dc7e468d14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:31.570855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9da3f-37d2-4102-81dd-19dc7e468d14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:31.572394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9da3f-37d2-4102-81dd-19dc7e468d14 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7fe9da3f-37d2-4102-81dd-19dc7e468d14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:49:31.602039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:31.602967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:49:31.604559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:49:31.604559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:49:31.604559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:49:31.604559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 15/29] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:49:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:31.604559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9da3f-37d2-4102-81dd-19dc7e468d14 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:31.637401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:31.674779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 15/30] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:31.676189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f98ab9-1d9d-444a-bee4-e10fb9b127e1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:31.700287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:31.791575 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f98ab9-1d9d-444a-bee4-e10fb9b127e1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:31.830086 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d447e2b-082a-4faf-ae9a-9deea1166c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:31.831062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d447e2b-082a-4faf-ae9a-9deea1166c49 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:31.831554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d447e2b-082a-4faf-ae9a-9deea1166c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:31.832069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d447e2b-082a-4faf-ae9a-9deea1166c49 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:31.833181 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d447e2b-082a-4faf-ae9a-9deea1166c49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:31.833709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d447e2b-082a-4faf-ae9a-9deea1166c49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:31.835285 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d447e2b-082a-4faf-ae9a-9deea1166c49 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:31.843529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9da3f-37d2-4102-81dd-19dc7e468d14 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:31.851039 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 16/31] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:49:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:31.852453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d447e2b-082a-4faf-ae9a-9deea1166c49 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:31.963322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d447e2b-082a-4faf-ae9a-9deea1166c49 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:31.968330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:31.992852 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9df5f-7867-4edb-85ae-e0306e9f77ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:31.993490 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9df5f-7867-4edb-85ae-e0306e9f77ed None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:31.993774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9df5f-7867-4edb-85ae-e0306e9f77ed None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:31.994051 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9df5f-7867-4edb-85ae-e0306e9f77ed None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:31.995111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9df5f-7867-4edb-85ae-e0306e9f77ed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:31.997013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9df5f-7867-4edb-85ae-e0306e9f77ed None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:32.003708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eac826-6f75-4716-b2d4-2eebfcbaf32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:32.004604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eac826-6f75-4716-b2d4-2eebfcbaf32e None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:32.005776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eac826-6f75-4716-b2d4-2eebfcbaf32e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:32.006272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eac826-6f75-4716-b2d4-2eebfcbaf32e None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:32.007278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eac826-6f75-4716-b2d4-2eebfcbaf32e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:32.008781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eac826-6f75-4716-b2d4-2eebfcbaf32e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:32.202281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 16/32] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Aug 24 07:49:31 2022] POST /identity/v3/roles => generated 219 bytes in 599 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:49:32.203517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9df5f-7867-4edb-85ae-e0306e9f77ed None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:32.232610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 17/33] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Aug 24 07:49:31 2022] POST /identity/v3/roles => generated 225 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:49:32.233887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eac826-6f75-4716-b2d4-2eebfcbaf32e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:32.305636 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:32.338724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9df5f-7867-4edb-85ae-e0306e9f77ed None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:32.369210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eac826-6f75-4716-b2d4-2eebfcbaf32e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:32.389476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bbf6cd-97ab-4bf9-955b-d9a64d34c152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:32.390135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbf6cd-97ab-4bf9-955b-d9a64d34c152 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:32.390423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbf6cd-97ab-4bf9-955b-d9a64d34c152 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:32.390704 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bbf6cd-97ab-4bf9-955b-d9a64d34c152 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:32.391383 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbf6cd-97ab-4bf9-955b-d9a64d34c152 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:32.393059 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bbf6cd-97ab-4bf9-955b-d9a64d34c152 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:32.438798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896aac1-2c92-49b6-9328-24ec1f526207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:32.439586 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896aac1-2c92-49b6-9328-24ec1f526207 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:32.439911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896aac1-2c92-49b6-9328-24ec1f526207 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:32.440197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896aac1-2c92-49b6-9328-24ec1f526207 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:32.454006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:32.455158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896aac1-2c92-49b6-9328-24ec1f526207 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:32.531266 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 17/34] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 24 07:49:32 2022] POST /identity/v3/projects => generated 301 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:49:32.533345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c018a13-5a74-4d31-bcaa-237ba5d6524c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:32.533875 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c018a13-5a74-4d31-bcaa-237ba5d6524c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:32.534369 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c018a13-5a74-4d31-bcaa-237ba5d6524c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:32.538932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 18/35] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:32.546550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d2f3a-50f9-4fb8-b969-17b46a679812 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:32.550830 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d2f3a-50f9-4fb8-b969-17b46a679812 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:32.550830 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d2f3a-50f9-4fb8-b969-17b46a679812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-7896aac1-2c92-49b6-9328-24ec1f526207 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:32.573417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:32.574388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:32.582568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:32.582568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:32.582568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:32.582568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:32.582568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:32.582568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:32.582568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:32.582568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:32.582568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:32.582568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:32.582568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:49:32.582568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:49:32.582568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 18/36] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:49:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:32.582568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896aac1-2c92-49b6-9328-24ec1f526207 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:32.597307 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7e8d2f3a-50f9-4fb8-b969-17b46a679812 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:32.599064 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7e8d2f3a-50f9-4fb8-b969-17b46a679812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:32.695022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 19/37] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:49:32.696417 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b6386-7b6e-4d4e-927b-74358ca7e6f8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:32.696712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b6386-7b6e-4d4e-927b-74358ca7e6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:32.697067 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8b6386-7b6e-4d4e-927b-74358ca7e6f8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:32.702375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 20/38] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:32.709588 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4d687-42d0-4898-b06c-2b2229516af7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:32.710342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4d687-42d0-4898-b06c-2b2229516af7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:32.710925 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4d687-42d0-4898-b06c-2b2229516af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:32.729591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896aac1-2c92-49b6-9328-24ec1f526207 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:32.730318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-76f4d687-42d0-4898-b06c-2b2229516af7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:32.731501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-76f4d687-42d0-4898-b06c-2b2229516af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:32.771572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b5f86-efac-48fc-a616-f4b5afb10f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:32.772259 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5f86-efac-48fc-a616-f4b5afb10f50 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:32.772539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5f86-efac-48fc-a616-f4b5afb10f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:32.772812 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b5f86-efac-48fc-a616-f4b5afb10f50 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:32.773491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b5f86-efac-48fc-a616-f4b5afb10f50 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:32.773790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b5f86-efac-48fc-a616-f4b5afb10f50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:32.775300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788b5f86-efac-48fc-a616-f4b5afb10f50 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:32.789343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 19/39] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:32.795759 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b5f86-efac-48fc-a616-f4b5afb10f50 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:32.797971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:32.817496 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 21/40] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:32.871759 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:32.913350 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b5f86-efac-48fc-a616-f4b5afb10f50 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:32.946850 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9cb69-5ec3-49ab-ac10-348a979fe979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:32.947485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9cb69-5ec3-49ab-ac10-348a979fe979 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:32.947766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9cb69-5ec3-49ab-ac10-348a979fe979 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:32.948068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9cb69-5ec3-49ab-ac10-348a979fe979 None admin] PATH_INFO: `/v3/users/5ed7209395664f8f80ff40e9951b896e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:32.949401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9cb69-5ec3-49ab-ac10-348a979fe979 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed7209395664f8f80ff40e9951b896e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:32.950867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9cb69-5ec3-49ab-ac10-348a979fe979 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:32.952702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 20/41] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:32 2022] GET /identity/v3/users/5ed7209395664f8f80ff40e9951b896e => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:32.957994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4d687-42d0-4898-b06c-2b2229516af7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:32.972916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9cb69-5ec3-49ab-ac10-348a979fe979 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:33.068531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4d687-42d0-4898-b06c-2b2229516af7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:33.082647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9cb69-5ec3-49ab-ac10-348a979fe979 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:33.106167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b3c6b-e27c-4a95-b969-2a16a98afe5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:33.106831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3c6b-e27c-4a95-b969-2a16a98afe5a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:33.107115 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3c6b-e27c-4a95-b969-2a16a98afe5a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:33.108257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b3c6b-e27c-4a95-b969-2a16a98afe5a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:33.109227 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b3c6b-e27c-4a95-b969-2a16a98afe5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:33.110671 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b3c6b-e27c-4a95-b969-2a16a98afe5a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:33.111419 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:33.112284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 22/42] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:49:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:33.113043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b3c6b-e27c-4a95-b969-2a16a98afe5a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:33.124298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ed388-82d0-4781-b1c7-b50219b45cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:33.124922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed388-82d0-4781-b1c7-b50219b45cce None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:33.125206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed388-82d0-4781-b1c7-b50219b45cce None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:33.125481 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ed388-82d0-4781-b1c7-b50219b45cce None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:33.127204 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ed388-82d0-4781-b1c7-b50219b45cce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:33.127740 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ed388-82d0-4781-b1c7-b50219b45cce None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:33.166614 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:33.209755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b3c6b-e27c-4a95-b969-2a16a98afe5a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:33.213522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 21/43] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Aug 24 07:49:32 2022] POST /identity/v3/roles => generated 223 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:49:33.214327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ed388-82d0-4781-b1c7-b50219b45cce None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:33.256510 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773df8e-8b76-46b2-957d-8afaa13118bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:33.257088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773df8e-8b76-46b2-957d-8afaa13118bf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:33.257376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773df8e-8b76-46b2-957d-8afaa13118bf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:33.257658 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773df8e-8b76-46b2-957d-8afaa13118bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:33.258975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773df8e-8b76-46b2-957d-8afaa13118bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:33.260519 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f773df8e-8b76-46b2-957d-8afaa13118bf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:33.262226 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 23/44] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:49:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:33.268798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773df8e-8b76-46b2-957d-8afaa13118bf None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:33.338158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ed388-82d0-4781-b1c7-b50219b45cce None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:33.384837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773df8e-8b76-46b2-957d-8afaa13118bf None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:33.389056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14588e44-54a2-4181-9dc5-c58cc824ae24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:33.389747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14588e44-54a2-4181-9dc5-c58cc824ae24 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:33.390030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14588e44-54a2-4181-9dc5-c58cc824ae24 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:33.390306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14588e44-54a2-4181-9dc5-c58cc824ae24 None admin] PATH_INFO: `/v3/domains/default/users/5ed7209395664f8f80ff40e9951b896e/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:33.392685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14588e44-54a2-4181-9dc5-c58cc824ae24 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5ed7209395664f8f80ff40e9951b896e, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:33.394108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14588e44-54a2-4181-9dc5-c58cc824ae24 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:33.410874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:33.421878 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fded1e55-115f-4ffd-910d-9671627f1ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:33.422496 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded1e55-115f-4ffd-910d-9671627f1ddb None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:33.422785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded1e55-115f-4ffd-910d-9671627f1ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:33.423066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fded1e55-115f-4ffd-910d-9671627f1ddb None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:33.423782 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded1e55-115f-4ffd-910d-9671627f1ddb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:33.425248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fded1e55-115f-4ffd-910d-9671627f1ddb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:33.458820 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 22/45] 10.222.0.62 () {58 vars in 1361 bytes} [Wed Aug 24 07:49:33 2022] PUT /identity/v3/domains/default/users/5ed7209395664f8f80ff40e9951b896e/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:49:33.518385 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 24/46] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 24 07:49:33 2022] POST /identity/v3/projects => generated 312 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:49:35.360218 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628862a5-a538-4464-9e34-a103887c988c None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:35.360740 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628862a5-a538-4464-9e34-a103887c988c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:35.360824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628862a5-a538-4464-9e34-a103887c988c None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:35.362110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 23/47] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:35.367498 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d149779-1853-4b80-bb4e-3b48945a4cbc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:35.367950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d149779-1853-4b80-bb4e-3b48945a4cbc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:35.368084 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d149779-1853-4b80-bb4e-3b48945a4cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:35.386742 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8d149779-1853-4b80-bb4e-3b48945a4cbc None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:35.388002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8d149779-1853-4b80-bb4e-3b48945a4cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:35.434082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a46c63-dc82-4498-a9ba-1e0e819f6518 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:35.434372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a46c63-dc82-4498-a9ba-1e0e819f6518 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:35.434653 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a46c63-dc82-4498-a9ba-1e0e819f6518 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:35.436684 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 24/48] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:49:35.441593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732259ed-d0cb-4a87-9dc4-035839659303 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:35.441879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732259ed-d0cb-4a87-9dc4-035839659303 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:35.442157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732259ed-d0cb-4a87-9dc4-035839659303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:35.454369 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 25/49] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:49:35.460756 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-732259ed-d0cb-4a87-9dc4-035839659303 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:35.462292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-732259ed-d0cb-4a87-9dc4-035839659303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:35.505280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:35.528037 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 25/50] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:49:35.722461 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d149779-1853-4b80-bb4e-3b48945a4cbc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:35.803519 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732259ed-d0cb-4a87-9dc4-035839659303 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:35.819014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d149779-1853-4b80-bb4e-3b48945a4cbc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:35.821298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:35.854292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fc4ae-6655-4d65-b935-96306b9d9bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:35.854925 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fc4ae-6655-4d65-b935-96306b9d9bd9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:35.855203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fc4ae-6655-4d65-b935-96306b9d9bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:35.855475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fc4ae-6655-4d65-b935-96306b9d9bd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:35.865615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fc4ae-6655-4d65-b935-96306b9d9bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ea7fc4ae-6655-4d65-b935-96306b9d9bd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:35.870689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:35.871727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:35.873465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:35.873465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:35.873465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:35.873465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:35.873465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:35.873465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:35.873465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:35.873465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:35.873465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:35.873465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:35.873465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:49:35.873465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:49:35.873465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 26/51] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:49:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:49:35.877963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fc4ae-6655-4d65-b935-96306b9d9bd9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:35.906523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732259ed-d0cb-4a87-9dc4-035839659303 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:35.939964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c147e46-e332-4a0e-b592-1fa6d7d543ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:35.940597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c147e46-e332-4a0e-b592-1fa6d7d543ac None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:35.940882 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c147e46-e332-4a0e-b592-1fa6d7d543ac None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:35.941157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c147e46-e332-4a0e-b592-1fa6d7d543ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:35.942297 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c147e46-e332-4a0e-b592-1fa6d7d543ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:35.943750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c147e46-e332-4a0e-b592-1fa6d7d543ac None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:35.945350 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 26/52] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:49:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:35.950809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c147e46-e332-4a0e-b592-1fa6d7d543ac None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:35.979638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fc4ae-6655-4d65-b935-96306b9d9bd9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:35.996797 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:36.015342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fb7e8-47e1-40e9-9bdb-ae6975ebc847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:36.015979 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fb7e8-47e1-40e9-9bdb-ae6975ebc847 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:36.016263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fb7e8-47e1-40e9-9bdb-ae6975ebc847 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:36.016539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fb7e8-47e1-40e9-9bdb-ae6975ebc847 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:36.017198 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fb7e8-47e1-40e9-9bdb-ae6975ebc847 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:36.017501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fb7e8-47e1-40e9-9bdb-ae6975ebc847 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:36.018929 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fb7e8-47e1-40e9-9bdb-ae6975ebc847 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:36.026943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 27/53] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:36.032571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fb7e8-47e1-40e9-9bdb-ae6975ebc847 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:36.050902 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c147e46-e332-4a0e-b592-1fa6d7d543ac None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:36.088312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1972b-b6f4-4c20-a192-6ea880a092f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:36.088949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1972b-b6f4-4c20-a192-6ea880a092f6 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:36.089232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1972b-b6f4-4c20-a192-6ea880a092f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:36.089505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1972b-b6f4-4c20-a192-6ea880a092f6 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:36.090169 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1972b-b6f4-4c20-a192-6ea880a092f6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:36.092128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1972b-b6f4-4c20-a192-6ea880a092f6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:36.164344 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:36.209925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 27/54] 10.222.0.62 () {60 vars in 1140 bytes} [Wed Aug 24 07:49:35 2022] POST /identity/v3/projects => generated 298 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:49:36.239319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fb7e8-47e1-40e9-9bdb-ae6975ebc847 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:36.276447 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc51e8e-db22-4bb8-a531-d82821f61921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:36.277094 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc51e8e-db22-4bb8-a531-d82821f61921 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:36.277386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc51e8e-db22-4bb8-a531-d82821f61921 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:36.277652 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc51e8e-db22-4bb8-a531-d82821f61921 None admin] PATH_INFO: `/v3/users/5ed7209395664f8f80ff40e9951b896e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:36.278827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc51e8e-db22-4bb8-a531-d82821f61921 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed7209395664f8f80ff40e9951b896e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:36.280691 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc51e8e-db22-4bb8-a531-d82821f61921 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:36.282405 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 28/55] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:36 2022] GET /identity/v3/users/5ed7209395664f8f80ff40e9951b896e => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:36.288309 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1972b-b6f4-4c20-a192-6ea880a092f6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:36.390388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:36.394252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1972b-b6f4-4c20-a192-6ea880a092f6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:36.428078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376027c-674d-4afa-9e3a-5766256450c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:36.428725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376027c-674d-4afa-9e3a-5766256450c8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:36.429010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376027c-674d-4afa-9e3a-5766256450c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:36.429284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376027c-674d-4afa-9e3a-5766256450c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:36.430402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376027c-674d-4afa-9e3a-5766256450c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:36.431954 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376027c-674d-4afa-9e3a-5766256450c8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:36.433759 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 28/56] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:49:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:36.439947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc51e8e-db22-4bb8-a531-d82821f61921 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:36.533520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:36.540049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc51e8e-db22-4bb8-a531-d82821f61921 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:36.574839 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0219d0a5-ae52-4935-b35a-8670dfecb5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:36.575457 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219d0a5-ae52-4935-b35a-8670dfecb5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:36.575742 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219d0a5-ae52-4935-b35a-8670dfecb5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:36.576208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0219d0a5-ae52-4935-b35a-8670dfecb5d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:36.577253 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219d0a5-ae52-4935-b35a-8670dfecb5d1 None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.domain.id=default, user.id=5ed7209395664f8f80ff40e9951b896e) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:36.577571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219d0a5-ae52-4935-b35a-8670dfecb5d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:36.579013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0219d0a5-ae52-4935-b35a-8670dfecb5d1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:36.587485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 29/57] 10.222.0.62 () {56 vars in 1322 bytes} [Wed Aug 24 07:49:36 2022] GET /identity/v3/role_assignments?user.id=5ed7209395664f8f80ff40e9951b896e&scope.domain.id=default&role.id=68b1888f7bb644a39938b8d41006a813 => generated 530 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:38.144073 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39dc84-0912-4839-b5fe-97b133985ab7 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:38.144594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39dc84-0912-4839-b5fe-97b133985ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:38.144716 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39dc84-0912-4839-b5fe-97b133985ab7 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:38.145960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 29/58] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:38.151211 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51155f95-6972-4af1-9d1b-3291523fd975 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:38.151625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51155f95-6972-4af1-9d1b-3291523fd975 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:38.151772 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51155f95-6972-4af1-9d1b-3291523fd975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:38.169410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-51155f95-6972-4af1-9d1b-3291523fd975 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:38.170777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-51155f95-6972-4af1-9d1b-3291523fd975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:38.235315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 30/59] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:38.507521 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39dc84-0912-4839-b5fe-97b133985ab7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:38.606747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39dc84-0912-4839-b5fe-97b133985ab7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:38.640307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b17324-9525-4080-83a2-2285758daded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:38.640923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b17324-9525-4080-83a2-2285758daded None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:38.641206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b17324-9525-4080-83a2-2285758daded None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:38.641478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b17324-9525-4080-83a2-2285758daded None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:38.642596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b17324-9525-4080-83a2-2285758daded None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:38.644059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b17324-9525-4080-83a2-2285758daded None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:38.645623 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 30/60] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:49:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:38.651007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51155f95-6972-4af1-9d1b-3291523fd975 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:38.737906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:38.750115 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51155f95-6972-4af1-9d1b-3291523fd975 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:38.783065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2990d7cb-1c20-4955-9856-2c84c59b14a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:38.783677 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990d7cb-1c20-4955-9856-2c84c59b14a4 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:38.784000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990d7cb-1c20-4955-9856-2c84c59b14a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:38.784276 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2990d7cb-1c20-4955-9856-2c84c59b14a4 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:38.784923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990d7cb-1c20-4955-9856-2c84c59b14a4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:38.786349 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2990d7cb-1c20-4955-9856-2c84c59b14a4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:38.892108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 31/61] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:49:38 2022] POST /identity/v3/users => generated 275 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:49:41.975879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32aa7e-7bf9-4728-8758-96c998d61b73 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:41.977870 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98604cca-1789-491f-8c8f-08207282b9e7 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:41.978827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98604cca-1789-491f-8c8f-08207282b9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:41.979309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32aa7e-7bf9-4728-8758-96c998d61b73 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:41.979788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98604cca-1789-491f-8c8f-08207282b9e7 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:41.980338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d32aa7e-7bf9-4728-8758-96c998d61b73 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:41.981891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 31/62] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:41.983433 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 32/63] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:41.989271 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2e949-2271-4e46-98ab-a36703690d2a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:41.990748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febbfaf-e616-410e-b075-cadfa207e5cb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:41.991381 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2e949-2271-4e46-98ab-a36703690d2a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:41.992161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb2e949-2271-4e46-98ab-a36703690d2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:41.992356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febbfaf-e616-410e-b075-cadfa207e5cb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:41.992812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febbfaf-e616-410e-b075-cadfa207e5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.027884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-eeb2e949-2271-4e46-98ab-a36703690d2a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:42.027884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-eeb2e949-2271-4e46-98ab-a36703690d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:42.028230 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7febbfaf-e616-410e-b075-cadfa207e5cb None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:42.031542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7febbfaf-e616-410e-b075-cadfa207e5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:42.064366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:42.110648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 32/64] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:49:42.145414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688277f9-3462-41b2-aaac-f763f1d775a4 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.145738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688277f9-3462-41b2-aaac-f763f1d775a4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.146229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688277f9-3462-41b2-aaac-f763f1d775a4 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.148613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 33/65] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:42.157910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3701d47-9ade-4ad9-822a-d96ff212d897 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.158312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3701d47-9ade-4ad9-822a-d96ff212d897 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.158704 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3701d47-9ade-4ad9-822a-d96ff212d897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.165928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 33/66] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:42.185023 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e3701d47-9ade-4ad9-822a-d96ff212d897 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:42.186213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e3701d47-9ade-4ad9-822a-d96ff212d897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:42.283687 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 34/67] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:42.424863 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febbfaf-e616-410e-b075-cadfa207e5cb None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:42.492481 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb359888-5fde-4f1d-bf89-316371472f6c None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.492809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb359888-5fde-4f1d-bf89-316371472f6c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.493036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb359888-5fde-4f1d-bf89-316371472f6c None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.494983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 35/68] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:42.500769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab794749-b1ac-462f-80fe-42313a211130 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.501061 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab794749-b1ac-462f-80fe-42313a211130 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.501329 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab794749-b1ac-462f-80fe-42313a211130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.523340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ab794749-b1ac-462f-80fe-42313a211130 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:42.524655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ab794749-b1ac-462f-80fe-42313a211130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:42.540098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:42.568972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febbfaf-e616-410e-b075-cadfa207e5cb None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:42.606364 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 36/69] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:49:42.607212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab794749-b1ac-462f-80fe-42313a211130 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:42.608552 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aac24-71f5-4a86-ba0f-d6df7616758a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:42.609782 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aac24-71f5-4a86-ba0f-d6df7616758a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.610244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aac24-71f5-4a86-ba0f-d6df7616758a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.610527 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087aac24-71f5-4a86-ba0f-d6df7616758a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.623014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087aac24-71f5-4a86-ba0f-d6df7616758a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-087aac24-71f5-4a86-ba0f-d6df7616758a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:42.627833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:42.628703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:42.629485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:42.629485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:42.629485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:42.629485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:42.629485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:42.629485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:42.629485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:42.629485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:42.629485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:42.629485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:42.629485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:49:42.629485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:49:42.629485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 34/70] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:42.630112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aac24-71f5-4a86-ba0f-d6df7616758a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:42.637658 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:42.713626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab794749-b1ac-462f-80fe-42313a211130 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:42.737505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087aac24-71f5-4a86-ba0f-d6df7616758a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:42.748603 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb149ae7-ccee-450f-8b32-50d73ce93608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:42.749236 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb149ae7-ccee-450f-8b32-50d73ce93608 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.749557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb149ae7-ccee-450f-8b32-50d73ce93608 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.749989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb149ae7-ccee-450f-8b32-50d73ce93608 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.763090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb149ae7-ccee-450f-8b32-50d73ce93608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-cb149ae7-ccee-450f-8b32-50d73ce93608 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:42.769310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:42.770158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:42.770935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:42.770935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:42.770935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:42.770935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:42.770935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:42.770935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:42.770935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:42.770935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:42.770935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:42.770935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:42.770935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:49:42.770935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:49:42.770935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 37/71] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:49:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:42.772248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82daec-9dc0-48a5-bbd8-985dc3686d2b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.772531 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82daec-9dc0-48a5-bbd8-985dc3686d2b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.772801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82daec-9dc0-48a5-bbd8-985dc3686d2b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.774207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 38/72] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:42.774747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82daec-9dc0-48a5-bbd8-985dc3686d2b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:42.788601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb52ab7-5a09-48fb-870f-c9ac2103518e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:42.789248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52ab7-5a09-48fb-870f-c9ac2103518e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.789535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52ab7-5a09-48fb-870f-c9ac2103518e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.789815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb52ab7-5a09-48fb-870f-c9ac2103518e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.791748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:42.801214 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb52ab7-5a09-48fb-870f-c9ac2103518e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-3fb52ab7-5a09-48fb-870f-c9ac2103518e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:42.806014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:42.812748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:42.813512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:42.813512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:42.813512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:42.813512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:42.813512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:42.813512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:42.813512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:42.813512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:42.813512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:42.813512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:42.813512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:49:42.813512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:49:42.813512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 35/73] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:49:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:42.813512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb52ab7-5a09-48fb-870f-c9ac2103518e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:42.874412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:42.891401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82daec-9dc0-48a5-bbd8-985dc3686d2b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:42.916106 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb52ab7-5a09-48fb-870f-c9ac2103518e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:42.926006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b45de-02c1-4d28-b2d6-b9dceabbbdf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:42.926609 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b45de-02c1-4d28-b2d6-b9dceabbbdf8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.926889 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b45de-02c1-4d28-b2d6-b9dceabbbdf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.927163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b45de-02c1-4d28-b2d6-b9dceabbbdf8 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.927826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b45de-02c1-4d28-b2d6-b9dceabbbdf8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:42.928152 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b45de-02c1-4d28-b2d6-b9dceabbbdf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:42.929531 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b45de-02c1-4d28-b2d6-b9dceabbbdf8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:42.937517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 39/74] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:49:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:42.938692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1ff17-3301-4d65-b597-479a9df14645 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.938984 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1ff17-3301-4d65-b597-479a9df14645 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.939261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1ff17-3301-4d65-b597-479a9df14645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.951975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38590a7-8699-4fdb-8f99-50aef7e66380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:42.953129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38590a7-8699-4fdb-8f99-50aef7e66380 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:42.953760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38590a7-8699-4fdb-8f99-50aef7e66380 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:42.954034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38590a7-8699-4fdb-8f99-50aef7e66380 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:42.954723 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38590a7-8699-4fdb-8f99-50aef7e66380 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:42.955031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38590a7-8699-4fdb-8f99-50aef7e66380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:42.956424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38590a7-8699-4fdb-8f99-50aef7e66380 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:42.956987 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-70f1ff17-3301-4d65-b597-479a9df14645 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:42.958212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-70f1ff17-3301-4d65-b597-479a9df14645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:42.964362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 36/75] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:42.964362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38590a7-8699-4fdb-8f99-50aef7e66380 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:43.022939 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:43.023819 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 40/76] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:43.024695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1ff17-3301-4d65-b597-479a9df14645 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:43.068213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38590a7-8699-4fdb-8f99-50aef7e66380 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:43.105254 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6f5a3-c38b-437e-b506-6055348937b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:43.105866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6f5a3-c38b-437e-b506-6055348937b1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:43.106152 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6f5a3-c38b-437e-b506-6055348937b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:43.106426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f6f5a3-c38b-437e-b506-6055348937b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:43.107098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6f5a3-c38b-437e-b506-6055348937b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:43.107407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6f5a3-c38b-437e-b506-6055348937b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:43.108824 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f6f5a3-c38b-437e-b506-6055348937b1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:43.115160 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:43.117407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 37/77] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:49:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:43.118298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6f5a3-c38b-437e-b506-6055348937b1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:43.144185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1ff17-3301-4d65-b597-479a9df14645 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:43.179661 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784030a-10d4-4ebc-b7ec-ade76fb2a565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:43.180330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784030a-10d4-4ebc-b7ec-ade76fb2a565 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:43.180617 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784030a-10d4-4ebc-b7ec-ade76fb2a565 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:43.180938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784030a-10d4-4ebc-b7ec-ade76fb2a565 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:43.192512 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784030a-10d4-4ebc-b7ec-ade76fb2a565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-8784030a-10d4-4ebc-b7ec-ade76fb2a565 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:43.197540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:43.198420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:43.199723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:43.199723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:43.199723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:43.199723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:43.199723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:43.199723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:43.199723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:43.199723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:43.199723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:43.199723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:43.199723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:49:43.199723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:49:43.199723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 41/78] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:43.199723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784030a-10d4-4ebc-b7ec-ade76fb2a565 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:43.231498 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f6f5a3-c38b-437e-b506-6055348937b1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:43.252294 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:43.271730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d279f58-67ef-448f-8131-389ec8d51e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:43.272596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d279f58-67ef-448f-8131-389ec8d51e3b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:43.273031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d279f58-67ef-448f-8131-389ec8d51e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:43.273309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d279f58-67ef-448f-8131-389ec8d51e3b None admin] PATH_INFO: `/v3/users/c72dab1e64e3435cbf22437d73cbf5a9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:43.290007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d279f58-67ef-448f-8131-389ec8d51e3b None admin] RBAC: Authorizing `identity:get_user(user_id=c72dab1e64e3435cbf22437d73cbf5a9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:43.291459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d279f58-67ef-448f-8131-389ec8d51e3b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:43.293694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 38/79] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:43 2022] GET /identity/v3/users/c72dab1e64e3435cbf22437d73cbf5a9 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:43.294505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d279f58-67ef-448f-8131-389ec8d51e3b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:43.312908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784030a-10d4-4ebc-b7ec-ade76fb2a565 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:43.346378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e361b5c-aae0-4fa8-b367-d8eb2aedd443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:43.346952 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e361b5c-aae0-4fa8-b367-d8eb2aedd443 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:43.347226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e361b5c-aae0-4fa8-b367-d8eb2aedd443 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:43.347508 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e361b5c-aae0-4fa8-b367-d8eb2aedd443 None admin] PATH_INFO: `/v3/users/5ed7209395664f8f80ff40e9951b896e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:43.348674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e361b5c-aae0-4fa8-b367-d8eb2aedd443 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed7209395664f8f80ff40e9951b896e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:43.350112 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e361b5c-aae0-4fa8-b367-d8eb2aedd443 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:43.351747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 42/80] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:43 2022] GET /identity/v3/users/5ed7209395664f8f80ff40e9951b896e => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:43.352540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e361b5c-aae0-4fa8-b367-d8eb2aedd443 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:43.356031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:43.397341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d279f58-67ef-448f-8131-389ec8d51e3b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:43.430731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44b101-a055-453a-8400-3534e49c90f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:43.431363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b101-a055-453a-8400-3534e49c90f1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:43.431644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b101-a055-453a-8400-3534e49c90f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:43.431950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf44b101-a055-453a-8400-3534e49c90f1 None admin] PATH_INFO: `/v3/users/c72dab1e64e3435cbf22437d73cbf5a9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:43.433089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44b101-a055-453a-8400-3534e49c90f1 None admin] RBAC: Authorizing `identity:get_user(user_id=c72dab1e64e3435cbf22437d73cbf5a9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:43.434516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf44b101-a055-453a-8400-3534e49c90f1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:43.436120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 39/81] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:43 2022] GET /identity/v3/users/c72dab1e64e3435cbf22437d73cbf5a9 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:43.436874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44b101-a055-453a-8400-3534e49c90f1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:43.454916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e361b5c-aae0-4fa8-b367-d8eb2aedd443 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:43.482424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:43.488145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd213def-7881-4466-a8b1-d9e10385341c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:43.488805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd213def-7881-4466-a8b1-d9e10385341c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:43.489084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd213def-7881-4466-a8b1-d9e10385341c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:43.489355 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd213def-7881-4466-a8b1-d9e10385341c None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:43.490018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd213def-7881-4466-a8b1-d9e10385341c None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:43.490319 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd213def-7881-4466-a8b1-d9e10385341c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:43.491733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd213def-7881-4466-a8b1-d9e10385341c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:43.500304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 43/82] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:49:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:43.501148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd213def-7881-4466-a8b1-d9e10385341c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:43.536763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf44b101-a055-453a-8400-3534e49c90f1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:43.564698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:43.570006 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9969908-0fa1-48a0-bd00-30eb0c09c2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:43.570632 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9969908-0fa1-48a0-bd00-30eb0c09c2b7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:43.570913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9969908-0fa1-48a0-bd00-30eb0c09c2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:43.571187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9969908-0fa1-48a0-bd00-30eb0c09c2b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:43.572333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9969908-0fa1-48a0-bd00-30eb0c09c2b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:43.573830 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9969908-0fa1-48a0-bd00-30eb0c09c2b7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:43.575424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 40/83] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:49:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:43.577286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9969908-0fa1-48a0-bd00-30eb0c09c2b7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:43.603260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd213def-7881-4466-a8b1-d9e10385341c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:43.637678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63208bf7-6b05-40cc-9775-44acf174d8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:43.638282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63208bf7-6b05-40cc-9775-44acf174d8b0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:43.638564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63208bf7-6b05-40cc-9775-44acf174d8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:43.638838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63208bf7-6b05-40cc-9775-44acf174d8b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:43.672688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9969908-0fa1-48a0-bd00-30eb0c09c2b7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:43.686082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:43.705706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63208bf7-6b05-40cc-9775-44acf174d8b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:43.707168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63208bf7-6b05-40cc-9775-44acf174d8b0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:43.707402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8286f-4af7-4578-b8f0-654ce6f2fd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:43.708045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8286f-4af7-4578-b8f0-654ce6f2fd61 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:43.708331 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8286f-4af7-4578-b8f0-654ce6f2fd61 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:43.708609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8286f-4af7-4578-b8f0-654ce6f2fd61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:43.770753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:43.774795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8286f-4af7-4578-b8f0-654ce6f2fd61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:43.776306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d8286f-4af7-4578-b8f0-654ce6f2fd61 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:43.805567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 44/84] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:49:43.806407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63208bf7-6b05-40cc-9775-44acf174d8b0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:43.876201 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 41/85] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:49:43.876972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8286f-4af7-4578-b8f0-654ce6f2fd61 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:43.890156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:43.909683 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63208bf7-6b05-40cc-9775-44acf174d8b0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:43.942978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b015a6-f2b5-4f77-b7ea-b878d80333c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:43.943587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b015a6-f2b5-4f77-b7ea-b878d80333c2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:43.943892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b015a6-f2b5-4f77-b7ea-b878d80333c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:43.944170 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b015a6-f2b5-4f77-b7ea-b878d80333c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:43.974662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d8286f-4af7-4578-b8f0-654ce6f2fd61 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:43.977073 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:44.009621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e21ee-495a-4a3d-92ee-18b185c7b650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:44.010255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e21ee-495a-4a3d-92ee-18b185c7b650 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:44.010542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e21ee-495a-4a3d-92ee-18b185c7b650 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:44.010821 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e21ee-495a-4a3d-92ee-18b185c7b650 None admin] PATH_INFO: `/v3/users/c72dab1e64e3435cbf22437d73cbf5a9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:44.011753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b015a6-f2b5-4f77-b7ea-b878d80333c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:44.011981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e21ee-495a-4a3d-92ee-18b185c7b650 None admin] RBAC: Authorizing `identity:get_user(user_id=c72dab1e64e3435cbf22437d73cbf5a9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:44.013233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b015a6-f2b5-4f77-b7ea-b878d80333c2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:44.013402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e21ee-495a-4a3d-92ee-18b185c7b650 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:44.014992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 42/86] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:43 2022] GET /identity/v3/users/c72dab1e64e3435cbf22437d73cbf5a9 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:44.015744 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e21ee-495a-4a3d-92ee-18b185c7b650 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:44.096697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:44.110233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 45/87] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:49:44.111129 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b015a6-f2b5-4f77-b7ea-b878d80333c2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:44.116949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e21ee-495a-4a3d-92ee-18b185c7b650 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:44.150083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38742fb3-6641-4fe3-8117-364f6d00ddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:44.150621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38742fb3-6641-4fe3-8117-364f6d00ddaf None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:44.150931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38742fb3-6641-4fe3-8117-364f6d00ddaf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:44.151205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38742fb3-6641-4fe3-8117-364f6d00ddaf None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:44.151869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38742fb3-6641-4fe3-8117-364f6d00ddaf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:44.153295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38742fb3-6641-4fe3-8117-364f6d00ddaf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:44.175260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:44.207593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b015a6-f2b5-4f77-b7ea-b878d80333c2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:44.240619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba8ede-66bd-4dfd-bc33-bc18d67c2f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:44.241255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 43/88] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:49:44 2022] POST /identity/v3/users => generated 289 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:49:44.241364 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8ede-66bd-4dfd-bc33-bc18d67c2f1f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:44.241619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8ede-66bd-4dfd-bc33-bc18d67c2f1f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:44.241901 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8ede-66bd-4dfd-bc33-bc18d67c2f1f None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:44.242076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38742fb3-6641-4fe3-8117-364f6d00ddaf None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:44.243093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba8ede-66bd-4dfd-bc33-bc18d67c2f1f None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:44.244779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba8ede-66bd-4dfd-bc33-bc18d67c2f1f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:44.246893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 46/89] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:44 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:44.248453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba8ede-66bd-4dfd-bc33-bc18d67c2f1f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:44.370816 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38742fb3-6641-4fe3-8117-364f6d00ddaf None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:44.380466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba8ede-66bd-4dfd-bc33-bc18d67c2f1f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:44.412613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021f8d9-d09f-472d-8180-c15bdb8dd38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:44.413191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f8d9-d09f-472d-8180-c15bdb8dd38a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:44.413479 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f8d9-d09f-472d-8180-c15bdb8dd38a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:44.413758 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e021f8d9-d09f-472d-8180-c15bdb8dd38a None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:44.414920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021f8d9-d09f-472d-8180-c15bdb8dd38a None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:44.416410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e021f8d9-d09f-472d-8180-c15bdb8dd38a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:44.418063 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 44/90] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:44 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:44.420038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021f8d9-d09f-472d-8180-c15bdb8dd38a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:44.424243 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:44.429078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d3525-9a71-43f8-a4a4-959904893ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:44.429696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3525-9a71-43f8-a4a4-959904893ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:44.429975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3525-9a71-43f8-a4a4-959904893ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:44.430247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d3525-9a71-43f8-a4a4-959904893ab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:44.433159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:44.517720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d3525-9a71-43f8-a4a4-959904893ab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:44.519561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2d3525-9a71-43f8-a4a4-959904893ab7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:44.549470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e021f8d9-d09f-472d-8180-c15bdb8dd38a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:44.589767 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae14d2c-fefb-4797-82a9-ad2fd7de91df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:44.590410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae14d2c-fefb-4797-82a9-ad2fd7de91df None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:44.590691 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae14d2c-fefb-4797-82a9-ad2fd7de91df None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:44.591076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae14d2c-fefb-4797-82a9-ad2fd7de91df None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:44.592498 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae14d2c-fefb-4797-82a9-ad2fd7de91df None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:44.594525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae14d2c-fefb-4797-82a9-ad2fd7de91df None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:44.596592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 45/91] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:44 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:44.597190 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae14d2c-fefb-4797-82a9-ad2fd7de91df None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:44.659898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 47/92] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:49:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:49:44.660670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d3525-9a71-43f8-a4a4-959904893ab7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:44.683165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:44.697860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:44.748087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae14d2c-fefb-4797-82a9-ad2fd7de91df None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:44.784424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8f536-7ce3-4dbe-a260-c49df54d3c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:44.785014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8f536-7ce3-4dbe-a260-c49df54d3c0f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:44.785268 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8f536-7ce3-4dbe-a260-c49df54d3c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:44.785540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8f536-7ce3-4dbe-a260-c49df54d3c0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:44.786278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8f536-7ce3-4dbe-a260-c49df54d3c0f None admin] RBAC: Adding query filter params (role.id=75d9054a423c4c66b163c72c8ae7989c, scope.project.id=48ad6ef4173e4919a439dd1e407c850c, user.id=c72dab1e64e3435cbf22437d73cbf5a9) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:44.786588 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8f536-7ce3-4dbe-a260-c49df54d3c0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:44.788084 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8f536-7ce3-4dbe-a260-c49df54d3c0f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:44.792278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2d3525-9a71-43f8-a4a4-959904893ab7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:44.794336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 46/93] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:49:44 2022] GET /identity/v3/role_assignments?user.id=c72dab1e64e3435cbf22437d73cbf5a9&scope.project.id=48ad6ef4173e4919a439dd1e407c850c&role.id=75d9054a423c4c66b163c72c8ae7989c => generated 259 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:44.795146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8f536-7ce3-4dbe-a260-c49df54d3c0f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:44.847236 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2798d01-351e-44e8-ad4c-9f926afb8145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:44.847882 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798d01-351e-44e8-ad4c-9f926afb8145 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:44.848170 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798d01-351e-44e8-ad4c-9f926afb8145 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:44.848443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2798d01-351e-44e8-ad4c-9f926afb8145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:44.849185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2798d01-351e-44e8-ad4c-9f926afb8145 None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=48ad6ef4173e4919a439dd1e407c850c, user.id=5ed7209395664f8f80ff40e9951b896e) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:44.849559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2798d01-351e-44e8-ad4c-9f926afb8145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:44.851077 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2798d01-351e-44e8-ad4c-9f926afb8145 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:44.862088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 48/94] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:49:44 2022] GET /identity/v3/role_assignments?user.id=5ed7209395664f8f80ff40e9951b896e&scope.project.id=48ad6ef4173e4919a439dd1e407c850c&role.id=68b1888f7bb644a39938b8d41006a813 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:44.864260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2798d01-351e-44e8-ad4c-9f926afb8145 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:44.927983 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8f536-7ce3-4dbe-a260-c49df54d3c0f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:44.982963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a7fee-0d4f-4d88-b8e0-cc1baffcee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:44.983514 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a7fee-0d4f-4d88-b8e0-cc1baffcee7b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:44.983910 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a7fee-0d4f-4d88-b8e0-cc1baffcee7b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:44.984675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93a7fee-0d4f-4d88-b8e0-cc1baffcee7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:44.985436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a7fee-0d4f-4d88-b8e0-cc1baffcee7b None admin] RBAC: Adding query filter params (role.id=d78c47b14910477fa17f456efbbc177c, scope.project.id=48ad6ef4173e4919a439dd1e407c850c, user.id=c72dab1e64e3435cbf22437d73cbf5a9) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:44.985741 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a7fee-0d4f-4d88-b8e0-cc1baffcee7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:44.987248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93a7fee-0d4f-4d88-b8e0-cc1baffcee7b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:44.990489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:44.999887 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 47/95] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:49:44 2022] GET /identity/v3/role_assignments?user.id=c72dab1e64e3435cbf22437d73cbf5a9&scope.project.id=48ad6ef4173e4919a439dd1e407c850c&role.id=d78c47b14910477fa17f456efbbc177c => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:45.037709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:45.042175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2798d01-351e-44e8-ad4c-9f926afb8145 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:45.082660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d3896-4c89-459b-a342-a0a5f4a9dad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:45.083415 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d3896-4c89-459b-a342-a0a5f4a9dad9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:45.083658 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d3896-4c89-459b-a342-a0a5f4a9dad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:45.083966 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d3896-4c89-459b-a342-a0a5f4a9dad9 None admin] PATH_INFO: `/v3/projects/f72717c84d70483fb266e83b3cf280c0` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:45.085357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d3896-4c89-459b-a342-a0a5f4a9dad9 None admin] RBAC: Authorizing `identity:get_project(project_id=f72717c84d70483fb266e83b3cf280c0)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:45.087310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d3896-4c89-459b-a342-a0a5f4a9dad9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:45.089408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 49/96] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:44 2022] GET /identity/v3/projects/f72717c84d70483fb266e83b3cf280c0 => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:45.096015 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a7fee-0d4f-4d88-b8e0-cc1baffcee7b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:45.210953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93a7fee-0d4f-4d88-b8e0-cc1baffcee7b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:45.246728 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5407f1d5-ef25-4495-a07c-1bb8a90067f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:45.247264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407f1d5-ef25-4495-a07c-1bb8a90067f4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:45.247547 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407f1d5-ef25-4495-a07c-1bb8a90067f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:45.247823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5407f1d5-ef25-4495-a07c-1bb8a90067f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:45.248643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407f1d5-ef25-4495-a07c-1bb8a90067f4 None admin] RBAC: Adding query filter params (role.id=75d9054a423c4c66b163c72c8ae7989c, scope.project.id=f72717c84d70483fb266e83b3cf280c0, user.id=c72dab1e64e3435cbf22437d73cbf5a9) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:45.248957 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407f1d5-ef25-4495-a07c-1bb8a90067f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:45.250626 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5407f1d5-ef25-4495-a07c-1bb8a90067f4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:45.256479 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 48/97] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:49:45 2022] GET /identity/v3/role_assignments?user.id=c72dab1e64e3435cbf22437d73cbf5a9&scope.project.id=f72717c84d70483fb266e83b3cf280c0&role.id=75d9054a423c4c66b163c72c8ae7989c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:47.299358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd7436-b2c6-46ad-8c20-d23922f574fd None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:47.299897 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd7436-b2c6-46ad-8c20-d23922f574fd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:47.299978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cd7436-b2c6-46ad-8c20-d23922f574fd None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:47.301502 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 50/98] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:47.317847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067dd2d-4505-4656-8661-0aaeba0b7fc1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:47.318336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067dd2d-4505-4656-8661-0aaeba0b7fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:47.318410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067dd2d-4505-4656-8661-0aaeba0b7fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:47.342027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f067dd2d-4505-4656-8661-0aaeba0b7fc1 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:47.343257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f067dd2d-4505-4656-8661-0aaeba0b7fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:47.415430 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:47.423900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 49/99] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:47.694682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd7436-b2c6-46ad-8c20-d23922f574fd None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:47.729224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d804d8-6285-4134-b0ad-b4371ed67277 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:47.730003 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d804d8-6285-4134-b0ad-b4371ed67277 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:47.730530 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d804d8-6285-4134-b0ad-b4371ed67277 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:47.732367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 50/100] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:47.737189 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54415f2e-9fb9-40dc-86b7-56e2515063c2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:47.737702 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54415f2e-9fb9-40dc-86b7-56e2515063c2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:47.738187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54415f2e-9fb9-40dc-86b7-56e2515063c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:47.784931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-54415f2e-9fb9-40dc-86b7-56e2515063c2 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:47.786143 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-54415f2e-9fb9-40dc-86b7-56e2515063c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:47.866308 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 51/101] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:49:47.867971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b784e45-85b4-4477-bfb1-cb3d30e2fe88 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:47.868443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b784e45-85b4-4477-bfb1-cb3d30e2fe88 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:47.868844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cd7436-b2c6-46ad-8c20-d23922f574fd None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:47.869113 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b784e45-85b4-4477-bfb1-cb3d30e2fe88 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:47.875708 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 52/102] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:47.877088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ce5bb-d04f-45e2-b0a1-da83ad97afef None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:47.877375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ce5bb-d04f-45e2-b0a1-da83ad97afef None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:47.877647 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ce5bb-d04f-45e2-b0a1-da83ad97afef None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:47.879311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 53/103] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:47.880449 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aed3ee-1060-4909-ad86-a38d51aa24fc None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:47.880741 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aed3ee-1060-4909-ad86-a38d51aa24fc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:47.881018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aed3ee-1060-4909-ad86-a38d51aa24fc None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:47.882206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 54/104] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:47.883573 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6138da-9540-4398-be7d-e79f154c6dcd None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:47.884115 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6138da-9540-4398-be7d-e79f154c6dcd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:47.884568 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6138da-9540-4398-be7d-e79f154c6dcd None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:47.886013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 55/105] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:47.887319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0803a-9d31-4ff5-aca4-1b072664d5c9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:47.887795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0803a-9d31-4ff5-aca4-1b072664d5c9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:47.888165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0803a-9d31-4ff5-aca4-1b072664d5c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:47.906063 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d8a0803a-9d31-4ff5-aca4-1b072664d5c9 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:47.907249 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d8a0803a-9d31-4ff5-aca4-1b072664d5c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:47.914561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5853040-58c4-454c-ae1f-2dd6ef9bbd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:47.915183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5853040-58c4-454c-ae1f-2dd6ef9bbd12 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:47.915608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5853040-58c4-454c-ae1f-2dd6ef9bbd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:47.916044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5853040-58c4-454c-ae1f-2dd6ef9bbd12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:47.926728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5853040-58c4-454c-ae1f-2dd6ef9bbd12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-d5853040-58c4-454c-ae1f-2dd6ef9bbd12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:47.931948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:47.932972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:47.933938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:47.933938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:47.933938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:47.933938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:47.933938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:47.933938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:47.933938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:47.933938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:47.933938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:47.933938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:47.933938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:49:47.933938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:49:47.940988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 51/106] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:47.941310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2c1a6-4f3c-481e-abc5-dfad7d30da1d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:47.941603 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2c1a6-4f3c-481e-abc5-dfad7d30da1d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:47.941963 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2c1a6-4f3c-481e-abc5-dfad7d30da1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:47.959800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-bad2c1a6-4f3c-481e-abc5-dfad7d30da1d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:47.960952 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bad2c1a6-4f3c-481e-abc5-dfad7d30da1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:47.978749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 56/107] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:47.980143 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190e47a-3f19-4d3e-9ed1-5d55b27bbde7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:47.980436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190e47a-3f19-4d3e-9ed1-5d55b27bbde7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:47.980718 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5190e47a-3f19-4d3e-9ed1-5d55b27bbde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:47.985109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:47.998651 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5190e47a-3f19-4d3e-9ed1-5d55b27bbde7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:48.000648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5190e47a-3f19-4d3e-9ed1-5d55b27bbde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:48.046660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 52/108] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:48.048148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef9502-d392-4a5d-b638-1bb2288f1967 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:48.048567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef9502-d392-4a5d-b638-1bb2288f1967 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:48.049402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef9502-d392-4a5d-b638-1bb2288f1967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:48.056994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:48.073846 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-87ef9502-d392-4a5d-b638-1bb2288f1967 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:48.075446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-87ef9502-d392-4a5d-b638-1bb2288f1967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:48.076386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 57/109] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:48.078066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190e47a-3f19-4d3e-9ed1-5d55b27bbde7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:48.238857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 53/110] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:48.276366 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5190e47a-3f19-4d3e-9ed1-5d55b27bbde7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:48.278881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef9502-d392-4a5d-b638-1bb2288f1967 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:48.359712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030a68a-c4ff-46c3-ab7a-2e82808cf48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:48.360400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030a68a-c4ff-46c3-ab7a-2e82808cf48e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:48.360642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030a68a-c4ff-46c3-ab7a-2e82808cf48e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:48.360918 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c030a68a-c4ff-46c3-ab7a-2e82808cf48e None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:48.361619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030a68a-c4ff-46c3-ab7a-2e82808cf48e None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:48.361929 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030a68a-c4ff-46c3-ab7a-2e82808cf48e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:48.363301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c030a68a-c4ff-46c3-ab7a-2e82808cf48e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:48.372339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 58/111] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:49:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:48.373243 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030a68a-c4ff-46c3-ab7a-2e82808cf48e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:48.410532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:48.427042 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef9502-d392-4a5d-b638-1bb2288f1967 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:48.438653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:48.464108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d40a85-c01f-4158-b85f-a9dc02e2adb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:48.465016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d40a85-c01f-4158-b85f-a9dc02e2adb7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:48.465446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d40a85-c01f-4158-b85f-a9dc02e2adb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:48.465926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d40a85-c01f-4158-b85f-a9dc02e2adb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:48.477785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d40a85-c01f-4158-b85f-a9dc02e2adb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-50d40a85-c01f-4158-b85f-a9dc02e2adb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:48.482743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:48.484483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:48.485357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:48.485357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:48.485357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:48.485357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:48.485357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:48.485357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:48.485357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:48.485357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:48.485357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:48.485357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:48.485357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:49:48.485357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:49:48.485357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 54/112] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:49:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:49:48.488640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d40a85-c01f-4158-b85f-a9dc02e2adb7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:48.499370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c030a68a-c4ff-46c3-ab7a-2e82808cf48e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:48.537752 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579566c5-13c2-4fc6-8183-7eaef42eda51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:48.538396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579566c5-13c2-4fc6-8183-7eaef42eda51 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:48.538686 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579566c5-13c2-4fc6-8183-7eaef42eda51 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:48.538963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579566c5-13c2-4fc6-8183-7eaef42eda51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:48.549849 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579566c5-13c2-4fc6-8183-7eaef42eda51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-579566c5-13c2-4fc6-8183-7eaef42eda51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:48.555010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:48.556034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:48.556809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:48.556809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:48.556809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:48.556809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:48.556809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:48.556809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:48.556809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:48.556809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:48.556809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:48.556809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:48.556809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:49:48.556809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:49:48.556809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 59/113] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:48.557449 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579566c5-13c2-4fc6-8183-7eaef42eda51 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:48.592346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d40a85-c01f-4158-b85f-a9dc02e2adb7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:48.626478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734cda2-1f40-47b5-8013-b1de3ade2146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:48.627104 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734cda2-1f40-47b5-8013-b1de3ade2146 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:48.627386 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734cda2-1f40-47b5-8013-b1de3ade2146 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:48.627659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734cda2-1f40-47b5-8013-b1de3ade2146 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:48.637561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734cda2-1f40-47b5-8013-b1de3ade2146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-6734cda2-1f40-47b5-8013-b1de3ade2146 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:48.642464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:48.643401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:48.644191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:48.644191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:48.644191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:48.644191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:48.644191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:48.644191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:48.644191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:48.644191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:48.644191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:48.644191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:48.644191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:49:48.644191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:49:48.644191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 55/114] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:48.644842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734cda2-1f40-47b5-8013-b1de3ade2146 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:48.657709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:48.660315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579566c5-13c2-4fc6-8183-7eaef42eda51 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:48.667605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:48.693583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237c752-9f84-452a-99bb-bf14c0f26d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:48.694239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237c752-9f84-452a-99bb-bf14c0f26d3d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:48.694521 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237c752-9f84-452a-99bb-bf14c0f26d3d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:48.694795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237c752-9f84-452a-99bb-bf14c0f26d3d None admin] PATH_INFO: `/v3/users/c72dab1e64e3435cbf22437d73cbf5a9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:48.695960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237c752-9f84-452a-99bb-bf14c0f26d3d None admin] RBAC: Authorizing `identity:get_user(user_id=c72dab1e64e3435cbf22437d73cbf5a9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:48.697468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237c752-9f84-452a-99bb-bf14c0f26d3d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:48.699022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 60/115] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:48 2022] GET /identity/v3/users/c72dab1e64e3435cbf22437d73cbf5a9 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:48.699780 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237c752-9f84-452a-99bb-bf14c0f26d3d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:48.747126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734cda2-1f40-47b5-8013-b1de3ade2146 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:48.782252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1690b-c628-4e53-ba98-daa9f45dc034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:48.782886 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1690b-c628-4e53-ba98-daa9f45dc034 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:48.783170 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1690b-c628-4e53-ba98-daa9f45dc034 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:48.783443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1690b-c628-4e53-ba98-daa9f45dc034 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:48.793784 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1690b-c628-4e53-ba98-daa9f45dc034 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-89f1690b-c628-4e53-ba98-daa9f45dc034 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:48.799173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:48.800148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:48.801145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:48.801145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:48.801145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:48.801145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:48.801145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:48.801145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:48.801145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:48.801145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:48.801145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:48.801145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:48.801145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:49:48.801145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:49:48.801145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 56/116] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:49:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:48.801145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1690b-c628-4e53-ba98-daa9f45dc034 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:48.805800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237c752-9f84-452a-99bb-bf14c0f26d3d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:48.839386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0604c1-e98c-4074-8306-ca9155073f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:48.840034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0604c1-e98c-4074-8306-ca9155073f2c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:48.840319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0604c1-e98c-4074-8306-ca9155073f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:48.840593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0604c1-e98c-4074-8306-ca9155073f2c None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:48.841513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0604c1-e98c-4074-8306-ca9155073f2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:48.841817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0604c1-e98c-4074-8306-ca9155073f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:48.843321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0604c1-e98c-4074-8306-ca9155073f2c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:48.851513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 61/117] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:48.852340 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0604c1-e98c-4074-8306-ca9155073f2c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:48.870139 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:48.887479 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:48.904468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1690b-c628-4e53-ba98-daa9f45dc034 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:48.937638 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae138b-ef4c-4734-9be6-841e31cd8a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:48.938417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae138b-ef4c-4734-9be6-841e31cd8a73 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:48.938702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae138b-ef4c-4734-9be6-841e31cd8a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:48.938975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae138b-ef4c-4734-9be6-841e31cd8a73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:48.940136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae138b-ef4c-4734-9be6-841e31cd8a73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:48.941610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae138b-ef4c-4734-9be6-841e31cd8a73 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:48.943583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 57/118] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:49:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:48.948585 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae138b-ef4c-4734-9be6-841e31cd8a73 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:48.950126 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0604c1-e98c-4074-8306-ca9155073f2c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:48.986966 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebff66a-5917-4fb4-803b-3a84981f8b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:48.987580 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebff66a-5917-4fb4-803b-3a84981f8b2b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:48.987886 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebff66a-5917-4fb4-803b-3a84981f8b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:48.988171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebff66a-5917-4fb4-803b-3a84981f8b2b None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:48.988922 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebff66a-5917-4fb4-803b-3a84981f8b2b None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:48.989239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebff66a-5917-4fb4-803b-3a84981f8b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:48.990623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebff66a-5917-4fb4-803b-3a84981f8b2b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:48.998550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 62/119] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:49:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:49.003948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebff66a-5917-4fb4-803b-3a84981f8b2b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:49.051747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae138b-ef4c-4734-9be6-841e31cd8a73 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:49.085265 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68034439-500e-4d34-a876-0f8676a0c27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:49.085875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68034439-500e-4d34-a876-0f8676a0c27e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:49.086159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68034439-500e-4d34-a876-0f8676a0c27e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:49.086436 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68034439-500e-4d34-a876-0f8676a0c27e None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:49.087102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68034439-500e-4d34-a876-0f8676a0c27e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:49.087410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68034439-500e-4d34-a876-0f8676a0c27e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:49.088798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68034439-500e-4d34-a876-0f8676a0c27e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:49.090243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:49.098259 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 58/120] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:49:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:49.099054 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68034439-500e-4d34-a876-0f8676a0c27e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:49.103218 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:49.103218 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebff66a-5917-4fb4-803b-3a84981f8b2b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:49.137498 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b341ff-2b22-45c0-bf6f-28c5ee20d9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:49.138131 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b341ff-2b22-45c0-bf6f-28c5ee20d9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:49.138417 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b341ff-2b22-45c0-bf6f-28c5ee20d9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:49.138697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b341ff-2b22-45c0-bf6f-28c5ee20d9c3 None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:49.139828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b341ff-2b22-45c0-bf6f-28c5ee20d9c3 None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:49.141649 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b341ff-2b22-45c0-bf6f-28c5ee20d9c3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:49.143462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 63/121] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:48 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:49.144146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b341ff-2b22-45c0-bf6f-28c5ee20d9c3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:49.203474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68034439-500e-4d34-a876-0f8676a0c27e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:49.236916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a3b67-a019-4730-ac8b-4f612f1bd48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:49.237533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3b67-a019-4730-ac8b-4f612f1bd48b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:49.237803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3b67-a019-4730-ac8b-4f612f1bd48b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:49.238076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1a3b67-a019-4730-ac8b-4f612f1bd48b None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:49.238745 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a3b67-a019-4730-ac8b-4f612f1bd48b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:49.239053 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a3b67-a019-4730-ac8b-4f612f1bd48b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:49.240463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1a3b67-a019-4730-ac8b-4f612f1bd48b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:49.248365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 59/122] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:49:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:49.249156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a3b67-a019-4730-ac8b-4f612f1bd48b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:49.250217 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b341ff-2b22-45c0-bf6f-28c5ee20d9c3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:49.283914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5549e89-90d1-4b8c-96a0-9c739203b7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:49.284551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5549e89-90d1-4b8c-96a0-9c739203b7b1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:49.284831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5549e89-90d1-4b8c-96a0-9c739203b7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:49.285106 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5549e89-90d1-4b8c-96a0-9c739203b7b1 None admin] PATH_INFO: `/v3/users/5ed7209395664f8f80ff40e9951b896e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:49.286225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5549e89-90d1-4b8c-96a0-9c739203b7b1 None admin] RBAC: Authorizing `identity:get_user(user_id=5ed7209395664f8f80ff40e9951b896e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:49.287668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5549e89-90d1-4b8c-96a0-9c739203b7b1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:49.289293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 64/123] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:49 2022] GET /identity/v3/users/5ed7209395664f8f80ff40e9951b896e => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:49.290047 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5549e89-90d1-4b8c-96a0-9c739203b7b1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:49.311552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:49.323144 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:49.353483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1a3b67-a019-4730-ac8b-4f612f1bd48b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:49.389268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76132eb7-d853-4beb-8cef-363677dc8b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:49.389888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76132eb7-d853-4beb-8cef-363677dc8b28 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:49.390293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76132eb7-d853-4beb-8cef-363677dc8b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:49.390574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76132eb7-d853-4beb-8cef-363677dc8b28 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:49.391344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76132eb7-d853-4beb-8cef-363677dc8b28 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:49.391962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5549e89-90d1-4b8c-96a0-9c739203b7b1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:49.392829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76132eb7-d853-4beb-8cef-363677dc8b28 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:49.426608 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe6c3-2db5-48ea-9746-e4910bb4960f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:49.427246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe6c3-2db5-48ea-9746-e4910bb4960f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:49.427531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe6c3-2db5-48ea-9746-e4910bb4960f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:49.427809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abe6c3-2db5-48ea-9746-e4910bb4960f None admin] PATH_INFO: `/v3/users/c72dab1e64e3435cbf22437d73cbf5a9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:49.429000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe6c3-2db5-48ea-9746-e4910bb4960f None admin] RBAC: Authorizing `identity:get_user(user_id=c72dab1e64e3435cbf22437d73cbf5a9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:49.430448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abe6c3-2db5-48ea-9746-e4910bb4960f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:49.432050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 65/124] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:49 2022] GET /identity/v3/users/c72dab1e64e3435cbf22437d73cbf5a9 => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:49.432812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe6c3-2db5-48ea-9746-e4910bb4960f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:49.482494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 60/125] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 24 07:49:49 2022] POST /identity/v3/projects => generated 302 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:49:49.483988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76132eb7-d853-4beb-8cef-363677dc8b28 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:49.553051 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abe6c3-2db5-48ea-9746-e4910bb4960f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:49.554975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:49.592430 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc77ce-0d07-453d-8aed-439933591110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:49.593513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc77ce-0d07-453d-8aed-439933591110 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:49.593815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc77ce-0d07-453d-8aed-439933591110 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:49.594211 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bc77ce-0d07-453d-8aed-439933591110 None admin] PATH_INFO: `/v3/users/057609c2f69c43989189ec4b732b138e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:49.598724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76132eb7-d853-4beb-8cef-363677dc8b28 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:49.610692 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc77ce-0d07-453d-8aed-439933591110 None admin] RBAC: Authorizing `identity:get_user(user_id=057609c2f69c43989189ec4b732b138e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:49.612337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bc77ce-0d07-453d-8aed-439933591110 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:49.612875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:49.614476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 66/126] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:49 2022] GET /identity/v3/users/057609c2f69c43989189ec4b732b138e => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:49.615283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc77ce-0d07-453d-8aed-439933591110 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:49.648443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15619581-7a01-4acd-8928-d2d4113d174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:49.649116 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15619581-7a01-4acd-8928-d2d4113d174e None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:49.649400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15619581-7a01-4acd-8928-d2d4113d174e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:49.649674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15619581-7a01-4acd-8928-d2d4113d174e None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c/users/c72dab1e64e3435cbf22437d73cbf5a9/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:49.651620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15619581-7a01-4acd-8928-d2d4113d174e None admin] RBAC: Authorizing `identity:create_grant(project_id=48ad6ef4173e4919a439dd1e407c850c, user_id=c72dab1e64e3435cbf22437d73cbf5a9, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:49.653139 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15619581-7a01-4acd-8928-d2d4113d174e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:49.725926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bc77ce-0d07-453d-8aed-439933591110 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:49.750424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 61/127] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:49:49 2022] PUT /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c/users/c72dab1e64e3435cbf22437d73cbf5a9/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:49:49.751606 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15619581-7a01-4acd-8928-d2d4113d174e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:49.768599 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e1f33-ef21-4698-824c-82974209ef9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:49.769837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1f33-ef21-4698-824c-82974209ef9e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:49.770324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1f33-ef21-4698-824c-82974209ef9e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:49.770995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2e1f33-ef21-4698-824c-82974209ef9e None admin] PATH_INFO: `/v3/users/c72dab1e64e3435cbf22437d73cbf5a9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:49.772632 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e1f33-ef21-4698-824c-82974209ef9e None admin] RBAC: Authorizing `identity:get_user(user_id=c72dab1e64e3435cbf22437d73cbf5a9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:49.774806 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2e1f33-ef21-4698-824c-82974209ef9e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:49.776889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 67/128] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:49 2022] GET /identity/v3/users/c72dab1e64e3435cbf22437d73cbf5a9 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:49.778002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e1f33-ef21-4698-824c-82974209ef9e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:49.813451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:49.868544 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15619581-7a01-4acd-8928-d2d4113d174e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:49.900898 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2e1f33-ef21-4698-824c-82974209ef9e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:49.908292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645d44a-69ea-46b9-9f4f-184522dcb473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:49.908990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645d44a-69ea-46b9-9f4f-184522dcb473 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:49.909305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645d44a-69ea-46b9-9f4f-184522dcb473 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:49.909576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645d44a-69ea-46b9-9f4f-184522dcb473 None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:49.910755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645d44a-69ea-46b9-9f4f-184522dcb473 None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:49.912317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645d44a-69ea-46b9-9f4f-184522dcb473 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:49.914331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 62/129] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:49 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:49.915390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645d44a-69ea-46b9-9f4f-184522dcb473 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:49.949865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3841b6-8712-4d01-ad29-f31f310d8b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:49.950763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3841b6-8712-4d01-ad29-f31f310d8b99 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:49.951467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3841b6-8712-4d01-ad29-f31f310d8b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:49.951755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3841b6-8712-4d01-ad29-f31f310d8b99 None admin] PATH_INFO: `/v3/projects/f72717c84d70483fb266e83b3cf280c0` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:49.953827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3841b6-8712-4d01-ad29-f31f310d8b99 None admin] RBAC: Authorizing `identity:get_project(project_id=f72717c84d70483fb266e83b3cf280c0)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:49.956149 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3841b6-8712-4d01-ad29-f31f310d8b99 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:49.959103 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 68/130] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:49 2022] GET /identity/v3/projects/f72717c84d70483fb266e83b3cf280c0 => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:49.959776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3841b6-8712-4d01-ad29-f31f310d8b99 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:49.968710 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:50.032191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645d44a-69ea-46b9-9f4f-184522dcb473 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:50.071153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fb48a-5556-4776-96d0-850be1859f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:50.071805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fb48a-5556-4776-96d0-850be1859f0a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:50.072115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fb48a-5556-4776-96d0-850be1859f0a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:50.072387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fb48a-5556-4776-96d0-850be1859f0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:50.083795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:50.092549 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3841b6-8712-4d01-ad29-f31f310d8b99 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:50.141712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c01d8-757e-456e-a7e6-7e7e42aa909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:50.142524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c01d8-757e-456e-a7e6-7e7e42aa909b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:50.143222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c01d8-757e-456e-a7e6-7e7e42aa909b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:50.143510 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c01d8-757e-456e-a7e6-7e7e42aa909b None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:50.144967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c01d8-757e-456e-a7e6-7e7e42aa909b None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:50.146666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c01d8-757e-456e-a7e6-7e7e42aa909b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:50.148949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 69/131] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:49 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:50.150158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c01d8-757e-456e-a7e6-7e7e42aa909b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:50.150342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fb48a-5556-4776-96d0-850be1859f0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:50.151813 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fb48a-5556-4776-96d0-850be1859f0a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:50.199756 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:50.268791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c01d8-757e-456e-a7e6-7e7e42aa909b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:50.287989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 63/132] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:49:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:49:50.288843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fb48a-5556-4776-96d0-850be1859f0a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:50.315126 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f710210-78ee-45c9-b54b-11b1023f4977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:50.315959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f710210-78ee-45c9-b54b-11b1023f4977 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:50.316255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f710210-78ee-45c9-b54b-11b1023f4977 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:50.316788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f710210-78ee-45c9-b54b-11b1023f4977 None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c/users/5ed7209395664f8f80ff40e9951b896e/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:50.319693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f710210-78ee-45c9-b54b-11b1023f4977 None admin] RBAC: Authorizing `identity:create_grant(project_id=48ad6ef4173e4919a439dd1e407c850c, user_id=5ed7209395664f8f80ff40e9951b896e, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:50.321866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f710210-78ee-45c9-b54b-11b1023f4977 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:50.403545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fb48a-5556-4776-96d0-850be1859f0a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:50.409986 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 70/133] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:49:50 2022] PUT /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c/users/5ed7209395664f8f80ff40e9951b896e/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:49:50.410698 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f710210-78ee-45c9-b54b-11b1023f4977 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:50.447367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:50.478240 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99747e-6afa-4085-9cc3-6b341afc6437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:50.478987 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99747e-6afa-4085-9cc3-6b341afc6437 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:50.479342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99747e-6afa-4085-9cc3-6b341afc6437 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:50.479528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99747e-6afa-4085-9cc3-6b341afc6437 None admin] PATH_INFO: `/v3/projects/f72717c84d70483fb266e83b3cf280c0/users/c72dab1e64e3435cbf22437d73cbf5a9/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:50.485400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99747e-6afa-4085-9cc3-6b341afc6437 None admin] RBAC: Authorizing `identity:create_grant(project_id=f72717c84d70483fb266e83b3cf280c0, user_id=c72dab1e64e3435cbf22437d73cbf5a9, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:50.486895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99747e-6afa-4085-9cc3-6b341afc6437 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:50.547051 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f710210-78ee-45c9-b54b-11b1023f4977 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:50.573550 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:50.581323 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 64/134] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:49:50 2022] PUT /identity/v3/projects/f72717c84d70483fb266e83b3cf280c0/users/c72dab1e64e3435cbf22437d73cbf5a9/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:49:50.582255 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99747e-6afa-4085-9cc3-6b341afc6437 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:50.591345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef6007-ce02-42e5-9803-bbbb150cac29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:50.593295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef6007-ce02-42e5-9803-bbbb150cac29 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:50.593820 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef6007-ce02-42e5-9803-bbbb150cac29 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:50.594311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef6007-ce02-42e5-9803-bbbb150cac29 None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c/users/c72dab1e64e3435cbf22437d73cbf5a9/roles/d78c47b14910477fa17f456efbbc177c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:50.599540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef6007-ce02-42e5-9803-bbbb150cac29 None admin] RBAC: Authorizing `identity:create_grant(project_id=48ad6ef4173e4919a439dd1e407c850c, user_id=c72dab1e64e3435cbf22437d73cbf5a9, role_id=d78c47b14910477fa17f456efbbc177c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:50.602559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef6007-ce02-42e5-9803-bbbb150cac29 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:50.683676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 71/135] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:49:50 2022] PUT /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c/users/c72dab1e64e3435cbf22437d73cbf5a9/roles/d78c47b14910477fa17f456efbbc177c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:49:50.747654 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99747e-6afa-4085-9cc3-6b341afc6437 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:50.797469 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea075648-e82f-406e-8719-a15149bb20a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:50.798123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea075648-e82f-406e-8719-a15149bb20a8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:50.798404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea075648-e82f-406e-8719-a15149bb20a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:50.798678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea075648-e82f-406e-8719-a15149bb20a8 None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:50.799922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea075648-e82f-406e-8719-a15149bb20a8 None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:50.801393 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea075648-e82f-406e-8719-a15149bb20a8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:50.803047 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 65/136] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:50 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:50.809344 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef6007-ce02-42e5-9803-bbbb150cac29 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:50.908288 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:50.929969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef6007-ce02-42e5-9803-bbbb150cac29 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:50.973067 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a219232e-e3c1-4aec-a6e9-e38f796f2548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:50.973600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219232e-e3c1-4aec-a6e9-e38f796f2548 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:50.973883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219232e-e3c1-4aec-a6e9-e38f796f2548 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:50.974158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a219232e-e3c1-4aec-a6e9-e38f796f2548 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:50.974954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219232e-e3c1-4aec-a6e9-e38f796f2548 None admin] RBAC: Adding query filter params (role.id=569b7f0b7a5c4fe5b974abf4cfccfcb2, scope.project.id=48ad6ef4173e4919a439dd1e407c850c, user.id=057609c2f69c43989189ec4b732b138e) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:50.975274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219232e-e3c1-4aec-a6e9-e38f796f2548 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:50.976740 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a219232e-e3c1-4aec-a6e9-e38f796f2548 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:50.984779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 72/137] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:49:50 2022] GET /identity/v3/role_assignments?user.id=057609c2f69c43989189ec4b732b138e&scope.project.id=48ad6ef4173e4919a439dd1e407c850c&role.id=569b7f0b7a5c4fe5b974abf4cfccfcb2 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:51.986142 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5adc9d-1e15-456c-9229-85606c580138 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:51.987147 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5adc9d-1e15-456c-9229-85606c580138 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:51.987647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5adc9d-1e15-456c-9229-85606c580138 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:51.989539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 66/138] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:51.994742 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dae8b-6c20-456c-bf2e-8f23332efbc3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:51.995530 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dae8b-6c20-456c-bf2e-8f23332efbc3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:51.996028 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dae8b-6c20-456c-bf2e-8f23332efbc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:51.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2777b-5f76-471e-988e-6878c7b3ad3e None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:51.998051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2777b-5f76-471e-988e-6878c7b3ad3e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:51.998328 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2777b-5f76-471e-988e-6878c7b3ad3e None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:52.000269 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 67/139] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:49:52.011263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221a0e-579a-4f45-abf5-e3d7eedc8b99 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:52.011549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221a0e-579a-4f45-abf5-e3d7eedc8b99 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:52.011826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8221a0e-579a-4f45-abf5-e3d7eedc8b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:52.025011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-447dae8b-6c20-456c-bf2e-8f23332efbc3 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:52.026493 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-447dae8b-6c20-456c-bf2e-8f23332efbc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:52.046914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f8221a0e-579a-4f45-abf5-e3d7eedc8b99 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:52.048251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f8221a0e-579a-4f45-abf5-e3d7eedc8b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:52.108316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 73/140] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:52.145595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 68/141] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 07:49:52.149741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:52.447480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dae8b-6c20-456c-bf2e-8f23332efbc3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:52.538810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:52.565263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dae8b-6c20-456c-bf2e-8f23332efbc3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:52.600847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bb34f-44a9-4760-a667-1b9c907971bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:52.601496 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bb34f-44a9-4760-a667-1b9c907971bd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:52.601784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bb34f-44a9-4760-a667-1b9c907971bd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:52.602062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27bb34f-44a9-4760-a667-1b9c907971bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:52.614960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27bb34f-44a9-4760-a667-1b9c907971bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f27bb34f-44a9-4760-a667-1b9c907971bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:52.619921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:52.620960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:52.622021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:52.622021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:52.622021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:52.622021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:52.622021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:52.622021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:52.622021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:52.622021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:52.622021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:52.622021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:52.622021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:49:52.622021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:49:52.628239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 74/142] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:52.630404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221a0e-579a-4f45-abf5-e3d7eedc8b99 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:52.663999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bb34f-44a9-4760-a667-1b9c907971bd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:52.778288 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27bb34f-44a9-4760-a667-1b9c907971bd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:52.849880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8221a0e-579a-4f45-abf5-e3d7eedc8b99 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:52.858474 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda4989-103c-422d-8906-0b73db0ec4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:52.859477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda4989-103c-422d-8906-0b73db0ec4be None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:52.859984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda4989-103c-422d-8906-0b73db0ec4be None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:52.860448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda4989-103c-422d-8906-0b73db0ec4be None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:52.864571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda4989-103c-422d-8906-0b73db0ec4be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:52.866257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda4989-103c-422d-8906-0b73db0ec4be None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:52.868090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 75/143] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:49:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:52.873608 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda4989-103c-422d-8906-0b73db0ec4be None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:52.887502 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:52.936584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ed3c4-b92d-4b47-acd8-4f06c2df974a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:52.937278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ed3c4-b92d-4b47-acd8-4f06c2df974a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:52.937566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ed3c4-b92d-4b47-acd8-4f06c2df974a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:52.937852 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6ed3c4-b92d-4b47-acd8-4f06c2df974a None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:52.938545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ed3c4-b92d-4b47-acd8-4f06c2df974a None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:52.938824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ed3c4-b92d-4b47-acd8-4f06c2df974a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:52.940308 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6ed3c4-b92d-4b47-acd8-4f06c2df974a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:52.958319 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 69/144] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:49:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:52.963624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ed3c4-b92d-4b47-acd8-4f06c2df974a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:53.057714 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda4989-103c-422d-8906-0b73db0ec4be None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:53.072555 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:53.118505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6ed3c4-b92d-4b47-acd8-4f06c2df974a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:53.138466 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92d5cc-e237-4f31-b8b9-04cfa6fa94f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:53.139022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d5cc-e237-4f31-b8b9-04cfa6fa94f5 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:53.139302 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d5cc-e237-4f31-b8b9-04cfa6fa94f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:53.140562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92d5cc-e237-4f31-b8b9-04cfa6fa94f5 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:53.141301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92d5cc-e237-4f31-b8b9-04cfa6fa94f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:53.142744 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e92d5cc-e237-4f31-b8b9-04cfa6fa94f5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:53.175502 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3a7ec-6bc0-4f2d-badc-047e4f5d32e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:53.176274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3a7ec-6bc0-4f2d-badc-047e4f5d32e6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:53.176563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3a7ec-6bc0-4f2d-badc-047e4f5d32e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:53.176840 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3a7ec-6bc0-4f2d-badc-047e4f5d32e6 None admin] PATH_INFO: `/v3/users/c72dab1e64e3435cbf22437d73cbf5a9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:53.178317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3a7ec-6bc0-4f2d-badc-047e4f5d32e6 None admin] RBAC: Authorizing `identity:get_user(user_id=c72dab1e64e3435cbf22437d73cbf5a9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:53.179836 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3a7ec-6bc0-4f2d-badc-047e4f5d32e6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:53.181776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 70/145] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:52 2022] GET /identity/v3/users/c72dab1e64e3435cbf22437d73cbf5a9 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:53.182948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e76c2-5116-438e-9f3e-14ac58662018 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:53.183244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e76c2-5116-438e-9f3e-14ac58662018 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:53.183572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e76c2-5116-438e-9f3e-14ac58662018 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:53.184794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 71/146] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:53.191051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e76c2-5116-438e-9f3e-14ac58662018 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:53.270978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 76/147] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:49:52 2022] POST /identity/v3/users => generated 283 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:49:53.272139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea82f8-2c53-4893-b76a-958c6d70978c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:53.272433 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea82f8-2c53-4893-b76a-958c6d70978c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:53.272708 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea82f8-2c53-4893-b76a-958c6d70978c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:53.309922 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2dea82f8-2c53-4893-b76a-958c6d70978c None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:53.313642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2dea82f8-2c53-4893-b76a-958c6d70978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:53.367658 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e76c2-5116-438e-9f3e-14ac58662018 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:53.399037 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:53.410582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:53.422370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 77/148] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:53.423793 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cdcef-2e3f-4741-9375-763c200bd4e8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:53.427419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cdcef-2e3f-4741-9375-763c200bd4e8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:53.427419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3cdcef-2e3f-4741-9375-763c200bd4e8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:53.427419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 78/149] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:53.431670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d558089-278a-4d40-90af-feca32978951 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:53.432000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d558089-278a-4d40-90af-feca32978951 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:53.432282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d558089-278a-4d40-90af-feca32978951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:53.437165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c8393-556e-4c7c-b074-4f870f5345bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:53.438505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c8393-556e-4c7c-b074-4f870f5345bb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:53.438791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c8393-556e-4c7c-b074-4f870f5345bb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:53.439069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c8393-556e-4c7c-b074-4f870f5345bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:53.453757 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8d558089-278a-4d40-90af-feca32978951 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:53.455051 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8d558089-278a-4d40-90af-feca32978951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:53.546779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 79/150] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:49:53.561509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c8393-556e-4c7c-b074-4f870f5345bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:53.563554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c8393-556e-4c7c-b074-4f870f5345bb None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:53.681167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 72/151] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:49:53.686817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d558089-278a-4d40-90af-feca32978951 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:53.754685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c8393-556e-4c7c-b074-4f870f5345bb None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:53.807429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:53.819035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d558089-278a-4d40-90af-feca32978951 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:53.848258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:53.862807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113f199-014c-4cca-8c4d-02d44d76bbb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:53.863707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113f199-014c-4cca-8c4d-02d44d76bbb5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:53.864164 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113f199-014c-4cca-8c4d-02d44d76bbb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:53.864514 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0113f199-014c-4cca-8c4d-02d44d76bbb5 None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:53.865898 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113f199-014c-4cca-8c4d-02d44d76bbb5 None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:53.867418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0113f199-014c-4cca-8c4d-02d44d76bbb5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:53.869940 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 80/152] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:53 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:53.876380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113f199-014c-4cca-8c4d-02d44d76bbb5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:53.958217 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c8393-556e-4c7c-b074-4f870f5345bb None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:53.982803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0113f199-014c-4cca-8c4d-02d44d76bbb5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:54.008468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb683c5e-ce18-4507-97b5-bcc47afb50de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:54.009112 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683c5e-ce18-4507-97b5-bcc47afb50de None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:54.009394 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683c5e-ce18-4507-97b5-bcc47afb50de None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:54.009667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683c5e-ce18-4507-97b5-bcc47afb50de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:54.019958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39340028-bb54-4862-9296-f2c97193e51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:54.020576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39340028-bb54-4862-9296-f2c97193e51b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:54.020856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39340028-bb54-4862-9296-f2c97193e51b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:54.021131 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39340028-bb54-4862-9296-f2c97193e51b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:54.021339 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb683c5e-ce18-4507-97b5-bcc47afb50de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:54.021860 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39340028-bb54-4862-9296-f2c97193e51b None admin] RBAC: Adding query filter params (role.id=75d9054a423c4c66b163c72c8ae7989c, scope.project.id=48ad6ef4173e4919a439dd1e407c850c, user.id=c72dab1e64e3435cbf22437d73cbf5a9) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:54.022167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39340028-bb54-4862-9296-f2c97193e51b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:54.023593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39340028-bb54-4862-9296-f2c97193e51b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-eb683c5e-ce18-4507-97b5-bcc47afb50de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:54.026171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:54.027014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:54.027774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:54.027774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:54.027774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:54.027774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:54.027774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:54.027774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:54.027774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:54.027774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:54.027774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:54.027774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:54.027774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:49:54.027774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:49:54.027774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 73/153] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:49:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:54.029134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d9411-3fbb-4749-b565-f507c9d72eaa None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:54.029134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d9411-3fbb-4749-b565-f507c9d72eaa None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:54.029134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d9411-3fbb-4749-b565-f507c9d72eaa None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:54.031161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 81/154] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:49:53 2022] GET /identity/v3/role_assignments?user.id=c72dab1e64e3435cbf22437d73cbf5a9&scope.project.id=48ad6ef4173e4919a439dd1e407c850c&role.id=75d9054a423c4c66b163c72c8ae7989c => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:54.031277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 74/155] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:54.031348 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39340028-bb54-4862-9296-f2c97193e51b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:54.037162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d9411-3fbb-4749-b565-f507c9d72eaa None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:54.116346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:54.163077 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:54.184982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d9411-3fbb-4749-b565-f507c9d72eaa None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:54.188935 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39340028-bb54-4862-9296-f2c97193e51b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:54.234793 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c74f976-a0cb-4411-95a9-7f30a21dd334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:54.234987 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67990b2a-d2f2-4bfd-8957-d8798e9c6726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:54.235338 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74f976-a0cb-4411-95a9-7f30a21dd334 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:54.235445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67990b2a-d2f2-4bfd-8957-d8798e9c6726 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:54.235698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74f976-a0cb-4411-95a9-7f30a21dd334 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:54.235776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67990b2a-d2f2-4bfd-8957-d8798e9c6726 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:54.235992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67990b2a-d2f2-4bfd-8957-d8798e9c6726 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:54.236673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c74f976-a0cb-4411-95a9-7f30a21dd334 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:54.237440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74f976-a0cb-4411-95a9-7f30a21dd334 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:54.237745 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74f976-a0cb-4411-95a9-7f30a21dd334 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:54.239274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c74f976-a0cb-4411-95a9-7f30a21dd334 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:54.250172 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67990b2a-d2f2-4bfd-8957-d8798e9c6726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:54.250817 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 75/156] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-67990b2a-d2f2-4bfd-8957-d8798e9c6726 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:54.255715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:54.256777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:54.258956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:54.258956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:54.258956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:54.258956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:54.258956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:54.258956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:54.258956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:54.258956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:54.258956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:54.258956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:54.258956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:49:54.258956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:49:54.260475 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58866be6-c45d-40ef-9690-9961cf04bf12 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:54.260475 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58866be6-c45d-40ef-9690-9961cf04bf12 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:54.260475 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58866be6-c45d-40ef-9690-9961cf04bf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:54.260854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 82/157] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:54.260854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36e0c8-3b26-475a-8b53-866c36626a0a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:54.260854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36e0c8-3b26-475a-8b53-866c36626a0a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:54.260854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36e0c8-3b26-475a-8b53-866c36626a0a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:54.260854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 83/158] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:54.266192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36e0c8-3b26-475a-8b53-866c36626a0a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:54.280923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-58866be6-c45d-40ef-9690-9961cf04bf12 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:54.284133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-58866be6-c45d-40ef-9690-9961cf04bf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:54.368509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 76/159] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:54.375243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dba64-5333-4255-bf2c-d4a3546f4dfb None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:54.375538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dba64-5333-4255-bf2c-d4a3546f4dfb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:54.375817 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96dba64-5333-4255-bf2c-d4a3546f4dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:54.408739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36e0c8-3b26-475a-8b53-866c36626a0a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:54.415674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f96dba64-5333-4255-bf2c-d4a3546f4dfb None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:54.416984 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f96dba64-5333-4255-bf2c-d4a3546f4dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:54.432386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:54.449784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78afbb-2cd0-4a8c-8dce-60e37e54fb6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:54.450432 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78afbb-2cd0-4a8c-8dce-60e37e54fb6f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:54.450712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78afbb-2cd0-4a8c-8dce-60e37e54fb6f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:54.450986 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f78afbb-2cd0-4a8c-8dce-60e37e54fb6f None admin] PATH_INFO: `/v3/users/5ed7209395664f8f80ff40e9951b896e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:54.452460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78afbb-2cd0-4a8c-8dce-60e37e54fb6f None admin] RBAC: Authorizing `identity:get_user(user_id=5ed7209395664f8f80ff40e9951b896e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:54.454299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f78afbb-2cd0-4a8c-8dce-60e37e54fb6f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:54.456581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 84/160] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:54 2022] GET /identity/v3/users/5ed7209395664f8f80ff40e9951b896e => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:54.457260 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78afbb-2cd0-4a8c-8dce-60e37e54fb6f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:54.541474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 77/161] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:54.542344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dba64-5333-4255-bf2c-d4a3546f4dfb None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:54.561974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:54.571858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f78afbb-2cd0-4a8c-8dce-60e37e54fb6f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:54.620944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfc779-2d9c-4121-9089-f12c577d5c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:54.621570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfc779-2d9c-4121-9089-f12c577d5c2e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:54.621854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfc779-2d9c-4121-9089-f12c577d5c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:54.622123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bfc779-2d9c-4121-9089-f12c577d5c2e None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:54.622796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfc779-2d9c-4121-9089-f12c577d5c2e None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:54.623094 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfc779-2d9c-4121-9089-f12c577d5c2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:54.627216 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bfc779-2d9c-4121-9089-f12c577d5c2e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:54.644888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 85/162] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:49:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:54.650523 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfc779-2d9c-4121-9089-f12c577d5c2e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:54.712639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:54.754014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96dba64-5333-4255-bf2c-d4a3546f4dfb None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:54.777972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bfc779-2d9c-4121-9089-f12c577d5c2e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:54.816711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c929cf-0447-4278-a166-a1ac9c2f2e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:54.817394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c929cf-0447-4278-a166-a1ac9c2f2e7a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:54.817676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c929cf-0447-4278-a166-a1ac9c2f2e7a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:54.817947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c929cf-0447-4278-a166-a1ac9c2f2e7a None admin] PATH_INFO: `/v3/users/c72dab1e64e3435cbf22437d73cbf5a9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:54.819180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c929cf-0447-4278-a166-a1ac9c2f2e7a None admin] RBAC: Authorizing `identity:get_user(user_id=c72dab1e64e3435cbf22437d73cbf5a9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:54.820804 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c929cf-0447-4278-a166-a1ac9c2f2e7a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:54.822696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 86/163] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:54 2022] GET /identity/v3/users/c72dab1e64e3435cbf22437d73cbf5a9 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:54.828243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ffc8b-5f6f-45fd-8c58-21907dd262c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:54.828418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c929cf-0447-4278-a166-a1ac9c2f2e7a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:54.829355 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ffc8b-5f6f-45fd-8c58-21907dd262c4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:54.829828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ffc8b-5f6f-45fd-8c58-21907dd262c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:54.830286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ffc8b-5f6f-45fd-8c58-21907dd262c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:54.933164 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c929cf-0447-4278-a166-a1ac9c2f2e7a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:54.964211 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:54.970879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7a9e2-35dc-44eb-94e9-71b9ffce5630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:54.970879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7a9e2-35dc-44eb-94e9-71b9ffce5630 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:54.970879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7a9e2-35dc-44eb-94e9-71b9ffce5630 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:54.970879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7a9e2-35dc-44eb-94e9-71b9ffce5630 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:55.005857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ffc8b-5f6f-45fd-8c58-21907dd262c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:55.007636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ffc8b-5f6f-45fd-8c58-21907dd262c4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:55.022578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:55.043269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7a9e2-35dc-44eb-94e9-71b9ffce5630 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:55.044769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7a9e2-35dc-44eb-94e9-71b9ffce5630 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:55.168081 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 87/164] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:49:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:49:55.168859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7a9e2-35dc-44eb-94e9-71b9ffce5630 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:55.180692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 78/165] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:49:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:49:55.182120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ffc8b-5f6f-45fd-8c58-21907dd262c4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:55.196407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:55.299730 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ffc8b-5f6f-45fd-8c58-21907dd262c4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:55.313873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:55.341910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7058e-a183-46b6-b2bc-f0ba0e3787bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:55.343404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7058e-a183-46b6-b2bc-f0ba0e3787bc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:55.343909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7058e-a183-46b6-b2bc-f0ba0e3787bc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:55.344541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda7058e-a183-46b6-b2bc-f0ba0e3787bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:55.356176 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda7058e-a183-46b6-b2bc-f0ba0e3787bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-eda7058e-a183-46b6-b2bc-f0ba0e3787bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:55.363149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:55.364051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:55.364851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:55.364851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:55.364851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:55.364851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:55.364851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:55.364851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:55.364851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:55.364851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:55.364851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:55.364851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:55.364851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:49:55.364851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:49:55.367696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 79/166] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:49:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:55.368112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7a9e2-35dc-44eb-94e9-71b9ffce5630 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:55.368974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7058e-a183-46b6-b2bc-f0ba0e3787bc None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:55.496636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda7058e-a183-46b6-b2bc-f0ba0e3787bc None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:55.512935 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d81c1-740a-4258-9d33-13287cdd0c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:55.513928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d81c1-740a-4258-9d33-13287cdd0c2d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:55.514401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d81c1-740a-4258-9d33-13287cdd0c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:55.515019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d81c1-740a-4258-9d33-13287cdd0c2d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:55.536169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d81c1-740a-4258-9d33-13287cdd0c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-673d81c1-740a-4258-9d33-13287cdd0c2d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:55.541332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:55.542182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:55.542989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:55.542989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:55.542989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:55.542989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:55.542989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:55.542989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:55.542989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:55.542989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:55.542989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:55.542989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:55.542989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:49:55.542989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:49:55.545283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 88/167] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:55.546893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d81c1-740a-4258-9d33-13287cdd0c2d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:55.581290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bed76-675f-41b1-9f66-ebe17c891843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:55.581812 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bed76-675f-41b1-9f66-ebe17c891843 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:55.582096 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bed76-675f-41b1-9f66-ebe17c891843 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:55.582374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642bed76-675f-41b1-9f66-ebe17c891843 None admin] PATH_INFO: `/v3/projects/f72717c84d70483fb266e83b3cf280c0` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:55.588549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bed76-675f-41b1-9f66-ebe17c891843 None admin] RBAC: Authorizing `identity:get_project(project_id=f72717c84d70483fb266e83b3cf280c0)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:55.590012 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642bed76-675f-41b1-9f66-ebe17c891843 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:55.592296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 80/168] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:55 2022] GET /identity/v3/projects/f72717c84d70483fb266e83b3cf280c0 => generated 312 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:55.593602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bed76-675f-41b1-9f66-ebe17c891843 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:55.625789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:55.659663 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d81c1-740a-4258-9d33-13287cdd0c2d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:55.700195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ff8f7-292f-415b-a38a-2c0c45c11e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:55.701199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ff8f7-292f-415b-a38a-2c0c45c11e61 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:55.701743 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ff8f7-292f-415b-a38a-2c0c45c11e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:55.703227 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ff8f7-292f-415b-a38a-2c0c45c11e61 None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:55.703804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:55.705221 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ff8f7-292f-415b-a38a-2c0c45c11e61 None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:55.707003 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ff8f7-292f-415b-a38a-2c0c45c11e61 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:55.709439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 89/169] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:55 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:55.711088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ff8f7-292f-415b-a38a-2c0c45c11e61 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:55.830323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ff8f7-292f-415b-a38a-2c0c45c11e61 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:55.869072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961db7f8-473d-4e1d-bd73-28a62e8da6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:55.870156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961db7f8-473d-4e1d-bd73-28a62e8da6b4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:55.870655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961db7f8-473d-4e1d-bd73-28a62e8da6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:55.871120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961db7f8-473d-4e1d-bd73-28a62e8da6b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:55.872038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961db7f8-473d-4e1d-bd73-28a62e8da6b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:55.872550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961db7f8-473d-4e1d-bd73-28a62e8da6b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:55.874650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961db7f8-473d-4e1d-bd73-28a62e8da6b4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:55.879974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642bed76-675f-41b1-9f66-ebe17c891843 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:55.885088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 90/170] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:49:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:55.886179 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961db7f8-473d-4e1d-bd73-28a62e8da6b4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:55.889896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:55.940911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865328d-35b3-48bd-8024-5ee6bd3555e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:55.941521 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865328d-35b3-48bd-8024-5ee6bd3555e4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:55.941795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865328d-35b3-48bd-8024-5ee6bd3555e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:55.942055 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d865328d-35b3-48bd-8024-5ee6bd3555e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:55.942722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865328d-35b3-48bd-8024-5ee6bd3555e4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:55.943019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865328d-35b3-48bd-8024-5ee6bd3555e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:55.944411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d865328d-35b3-48bd-8024-5ee6bd3555e4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:55.952613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 81/171] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:49:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:55.953425 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865328d-35b3-48bd-8024-5ee6bd3555e4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:56.013440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961db7f8-473d-4e1d-bd73-28a62e8da6b4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:56.053257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd168fb1-8bb8-4c7d-ae8f-8e1c8f92edba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:56.054359 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd168fb1-8bb8-4c7d-ae8f-8e1c8f92edba None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:56.054882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd168fb1-8bb8-4c7d-ae8f-8e1c8f92edba None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:56.055347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd168fb1-8bb8-4c7d-ae8f-8e1c8f92edba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:56.056300 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd168fb1-8bb8-4c7d-ae8f-8e1c8f92edba None admin] RBAC: Adding query filter params (role.id=75d9054a423c4c66b163c72c8ae7989c, scope.project.id=f72717c84d70483fb266e83b3cf280c0, user.id=c72dab1e64e3435cbf22437d73cbf5a9) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:56.057087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd168fb1-8bb8-4c7d-ae8f-8e1c8f92edba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:56.058734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd168fb1-8bb8-4c7d-ae8f-8e1c8f92edba None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:56.066723 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 91/172] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:49:55 2022] GET /identity/v3/role_assignments?user.id=c72dab1e64e3435cbf22437d73cbf5a9&scope.project.id=f72717c84d70483fb266e83b3cf280c0&role.id=75d9054a423c4c66b163c72c8ae7989c => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:56.067790 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd168fb1-8bb8-4c7d-ae8f-8e1c8f92edba None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:56.158796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:56.202352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd168fb1-8bb8-4c7d-ae8f-8e1c8f92edba None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:56.210064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:56.226189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d865328d-35b3-48bd-8024-5ee6bd3555e4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:56.249734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a60c2-ed46-4521-8b3b-f6e85940f013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:56.250797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a60c2-ed46-4521-8b3b-f6e85940f013 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:56.251273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a60c2-ed46-4521-8b3b-f6e85940f013 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:56.251735 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a60c2-ed46-4521-8b3b-f6e85940f013 None admin] PATH_INFO: `/v3/users/057609c2f69c43989189ec4b732b138e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:56.253443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a60c2-ed46-4521-8b3b-f6e85940f013 None admin] RBAC: Authorizing `identity:get_user(user_id=057609c2f69c43989189ec4b732b138e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:56.255316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10a60c2-ed46-4521-8b3b-f6e85940f013 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:56.257762 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 92/173] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:56 2022] GET /identity/v3/users/057609c2f69c43989189ec4b732b138e => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:56.258909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a60c2-ed46-4521-8b3b-f6e85940f013 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:56.311434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55cc6d-9497-4577-953e-295d58c71365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:56.312049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55cc6d-9497-4577-953e-295d58c71365 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:56.312263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55cc6d-9497-4577-953e-295d58c71365 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:56.312540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe55cc6d-9497-4577-953e-295d58c71365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:56.313289 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55cc6d-9497-4577-953e-295d58c71365 None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=48ad6ef4173e4919a439dd1e407c850c, user.id=5ed7209395664f8f80ff40e9951b896e) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:56.313600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55cc6d-9497-4577-953e-295d58c71365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:56.315093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe55cc6d-9497-4577-953e-295d58c71365 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:56.321959 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 82/174] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:49:55 2022] GET /identity/v3/role_assignments?user.id=5ed7209395664f8f80ff40e9951b896e&scope.project.id=48ad6ef4173e4919a439dd1e407c850c&role.id=68b1888f7bb644a39938b8d41006a813 => generated 608 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:56.322746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55cc6d-9497-4577-953e-295d58c71365 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:56.388863 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10a60c2-ed46-4521-8b3b-f6e85940f013 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:56.457988 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4b524-885b-4080-8d32-560700632cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:56.458978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4b524-885b-4080-8d32-560700632cc9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:56.459454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4b524-885b-4080-8d32-560700632cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:56.459946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4b524-885b-4080-8d32-560700632cc9 None admin] PATH_INFO: `/v3/users/c72dab1e64e3435cbf22437d73cbf5a9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:56.462577 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4b524-885b-4080-8d32-560700632cc9 None admin] RBAC: Authorizing `identity:get_user(user_id=c72dab1e64e3435cbf22437d73cbf5a9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:56.464339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4b524-885b-4080-8d32-560700632cc9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:56.468834 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 93/175] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:56 2022] GET /identity/v3/users/c72dab1e64e3435cbf22437d73cbf5a9 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:56.470322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f034b-90a6-418b-a892-e3375a194fe1 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:56.470798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f034b-90a6-418b-a892-e3375a194fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:56.471263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f034b-90a6-418b-a892-e3375a194fe1 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:56.472967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 94/176] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:56.482823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f034b-90a6-418b-a892-e3375a194fe1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:56.486217 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:56.510242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe55cc6d-9497-4577-953e-295d58c71365 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:56.549072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98bd2b-383c-465d-bac5-fd21424361db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:56.549720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bd2b-383c-465d-bac5-fd21424361db None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:56.550003 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bd2b-383c-465d-bac5-fd21424361db None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:56.550378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98bd2b-383c-465d-bac5-fd21424361db None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:56.551754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98bd2b-383c-465d-bac5-fd21424361db None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:56.553427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee98bd2b-383c-465d-bac5-fd21424361db None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:56.555332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 83/177] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:56 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:56.561329 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd85da7-bab4-4c4e-a7de-fbfad7156462 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:56.561660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd85da7-bab4-4c4e-a7de-fbfad7156462 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:56.561941 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd85da7-bab4-4c4e-a7de-fbfad7156462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:56.582903 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8dd85da7-bab4-4c4e-a7de-fbfad7156462 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:56.584205 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8dd85da7-bab4-4c4e-a7de-fbfad7156462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:56.599559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f034b-90a6-418b-a892-e3375a194fe1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:56.624284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:56.640207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848214a-a873-42f7-94e7-036587c4078d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:56.640993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848214a-a873-42f7-94e7-036587c4078d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:56.641372 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848214a-a873-42f7-94e7-036587c4078d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:56.641759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2848214a-a873-42f7-94e7-036587c4078d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:56.665631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 84/178] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:56.673103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd85da7-bab4-4c4e-a7de-fbfad7156462 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:56.714980 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848214a-a873-42f7-94e7-036587c4078d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:56.716792 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2848214a-a873-42f7-94e7-036587c4078d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:56.720316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:56.827992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 95/179] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:49:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:49:56.833027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd85da7-bab4-4c4e-a7de-fbfad7156462 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:56.833864 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848214a-a873-42f7-94e7-036587c4078d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:56.898453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17c3d9a-a71a-4c4c-a5cc-84c7cb431506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:56.899291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c3d9a-a71a-4c4c-a5cc-84c7cb431506 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:56.899662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c3d9a-a71a-4c4c-a5cc-84c7cb431506 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:56.900051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c3d9a-a71a-4c4c-a5cc-84c7cb431506 None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c/users/057609c2f69c43989189ec4b732b138e/roles/569b7f0b7a5c4fe5b974abf4cfccfcb2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:56.903870 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c3d9a-a71a-4c4c-a5cc-84c7cb431506 None admin] RBAC: Authorizing `identity:create_grant(project_id=48ad6ef4173e4919a439dd1e407c850c, user_id=057609c2f69c43989189ec4b732b138e, role_id=569b7f0b7a5c4fe5b974abf4cfccfcb2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:56.906770 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17c3d9a-a71a-4c4c-a5cc-84c7cb431506 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:56.967477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2848214a-a873-42f7-94e7-036587c4078d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:56.969527 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:56.995501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 85/180] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:49:56 2022] PUT /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c/users/057609c2f69c43989189ec4b732b138e/roles/569b7f0b7a5c4fe5b974abf4cfccfcb2 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:49:56.996917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2af81b-df6a-4662-8f46-057bc71eea0a None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:56.997273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2af81b-df6a-4662-8f46-057bc71eea0a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:56.997607 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2af81b-df6a-4662-8f46-057bc71eea0a None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:56.998945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 86/181] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:57.009356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf231c-34da-4250-b43c-0cea18fac8cb None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:57.009733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf231c-34da-4250-b43c-0cea18fac8cb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:57.010072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf231c-34da-4250-b43c-0cea18fac8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:57.021990 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ef560-f931-4ef7-97d2-0b5ade95f40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:57.022649 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef560-f931-4ef7-97d2-0b5ade95f40b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:57.022932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef560-f931-4ef7-97d2-0b5ade95f40b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:57.023208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ef560-f931-4ef7-97d2-0b5ade95f40b None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:57.025292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ef560-f931-4ef7-97d2-0b5ade95f40b None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:57.026796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6ef560-f931-4ef7-97d2-0b5ade95f40b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:57.028759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 96/182] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:56 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:57.034676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ef560-f931-4ef7-97d2-0b5ade95f40b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:57.048964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1eaf231c-34da-4250-b43c-0cea18fac8cb None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:57.050178 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1eaf231c-34da-4250-b43c-0cea18fac8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:57.071383 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:57.149500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 87/183] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:57.150491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf231c-34da-4250-b43c-0cea18fac8cb None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:57.217446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ef560-f931-4ef7-97d2-0b5ade95f40b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:57.260392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a17d4c-275e-4079-a2fe-6d9f3c23a059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:57.261296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a17d4c-275e-4079-a2fe-6d9f3c23a059 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:57.261758 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a17d4c-275e-4079-a2fe-6d9f3c23a059 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:57.262208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a17d4c-275e-4079-a2fe-6d9f3c23a059 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:57.263112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a17d4c-275e-4079-a2fe-6d9f3c23a059 None admin] RBAC: Adding query filter params (role.id=d78c47b14910477fa17f456efbbc177c, scope.project.id=48ad6ef4173e4919a439dd1e407c850c, user.id=c72dab1e64e3435cbf22437d73cbf5a9) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:57.263618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a17d4c-275e-4079-a2fe-6d9f3c23a059 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:57.265400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a17d4c-275e-4079-a2fe-6d9f3c23a059 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:57.272356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 97/184] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:49:57 2022] GET /identity/v3/role_assignments?user.id=c72dab1e64e3435cbf22437d73cbf5a9&scope.project.id=48ad6ef4173e4919a439dd1e407c850c&role.id=d78c47b14910477fa17f456efbbc177c => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:57.274003 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27f18-45bb-42d3-853d-5ae2eb159972 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:57.274297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27f18-45bb-42d3-853d-5ae2eb159972 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:57.274573 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee27f18-45bb-42d3-853d-5ae2eb159972 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:57.275799 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 98/185] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:57.282429 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfe972-b132-4880-83b7-7a2e6e1cb8ee None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:57.282736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfe972-b132-4880-83b7-7a2e6e1cb8ee None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:57.283000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adfe972-b132-4880-83b7-7a2e6e1cb8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:57.287028 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf231c-34da-4250-b43c-0cea18fac8cb None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:57.307793 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1adfe972-b132-4880-83b7-7a2e6e1cb8ee None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:57.309366 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1adfe972-b132-4880-83b7-7a2e6e1cb8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:57.337049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80168608-fd11-427d-8b67-ff1c098af9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:57.337698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80168608-fd11-427d-8b67-ff1c098af9d0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:57.338004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80168608-fd11-427d-8b67-ff1c098af9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:57.338278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80168608-fd11-427d-8b67-ff1c098af9d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:57.349385 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:57.357018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80168608-fd11-427d-8b67-ff1c098af9d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-80168608-fd11-427d-8b67-ff1c098af9d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:57.364068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:57.366743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:57.367546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:57.367546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:57.367546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:57.367546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:57.367546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:57.367546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:57.367546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:57.367546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:57.367546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:57.367546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:57.367546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:49:57.367546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:49:57.367546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 88/186] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:49:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:57.371062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80168608-fd11-427d-8b67-ff1c098af9d0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:57.388214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:57.413958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 99/187] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:49:57.465145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfe972-b132-4880-83b7-7a2e6e1cb8ee None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:57.541428 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80168608-fd11-427d-8b67-ff1c098af9d0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:57.582991 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb222228-2d07-4c9f-b6cd-d449b7fddd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:57.583867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb222228-2d07-4c9f-b6cd-d449b7fddd3a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:57.584293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb222228-2d07-4c9f-b6cd-d449b7fddd3a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:57.584783 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb222228-2d07-4c9f-b6cd-d449b7fddd3a None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:57.585692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb222228-2d07-4c9f-b6cd-d449b7fddd3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:57.586137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb222228-2d07-4c9f-b6cd-d449b7fddd3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:57.587644 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb222228-2d07-4c9f-b6cd-d449b7fddd3a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:57.588095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adfe972-b132-4880-83b7-7a2e6e1cb8ee None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:57.598527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 89/188] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:57.604377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb222228-2d07-4c9f-b6cd-d449b7fddd3a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:57.630675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61a26c-e5ae-40b4-a83e-237932818540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:57.631358 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61a26c-e5ae-40b4-a83e-237932818540 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:57.631639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61a26c-e5ae-40b4-a83e-237932818540 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:57.631934 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b61a26c-e5ae-40b4-a83e-237932818540 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:57.649410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b61a26c-e5ae-40b4-a83e-237932818540 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2b61a26c-e5ae-40b4-a83e-237932818540 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:57.654328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:57.655354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:57.656264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:57.656264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:57.656264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:57.656264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:57.656264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:57.656264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:57.656264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:57.656264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:57.656264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:57.656264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:57.656264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:49:57.656264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:49:57.656264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 100/189] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:49:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:57.661505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61a26c-e5ae-40b4-a83e-237932818540 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:57.689646 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:57.699716 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:57.732241 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb222228-2d07-4c9f-b6cd-d449b7fddd3a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:57.773376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b61a26c-e5ae-40b4-a83e-237932818540 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:57.774380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093a094-2a44-4040-9361-26a65b4c9fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:57.775091 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093a094-2a44-4040-9361-26a65b4c9fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:57.775288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093a094-2a44-4040-9361-26a65b4c9fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:57.775556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2093a094-2a44-4040-9361-26a65b4c9fe4 None admin] PATH_INFO: `/v3/users/2ac8b3207ae2425b9de63ce457f90dd6` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:57.790049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093a094-2a44-4040-9361-26a65b4c9fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=2ac8b3207ae2425b9de63ce457f90dd6)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:57.791538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2093a094-2a44-4040-9361-26a65b4c9fe4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:57.793300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 90/190] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:57 2022] GET /identity/v3/users/2ac8b3207ae2425b9de63ce457f90dd6 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:57.793895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093a094-2a44-4040-9361-26a65b4c9fe4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:57.813499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c539820-a5cb-4179-a717-6655e7653a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:57.814306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539820-a5cb-4179-a717-6655e7653a84 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:57.814589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539820-a5cb-4179-a717-6655e7653a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:57.814859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c539820-a5cb-4179-a717-6655e7653a84 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:57.815817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c539820-a5cb-4179-a717-6655e7653a84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:57.816153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c539820-a5cb-4179-a717-6655e7653a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:57.817566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c539820-a5cb-4179-a717-6655e7653a84 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:57.829969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 101/191] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:49:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:57.831950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c539820-a5cb-4179-a717-6655e7653a84 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:57.902950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2093a094-2a44-4040-9361-26a65b4c9fe4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:57.925443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:57.935722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:57.940643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c539820-a5cb-4179-a717-6655e7653a84 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:57.942464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fb146-f645-41cd-a95e-10003031a6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:57.943532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fb146-f645-41cd-a95e-10003031a6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:57.943532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fb146-f645-41cd-a95e-10003031a6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:57.943720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632fb146-f645-41cd-a95e-10003031a6c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:57.944799 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fb146-f645-41cd-a95e-10003031a6c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:57.946267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632fb146-f645-41cd-a95e-10003031a6c7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:57.948048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 91/192] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:49:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:57.948834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fb146-f645-41cd-a95e-10003031a6c7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:57.981886 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af78c09-cebd-4318-a2ed-16d0ed9208dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:57.982580 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af78c09-cebd-4318-a2ed-16d0ed9208dc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:57.982935 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af78c09-cebd-4318-a2ed-16d0ed9208dc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:57.983282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af78c09-cebd-4318-a2ed-16d0ed9208dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:58.054922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632fb146-f645-41cd-a95e-10003031a6c7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:58.055093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af78c09-cebd-4318-a2ed-16d0ed9208dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:58.056767 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af78c09-cebd-4318-a2ed-16d0ed9208dc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:58.091277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fea5d-82c2-4af0-9c53-d2b50201c04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:58.091931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fea5d-82c2-4af0-9c53-d2b50201c04c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:58.092306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fea5d-82c2-4af0-9c53-d2b50201c04c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:58.092486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fea5d-82c2-4af0-9c53-d2b50201c04c None admin] PATH_INFO: `/v3/users/2ac8b3207ae2425b9de63ce457f90dd6` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:58.094314 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fea5d-82c2-4af0-9c53-d2b50201c04c None admin] RBAC: Authorizing `identity:get_user(user_id=2ac8b3207ae2425b9de63ce457f90dd6)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:58.096119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fea5d-82c2-4af0-9c53-d2b50201c04c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:58.097711 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 92/193] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:49:57 2022] GET /identity/v3/users/2ac8b3207ae2425b9de63ce457f90dd6 => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:58.098464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fea5d-82c2-4af0-9c53-d2b50201c04c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:58.151154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:58.171437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 102/194] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:49:58.171437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af78c09-cebd-4318-a2ed-16d0ed9208dc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:58.177703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:58.212253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fea5d-82c2-4af0-9c53-d2b50201c04c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:58.247196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d62275-dfbe-47d7-b732-b27dcc8b2e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:58.247817 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d62275-dfbe-47d7-b732-b27dcc8b2e33 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:58.248125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d62275-dfbe-47d7-b732-b27dcc8b2e33 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:58.248397 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d62275-dfbe-47d7-b732-b27dcc8b2e33 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:58.249703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d62275-dfbe-47d7-b732-b27dcc8b2e33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:58.251311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d62275-dfbe-47d7-b732-b27dcc8b2e33 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:58.273534 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af78c09-cebd-4318-a2ed-16d0ed9208dc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:58.308658 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83251b-516a-457d-b4cd-0c1edc3706d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:58.309198 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83251b-516a-457d-b4cd-0c1edc3706d7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:58.309477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83251b-516a-457d-b4cd-0c1edc3706d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:58.309751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83251b-516a-457d-b4cd-0c1edc3706d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:58.356287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 93/195] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:49:58 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:49:58.357038 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d62275-dfbe-47d7-b732-b27dcc8b2e33 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:58.386853 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:58.403491 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83251b-516a-457d-b4cd-0c1edc3706d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:58.405140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b83251b-516a-457d-b4cd-0c1edc3706d7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:58.511281 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d62275-dfbe-47d7-b732-b27dcc8b2e33 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:58.528353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 103/196] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:49:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:49:58.535289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83251b-516a-457d-b4cd-0c1edc3706d7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:58.542056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:58.557186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ff5bf-1361-4d72-a5e5-068d699f90d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:58.558047 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ff5bf-1361-4d72-a5e5-068d699f90d2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:58.558471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ff5bf-1361-4d72-a5e5-068d699f90d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:58.558966 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690ff5bf-1361-4d72-a5e5-068d699f90d2 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:58.561087 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ff5bf-1361-4d72-a5e5-068d699f90d2 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:58.562895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690ff5bf-1361-4d72-a5e5-068d699f90d2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:58.570584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 94/197] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:58 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:49:58.572154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ff5bf-1361-4d72-a5e5-068d699f90d2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:58.638947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:58.660089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83251b-516a-457d-b4cd-0c1edc3706d7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:58.708889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4665e3-03a6-4521-9ba7-ed40a42fb927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:58.709623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4665e3-03a6-4521-9ba7-ed40a42fb927 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:58.709975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4665e3-03a6-4521-9ba7-ed40a42fb927 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:58.710319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4665e3-03a6-4521-9ba7-ed40a42fb927 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:58.710800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690ff5bf-1361-4d72-a5e5-068d699f90d2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:58.711648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4665e3-03a6-4521-9ba7-ed40a42fb927 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:58.713374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4665e3-03a6-4521-9ba7-ed40a42fb927 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:58.716552 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 104/198] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:49:58 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:58.723528 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4665e3-03a6-4521-9ba7-ed40a42fb927 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:58.760349 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d262b6-e3c0-4ac9-a670-4b6d05e58885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:58.760977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d262b6-e3c0-4ac9-a670-4b6d05e58885 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:58.761253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d262b6-e3c0-4ac9-a670-4b6d05e58885 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:58.761521 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d262b6-e3c0-4ac9-a670-4b6d05e58885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:58.762264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d262b6-e3c0-4ac9-a670-4b6d05e58885 None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=ba004675284d4e2fb1037370cf5a047e, user.id=2ac8b3207ae2425b9de63ce457f90dd6) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:58.762573 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d262b6-e3c0-4ac9-a670-4b6d05e58885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:58.764328 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d262b6-e3c0-4ac9-a670-4b6d05e58885 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:58.772920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 95/199] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:49:58 2022] GET /identity/v3/role_assignments?user.id=2ac8b3207ae2425b9de63ce457f90dd6&scope.project.id=ba004675284d4e2fb1037370cf5a047e&role.id=68b1888f7bb644a39938b8d41006a813 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:58.858968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4665e3-03a6-4521-9ba7-ed40a42fb927 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:58.896375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8fc57f-67da-4ce9-bab9-c17577afcc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:58.897050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fc57f-67da-4ce9-bab9-c17577afcc9a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:58.897337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fc57f-67da-4ce9-bab9-c17577afcc9a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:58.897701 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8fc57f-67da-4ce9-bab9-c17577afcc9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:58.898441 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fc57f-67da-4ce9-bab9-c17577afcc9a None admin] RBAC: Adding query filter params (role.id=d78c47b14910477fa17f456efbbc177c, scope.project.id=ba004675284d4e2fb1037370cf5a047e, user.id=2ac8b3207ae2425b9de63ce457f90dd6) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:49:58.898750 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fc57f-67da-4ce9-bab9-c17577afcc9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:49:58.900248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8fc57f-67da-4ce9-bab9-c17577afcc9a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:49:58.907482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 105/200] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:49:58 2022] GET /identity/v3/role_assignments?user.id=2ac8b3207ae2425b9de63ce457f90dd6&scope.project.id=ba004675284d4e2fb1037370cf5a047e&role.id=d78c47b14910477fa17f456efbbc177c => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:49:59.244471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8bea7-af37-4272-92a5-a47102449ca6 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:59.244926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8bea7-af37-4272-92a5-a47102449ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:59.245317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba8bea7-af37-4272-92a5-a47102449ca6 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:59.246780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 96/201] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:49:59.252513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562dadc-4577-4a83-9c12-918f5d3c9c0a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:59.252917 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562dadc-4577-4a83-9c12-918f5d3c9c0a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:59.253292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562dadc-4577-4a83-9c12-918f5d3c9c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:59.272024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2562dadc-4577-4a83-9c12-918f5d3c9c0a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:49:59.273227 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2562dadc-4577-4a83-9c12-918f5d3c9c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:49:59.289046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:59.361061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 106/202] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:49:59.751564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8bea7-af37-4272-92a5-a47102449ca6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:49:59.822672 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:49:59.884709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba8bea7-af37-4272-92a5-a47102449ca6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:49:59.926850 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c2197-6d0d-4107-b328-75508c22b142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:49:59.927489 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2197-6d0d-4107-b328-75508c22b142 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:49:59.927769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2197-6d0d-4107-b328-75508c22b142 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:49:59.928069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846c2197-6d0d-4107-b328-75508c22b142 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:49:59.939289 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846c2197-6d0d-4107-b328-75508c22b142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-846c2197-6d0d-4107-b328-75508c22b142 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:49:59.944158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:49:59.945185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:49:59.946025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:49:59.946025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:49:59.946025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:49:59.946025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:49:59.946025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:49:59.946025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:49:59.946025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:49:59.946025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:49:59.946025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:49:59.946025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:49:59.946025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:49:59.946025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:49:59.946025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 97/203] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:49:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:49:59.951480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562dadc-4577-4a83-9c12-918f5d3c9c0a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:00.073767 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562dadc-4577-4a83-9c12-918f5d3c9c0a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:00.120970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da31bc-235f-4106-872b-a7515eb367fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:00.121586 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da31bc-235f-4106-872b-a7515eb367fe None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:00.121866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da31bc-235f-4106-872b-a7515eb367fe None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:00.122139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da31bc-235f-4106-872b-a7515eb367fe None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:00.122801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da31bc-235f-4106-872b-a7515eb367fe None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:00.123104 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da31bc-235f-4106-872b-a7515eb367fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:00.125139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da31bc-235f-4106-872b-a7515eb367fe None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:00.138042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 107/204] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:49:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:00.144257 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c2197-6d0d-4107-b328-75508c22b142 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:00.254775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846c2197-6d0d-4107-b328-75508c22b142 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:00.271286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:00.298910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2362e-2c6a-4a13-9106-21480239747b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:00.299917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2362e-2c6a-4a13-9106-21480239747b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:00.300503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2362e-2c6a-4a13-9106-21480239747b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:00.300988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef2362e-2c6a-4a13-9106-21480239747b None admin] PATH_INFO: `/v3/users/057609c2f69c43989189ec4b732b138e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:00.302361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2362e-2c6a-4a13-9106-21480239747b None admin] RBAC: Authorizing `identity:get_user(user_id=057609c2f69c43989189ec4b732b138e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:00.304045 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef2362e-2c6a-4a13-9106-21480239747b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:00.305852 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 98/205] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:00 2022] GET /identity/v3/users/057609c2f69c43989189ec4b732b138e => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:00.312304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da31bc-235f-4106-872b-a7515eb367fe None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:00.332964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:00.446724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da31bc-235f-4106-872b-a7515eb367fe None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:00.489003 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740d765-3ebb-4ac6-abca-8fc1677f9f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:00.489621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740d765-3ebb-4ac6-abca-8fc1677f9f17 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:00.489899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740d765-3ebb-4ac6-abca-8fc1677f9f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:00.490218 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a740d765-3ebb-4ac6-abca-8fc1677f9f17 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:00.574558 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740d765-3ebb-4ac6-abca-8fc1677f9f17 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:00.576097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a740d765-3ebb-4ac6-abca-8fc1677f9f17 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:00.594071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:00.703619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 108/206] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:00.705027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2362e-2c6a-4a13-9106-21480239747b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:00.904371 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef2362e-2c6a-4a13-9106-21480239747b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:00.957952 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09e8928-d774-45e3-95f1-755f23c4ffbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:00.958595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e8928-d774-45e3-95f1-755f23c4ffbc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:00.958881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e8928-d774-45e3-95f1-755f23c4ffbc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:00.959154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09e8928-d774-45e3-95f1-755f23c4ffbc None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:00.960346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e8928-d774-45e3-95f1-755f23c4ffbc None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:00.961795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09e8928-d774-45e3-95f1-755f23c4ffbc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:00.963448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 99/207] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:00 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:00.970513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740d765-3ebb-4ac6-abca-8fc1677f9f17 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:01.100059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa08c9-10f8-4383-9cd9-4a8f7203b97f None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:01.100401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa08c9-10f8-4383-9cd9-4a8f7203b97f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:01.100622 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa08c9-10f8-4383-9cd9-4a8f7203b97f None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:01.101969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 100/208] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:01.121365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d083e-9b29-4bd3-a70e-f1e99f8da0e7 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:01.121702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d083e-9b29-4bd3-a70e-f1e99f8da0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:01.121927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4d083e-9b29-4bd3-a70e-f1e99f8da0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:01.129801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a740d765-3ebb-4ac6-abca-8fc1677f9f17 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:01.141417 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:01.159207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4c4d083e-9b29-4bd3-a70e-f1e99f8da0e7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:01.160367 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4c4d083e-9b29-4bd3-a70e-f1e99f8da0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:01.166906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b6d33-ad8c-486d-9582-8d50c6a37e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:01.167792 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b6d33-ad8c-486d-9582-8d50c6a37e95 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:01.168149 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b6d33-ad8c-486d-9582-8d50c6a37e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:01.168420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b6d33-ad8c-486d-9582-8d50c6a37e95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:01.169151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b6d33-ad8c-486d-9582-8d50c6a37e95 None admin] RBAC: Adding query filter params (role.id=569b7f0b7a5c4fe5b974abf4cfccfcb2, scope.project.id=48ad6ef4173e4919a439dd1e407c850c, user.id=057609c2f69c43989189ec4b732b138e) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:01.169510 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b6d33-ad8c-486d-9582-8d50c6a37e95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:01.171065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b6d33-ad8c-486d-9582-8d50c6a37e95 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:01.179883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 109/209] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:00 2022] GET /identity/v3/role_assignments?user.id=057609c2f69c43989189ec4b732b138e&scope.project.id=48ad6ef4173e4919a439dd1e407c850c&role.id=569b7f0b7a5c4fe5b974abf4cfccfcb2 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:01.179883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763cb6a-eba7-49ed-933a-0e078d3ed44f None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:01.179883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763cb6a-eba7-49ed-933a-0e078d3ed44f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:01.179883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3763cb6a-eba7-49ed-933a-0e078d3ed44f None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:01.181616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 110/210] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:01.189670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23480cf-ada5-4c4f-b931-485649867777 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:01.189968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23480cf-ada5-4c4f-b931-485649867777 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:01.190231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23480cf-ada5-4c4f-b931-485649867777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:01.232909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d23480cf-ada5-4c4f-b931-485649867777 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:01.237111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d23480cf-ada5-4c4f-b931-485649867777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:01.248651 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:01.294181 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 101/211] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:50:01.360351 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 111/212] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:50:01.368262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cfbb1-2c4f-4a9f-846f-83fc503c046e None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:01.368545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cfbb1-2c4f-4a9f-846f-83fc503c046e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:01.368819 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480cfbb1-2c4f-4a9f-846f-83fc503c046e None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:01.370495 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 102/213] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:01.376322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300f014-dfe8-4ea9-983b-81df171a6260 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:01.376614 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300f014-dfe8-4ea9-983b-81df171a6260 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:01.376892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7300f014-dfe8-4ea9-983b-81df171a6260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:01.399092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7300f014-dfe8-4ea9-983b-81df171a6260 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:01.400570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7300f014-dfe8-4ea9-983b-81df171a6260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:01.456827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa30a0-3250-43ff-9329-b29cf66805c1 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:01.457439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa30a0-3250-43ff-9329-b29cf66805c1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:01.457788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aa30a0-3250-43ff-9329-b29cf66805c1 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:01.459577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 103/214] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:50:01.466829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27014ba-f023-4207-ab16-b70973eba553 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:01.467733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27014ba-f023-4207-ab16-b70973eba553 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:01.468602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27014ba-f023-4207-ab16-b70973eba553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:01.474471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 112/215] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:01.497817 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b27014ba-f023-4207-ab16-b70973eba553 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:01.500147 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b27014ba-f023-4207-ab16-b70973eba553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:01.594256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 104/216] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:01.626533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300f014-dfe8-4ea9-983b-81df171a6260 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:01.660798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27014ba-f023-4207-ab16-b70973eba553 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:01.662358 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:01.729802 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7300f014-dfe8-4ea9-983b-81df171a6260 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:01.766468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe4133-ccf3-46be-99a6-7560efc64c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:01.767099 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe4133-ccf3-46be-99a6-7560efc64c16 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:01.767356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27014ba-f023-4207-ab16-b70973eba553 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:01.767468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe4133-ccf3-46be-99a6-7560efc64c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:01.767694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe4133-ccf3-46be-99a6-7560efc64c16 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:01.778744 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:01.781639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fe4133-ccf3-46be-99a6-7560efc64c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-54fe4133-ccf3-46be-99a6-7560efc64c16 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:01.787500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:01.795076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:01.797027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:01.797027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:01.797027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:01.797027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:01.797027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:01.797027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:01.797027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:01.797027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:01.797027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:01.797027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:01.797027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:50:01.797027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:01.797027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 113/217] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:50:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:01.797027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe4133-ccf3-46be-99a6-7560efc64c16 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:01.805690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5eedb4-51a0-48fa-9f6a-fe241caeadb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:01.806409 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eedb4-51a0-48fa-9f6a-fe241caeadb0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:01.806722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eedb4-51a0-48fa-9f6a-fe241caeadb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:01.806995 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5eedb4-51a0-48fa-9f6a-fe241caeadb0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:01.818554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5eedb4-51a0-48fa-9f6a-fe241caeadb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-6c5eedb4-51a0-48fa-9f6a-fe241caeadb0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:01.823403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:01.824346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:01.825689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:01.825689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:01.825689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:01.825689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:01.825689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:01.825689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:01.825689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:01.825689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:01.825689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:01.825689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:01.825689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:01.825689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:01.825689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 105/218] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:01.830059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5eedb4-51a0-48fa-9f6a-fe241caeadb0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:01.895957 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:01.901897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe4133-ccf3-46be-99a6-7560efc64c16 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:01.933118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5eedb4-51a0-48fa-9f6a-fe241caeadb0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:01.934417 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00c534-8204-444f-879d-b81479c6df96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:01.935043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00c534-8204-444f-879d-b81479c6df96 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:01.935311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00c534-8204-444f-879d-b81479c6df96 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:01.935590 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00c534-8204-444f-879d-b81479c6df96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:01.946307 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00c534-8204-444f-879d-b81479c6df96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-9f00c534-8204-444f-879d-b81479c6df96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:01.951022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:01.951950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:01.952776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:01.952776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:01.952776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:01.952776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:01.952776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:01.952776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:01.952776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:01.952776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:01.952776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:01.952776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:01.952776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:01.952776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:01.952776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 114/219] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:50:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:01.953445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00c534-8204-444f-879d-b81479c6df96 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:01.971365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088f886-3f48-439a-b5ce-e85bff79aec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:01.972008 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088f886-3f48-439a-b5ce-e85bff79aec8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:01.972288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088f886-3f48-439a-b5ce-e85bff79aec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:01.972555 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088f886-3f48-439a-b5ce-e85bff79aec8 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:01.973219 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088f886-3f48-439a-b5ce-e85bff79aec8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:01.973519 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088f886-3f48-439a-b5ce-e85bff79aec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:01.974879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088f886-3f48-439a-b5ce-e85bff79aec8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:01.982954 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 106/220] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:01.984435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088f886-3f48-439a-b5ce-e85bff79aec8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:02.014083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:02.051785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00c534-8204-444f-879d-b81479c6df96 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:02.082865 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088f886-3f48-439a-b5ce-e85bff79aec8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:02.086294 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e775cde-815c-43d7-85ec-a05dfccdfcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:02.086905 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e775cde-815c-43d7-85ec-a05dfccdfcbc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:02.087190 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e775cde-815c-43d7-85ec-a05dfccdfcbc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:02.087469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e775cde-815c-43d7-85ec-a05dfccdfcbc None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:02.088170 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e775cde-815c-43d7-85ec-a05dfccdfcbc None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:02.088479 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e775cde-815c-43d7-85ec-a05dfccdfcbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:02.089891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e775cde-815c-43d7-85ec-a05dfccdfcbc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:02.099213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 115/221] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:02.099213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e775cde-815c-43d7-85ec-a05dfccdfcbc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:02.118207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:02.121420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb88f84-939a-485a-b8f2-a871a12fd92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:02.122048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb88f84-939a-485a-b8f2-a871a12fd92c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:02.122324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb88f84-939a-485a-b8f2-a871a12fd92c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:02.122591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb88f84-939a-485a-b8f2-a871a12fd92c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:02.124314 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb88f84-939a-485a-b8f2-a871a12fd92c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:02.125793 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb88f84-939a-485a-b8f2-a871a12fd92c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:02.127389 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 107/222] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:02.128173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb88f84-939a-485a-b8f2-a871a12fd92c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:02.197673 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e775cde-815c-43d7-85ec-a05dfccdfcbc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:02.225222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:02.228261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb88f84-939a-485a-b8f2-a871a12fd92c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:02.231213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec4e48-861b-417b-b8e5-3a63a5bb9a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:02.231814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec4e48-861b-417b-b8e5-3a63a5bb9a46 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:02.234578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec4e48-861b-417b-b8e5-3a63a5bb9a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:02.234578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec4e48-861b-417b-b8e5-3a63a5bb9a46 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:02.234578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec4e48-861b-417b-b8e5-3a63a5bb9a46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:02.234578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec4e48-861b-417b-b8e5-3a63a5bb9a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:02.235414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec4e48-861b-417b-b8e5-3a63a5bb9a46 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:02.243178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 116/223] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:02.243986 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec4e48-861b-417b-b8e5-3a63a5bb9a46 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:02.263998 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a2b4a-71c7-41f4-8945-d75543dc91ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:02.264715 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2b4a-71c7-41f4-8945-d75543dc91ae None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:02.264993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2b4a-71c7-41f4-8945-d75543dc91ae None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:02.265264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a2b4a-71c7-41f4-8945-d75543dc91ae None admin] PATH_INFO: `/v3/users/2ac8b3207ae2425b9de63ce457f90dd6` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:02.266397 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a2b4a-71c7-41f4-8945-d75543dc91ae None admin] RBAC: Authorizing `identity:get_user(user_id=2ac8b3207ae2425b9de63ce457f90dd6)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:02.267824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a2b4a-71c7-41f4-8945-d75543dc91ae None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:02.269567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 108/224] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:02 2022] GET /identity/v3/users/2ac8b3207ae2425b9de63ce457f90dd6 => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:02.270156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a2b4a-71c7-41f4-8945-d75543dc91ae None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:02.325951 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:02.347300 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec4e48-861b-417b-b8e5-3a63a5bb9a46 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:02.367564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a2b4a-71c7-41f4-8945-d75543dc91ae None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:02.383805 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09d686-8a2c-4da2-ab0f-d8c1821176c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:02.384466 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09d686-8a2c-4da2-ab0f-d8c1821176c7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:02.384744 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09d686-8a2c-4da2-ab0f-d8c1821176c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:02.385018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09d686-8a2c-4da2-ab0f-d8c1821176c7 None admin] PATH_INFO: `/v3/users/c139a37866be470ea8f9f13fbc4d9290` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:02.398185 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09d686-8a2c-4da2-ab0f-d8c1821176c7 None admin] RBAC: Authorizing `identity:get_user(user_id=c139a37866be470ea8f9f13fbc4d9290)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:02.399614 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09d686-8a2c-4da2-ab0f-d8c1821176c7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:02.401274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 117/225] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:02 2022] GET /identity/v3/users/c139a37866be470ea8f9f13fbc4d9290 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:02.403157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe2818-3d32-458e-a90e-c548401f0331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:02.403760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe2818-3d32-458e-a90e-c548401f0331 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:02.404066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe2818-3d32-458e-a90e-c548401f0331 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:02.404158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09d686-8a2c-4da2-ab0f-d8c1821176c7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:02.404336 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe2818-3d32-458e-a90e-c548401f0331 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:02.404967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe2818-3d32-458e-a90e-c548401f0331 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:02.407342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe2818-3d32-458e-a90e-c548401f0331 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:02.501760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09d686-8a2c-4da2-ab0f-d8c1821176c7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:02.509470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 109/226] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:50:02 2022] POST /identity/v3/users => generated 297 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:50:02.510489 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe2818-3d32-458e-a90e-c548401f0331 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:02.541265 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:02.541902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368cef6-ff4d-4ad0-918b-ce41caaffa10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:02.542566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368cef6-ff4d-4ad0-918b-ce41caaffa10 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:02.542842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368cef6-ff4d-4ad0-918b-ce41caaffa10 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:02.543113 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368cef6-ff4d-4ad0-918b-ce41caaffa10 None admin] PATH_INFO: `/v3/users/2ac8b3207ae2425b9de63ce457f90dd6` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:02.544481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368cef6-ff4d-4ad0-918b-ce41caaffa10 None admin] RBAC: Authorizing `identity:get_user(user_id=2ac8b3207ae2425b9de63ce457f90dd6)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:02.546018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368cef6-ff4d-4ad0-918b-ce41caaffa10 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:02.547959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 118/227] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:02 2022] GET /identity/v3/users/2ac8b3207ae2425b9de63ce457f90dd6 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:02.552853 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368cef6-ff4d-4ad0-918b-ce41caaffa10 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:02.556955 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:02.632098 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe2818-3d32-458e-a90e-c548401f0331 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:02.676048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285f8e8-a047-42e1-be2c-381a712ea759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:02.676695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285f8e8-a047-42e1-be2c-381a712ea759 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:02.676977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285f8e8-a047-42e1-be2c-381a712ea759 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:02.677250 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368cef6-ff4d-4ad0-918b-ce41caaffa10 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:02.677353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8285f8e8-a047-42e1-be2c-381a712ea759 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:02.678408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285f8e8-a047-42e1-be2c-381a712ea759 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:02.679888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8285f8e8-a047-42e1-be2c-381a712ea759 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:02.681538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 110/228] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:02 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:02.682315 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285f8e8-a047-42e1-be2c-381a712ea759 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:02.716292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928f367-00fa-4ae2-be47-9671f896d558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:02.716915 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928f367-00fa-4ae2-be47-9671f896d558 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:02.717472 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928f367-00fa-4ae2-be47-9671f896d558 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:02.717472 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928f367-00fa-4ae2-be47-9671f896d558 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:02.801574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:02.807465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928f367-00fa-4ae2-be47-9671f896d558 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:02.808980 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9928f367-00fa-4ae2-be47-9671f896d558 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:02.811472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8285f8e8-a047-42e1-be2c-381a712ea759 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:02.812681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:02.854679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faf380-9050-4d9d-b499-b831fdd2d656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:02.855778 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faf380-9050-4d9d-b499-b831fdd2d656 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:02.856357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faf380-9050-4d9d-b499-b831fdd2d656 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:02.856870 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23faf380-9050-4d9d-b499-b831fdd2d656 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:02.858898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23faf380-9050-4d9d-b499-b831fdd2d656 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:02.860582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23faf380-9050-4d9d-b499-b831fdd2d656 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:02.862441 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 111/229] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:02 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:02.863032 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faf380-9050-4d9d-b499-b831fdd2d656 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:02.933129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 119/230] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:02.933794 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928f367-00fa-4ae2-be47-9671f896d558 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:02.997819 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23faf380-9050-4d9d-b499-b831fdd2d656 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:03.043640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2153d72-f34e-4f47-b1bf-dc8303e7925f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:03.044420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2153d72-f34e-4f47-b1bf-dc8303e7925f None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:03.044774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2153d72-f34e-4f47-b1bf-dc8303e7925f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:03.045365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2153d72-f34e-4f47-b1bf-dc8303e7925f None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e/users/2ac8b3207ae2425b9de63ce457f90dd6/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:03.047605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2153d72-f34e-4f47-b1bf-dc8303e7925f None admin] RBAC: Authorizing `identity:create_grant(project_id=ba004675284d4e2fb1037370cf5a047e, user_id=2ac8b3207ae2425b9de63ce457f90dd6, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:03.049169 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2153d72-f34e-4f47-b1bf-dc8303e7925f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:03.056073 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9928f367-00fa-4ae2-be47-9671f896d558 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:03.059234 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:03.091989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb002a-a09f-4615-8dd9-5cd49da4d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:03.092705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb002a-a09f-4615-8dd9-5cd49da4d4fe None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:03.092967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb002a-a09f-4615-8dd9-5cd49da4d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:03.093274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb002a-a09f-4615-8dd9-5cd49da4d4fe None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e/users/2ac8b3207ae2425b9de63ce457f90dd6/roles/d78c47b14910477fa17f456efbbc177c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:03.095574 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb002a-a09f-4615-8dd9-5cd49da4d4fe None admin] RBAC: Authorizing `identity:create_grant(project_id=ba004675284d4e2fb1037370cf5a047e, user_id=2ac8b3207ae2425b9de63ce457f90dd6, role_id=d78c47b14910477fa17f456efbbc177c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:03.097066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cb002a-a09f-4615-8dd9-5cd49da4d4fe None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:03.129053 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 112/231] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:50:02 2022] PUT /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e/users/2ac8b3207ae2425b9de63ce457f90dd6/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:03.129674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2153d72-f34e-4f47-b1bf-dc8303e7925f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:03.189093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:03.235095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 120/232] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:50:02 2022] PUT /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e/users/2ac8b3207ae2425b9de63ce457f90dd6/roles/d78c47b14910477fa17f456efbbc177c => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:03.276824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2153d72-f34e-4f47-b1bf-dc8303e7925f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:03.318897 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8b028-4ffb-4063-a227-2cf0d7b3c222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:03.319653 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8b028-4ffb-4063-a227-2cf0d7b3c222 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:03.320063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8b028-4ffb-4063-a227-2cf0d7b3c222 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:03.320444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8b028-4ffb-4063-a227-2cf0d7b3c222 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:03.321845 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8b028-4ffb-4063-a227-2cf0d7b3c222 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:03.324061 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8b028-4ffb-4063-a227-2cf0d7b3c222 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:03.326016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 113/233] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:03 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:03.333020 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb002a-a09f-4615-8dd9-5cd49da4d4fe None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:03.477904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb002a-a09f-4615-8dd9-5cd49da4d4fe None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:03.516278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca906c-bf1e-427f-877a-d40cf4ac58b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:03.516899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca906c-bf1e-427f-877a-d40cf4ac58b0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:03.517184 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca906c-bf1e-427f-877a-d40cf4ac58b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:03.517462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca906c-bf1e-427f-877a-d40cf4ac58b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:03.518192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca906c-bf1e-427f-877a-d40cf4ac58b0 None admin] RBAC: Adding query filter params (role.id=75d9054a423c4c66b163c72c8ae7989c, scope.project.id=ba004675284d4e2fb1037370cf5a047e, user.id=c139a37866be470ea8f9f13fbc4d9290) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:03.518504 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca906c-bf1e-427f-877a-d40cf4ac58b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:03.519966 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca906c-bf1e-427f-877a-d40cf4ac58b0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:03.525864 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 121/234] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:03 2022] GET /identity/v3/role_assignments?user.id=c139a37866be470ea8f9f13fbc4d9290&scope.project.id=ba004675284d4e2fb1037370cf5a047e&role.id=75d9054a423c4c66b163c72c8ae7989c => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:04.806500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03dcf-a205-4683-a53b-1e34a0d8e60f None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:04.807035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03dcf-a205-4683-a53b-1e34a0d8e60f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:04.807035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a03dcf-a205-4683-a53b-1e34a0d8e60f None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:04.808706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 114/235] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:04.814248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a589a-4d50-47a7-9234-36eae561f8da None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:04.814654 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a589a-4d50-47a7-9234-36eae561f8da None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:04.814841 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a589a-4d50-47a7-9234-36eae561f8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:04.836609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0e5a589a-4d50-47a7-9234-36eae561f8da None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:04.837814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0e5a589a-4d50-47a7-9234-36eae561f8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:04.843110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c5021-e874-4378-ac83-5bea1aff9bc0 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:04.843391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c5021-e874-4378-ac83-5bea1aff9bc0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:04.843663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c5021-e874-4378-ac83-5bea1aff9bc0 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:04.845049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 115/236] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:04.850268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1f373-0e06-46ee-8957-7094559cd90b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:04.850555 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1f373-0e06-46ee-8957-7094559cd90b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:04.850834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f1f373-0e06-46ee-8957-7094559cd90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:04.878403 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:04.885243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e3f1f373-0e06-46ee-8957-7094559cd90b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:04.886469 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e3f1f373-0e06-46ee-8957-7094559cd90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:04.961583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 122/237] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:05.002682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 116/238] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:50:05.285326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a589a-4d50-47a7-9234-36eae561f8da None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:05.322631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1f373-0e06-46ee-8957-7094559cd90b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:05.350227 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:05.393949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a589a-4d50-47a7-9234-36eae561f8da None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:05.429022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e08ca0-f530-4af6-82ff-dd9fece031f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:05.429906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e08ca0-f530-4af6-82ff-dd9fece031f2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:05.430337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e08ca0-f530-4af6-82ff-dd9fece031f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:05.430798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e08ca0-f530-4af6-82ff-dd9fece031f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:05.432187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e08ca0-f530-4af6-82ff-dd9fece031f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:05.433853 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e08ca0-f530-4af6-82ff-dd9fece031f2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:05.440025 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 123/239] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:05.442158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e08ca0-f530-4af6-82ff-dd9fece031f2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:05.457774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f1f373-0e06-46ee-8957-7094559cd90b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:05.472319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:05.512571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e0df1-abe7-4594-8a4d-438ce2dbc603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:05.513264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e0df1-abe7-4594-8a4d-438ce2dbc603 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:05.513545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e0df1-abe7-4594-8a4d-438ce2dbc603 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:05.513827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13e0df1-abe7-4594-8a4d-438ce2dbc603 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:05.533271 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13e0df1-abe7-4594-8a4d-438ce2dbc603 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-d13e0df1-abe7-4594-8a4d-438ce2dbc603 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:05.547293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:05.548454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:05.549484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:05.549484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:05.549484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:05.549484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:05.549484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:05.549484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:05.549484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:05.549484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:05.549484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:05.549484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:05.549484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:50:05.549484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:05.551605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e08ca0-f530-4af6-82ff-dd9fece031f2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:05.551816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 117/240] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:05.560870 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e0df1-abe7-4594-8a4d-438ce2dbc603 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:05.589586 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54533e0e-af91-4301-8181-446faf5187dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:05.590835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54533e0e-af91-4301-8181-446faf5187dd None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:05.591317 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54533e0e-af91-4301-8181-446faf5187dd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:05.591788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54533e0e-af91-4301-8181-446faf5187dd None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:05.592821 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54533e0e-af91-4301-8181-446faf5187dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:05.594661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54533e0e-af91-4301-8181-446faf5187dd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:05.672242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:05.694356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 124/241] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:50:05 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:50:05.710349 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4afab7-7f39-43c4-b486-8e3178dda91b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:05.711032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4afab7-7f39-43c4-b486-8e3178dda91b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:05.711639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4afab7-7f39-43c4-b486-8e3178dda91b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:05.713487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 125/242] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:50:05.717041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13e0df1-abe7-4594-8a4d-438ce2dbc603 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:05.719996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdcdf2-dad8-4418-aee2-21183263c6ec None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:05.720522 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdcdf2-dad8-4418-aee2-21183263c6ec None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:05.720960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fdcdf2-dad8-4418-aee2-21183263c6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:05.751073 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-80fdcdf2-dad8-4418-aee2-21183263c6ec None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:05.752322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-80fdcdf2-dad8-4418-aee2-21183263c6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:05.776418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f8df3d-de16-469e-befe-2167338b1fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:05.777419 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8df3d-de16-469e-befe-2167338b1fbc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:05.777988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8df3d-de16-469e-befe-2167338b1fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:05.778464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f8df3d-de16-469e-befe-2167338b1fbc None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:05.779358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8df3d-de16-469e-befe-2167338b1fbc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:05.780013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8df3d-de16-469e-befe-2167338b1fbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:05.781681 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f8df3d-de16-469e-befe-2167338b1fbc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:05.792255 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 118/243] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:05.793994 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe126f0-f653-4e8e-84e0-23dd14299b57 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:05.794483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe126f0-f653-4e8e-84e0-23dd14299b57 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:05.795019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe126f0-f653-4e8e-84e0-23dd14299b57 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:05.797747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 119/244] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:05.798853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe126f0-f653-4e8e-84e0-23dd14299b57 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:05.835616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 126/245] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:50:05.837773 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c51e8a-6f9b-4a69-841a-ecfdfafe95b5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:05.838364 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c51e8a-6f9b-4a69-841a-ecfdfafe95b5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:05.839023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c51e8a-6f9b-4a69-841a-ecfdfafe95b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:05.875194 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-58c51e8a-6f9b-4a69-841a-ecfdfafe95b5 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:05.876953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-58c51e8a-6f9b-4a69-841a-ecfdfafe95b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:05.887050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:05.953966 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe126f0-f653-4e8e-84e0-23dd14299b57 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:05.974524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 127/246] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:06.003012 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056352c7-c563-45ac-8784-1fd698542667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:06.004023 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056352c7-c563-45ac-8784-1fd698542667 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:06.004498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056352c7-c563-45ac-8784-1fd698542667 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:06.004949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056352c7-c563-45ac-8784-1fd698542667 None admin] PATH_INFO: `/v3/users/5221446a36ef4240bce53a9b02435110` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:06.019341 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:06.020881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056352c7-c563-45ac-8784-1fd698542667 None admin] RBAC: Authorizing `identity:get_user(user_id=5221446a36ef4240bce53a9b02435110)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:06.022301 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056352c7-c563-45ac-8784-1fd698542667 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:06.024254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 120/247] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:05 2022] GET /identity/v3/users/5221446a36ef4240bce53a9b02435110 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:06.030647 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c51e8a-6f9b-4a69-841a-ecfdfafe95b5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:06.145970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056352c7-c563-45ac-8784-1fd698542667 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:06.163894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c51e8a-6f9b-4a69-841a-ecfdfafe95b5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:06.205183 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e6164-33e9-4188-90ec-53ce36dee2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:06.206180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e6164-33e9-4188-90ec-53ce36dee2d4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:06.206653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e6164-33e9-4188-90ec-53ce36dee2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:06.207117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e6164-33e9-4188-90ec-53ce36dee2d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:06.221542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:06.275166 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056352c7-c563-45ac-8784-1fd698542667 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:06.297624 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e6164-33e9-4188-90ec-53ce36dee2d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:06.299117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4e6164-33e9-4188-90ec-53ce36dee2d4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:06.317746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d25517-ccbb-4db3-aa91-6359f91a9470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:06.318776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d25517-ccbb-4db3-aa91-6359f91a9470 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:06.319055 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d25517-ccbb-4db3-aa91-6359f91a9470 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:06.319327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d25517-ccbb-4db3-aa91-6359f91a9470 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:06.334575 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d25517-ccbb-4db3-aa91-6359f91a9470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-08d25517-ccbb-4db3-aa91-6359f91a9470 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:06.341099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:06.342080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:06.343988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:06.343988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:06.343988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:06.343988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:06.343988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:06.343988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:06.343988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:06.343988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:06.343988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:06.343988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:06.343988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:50:06.343988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:06.343988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 121/248] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:50:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:06.347766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f533-5d4c-4d6e-96ad-363d348dc026 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:06.347766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f533-5d4c-4d6e-96ad-363d348dc026 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:06.347766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6f533-5d4c-4d6e-96ad-363d348dc026 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:06.352050 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 122/249] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:06.353402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6f533-5d4c-4d6e-96ad-363d348dc026 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:06.428703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 128/250] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:06.429737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e6164-33e9-4188-90ec-53ce36dee2d4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:06.435274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:06.486314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:06.488201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6f533-5d4c-4d6e-96ad-363d348dc026 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:06.535046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadbb512-6d5d-45b8-95c2-513603075e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:06.535956 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbb512-6d5d-45b8-95c2-513603075e5f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:06.536239 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbb512-6d5d-45b8-95c2-513603075e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:06.536529 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadbb512-6d5d-45b8-95c2-513603075e5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:06.545723 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e6164-33e9-4188-90ec-53ce36dee2d4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:06.550960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadbb512-6d5d-45b8-95c2-513603075e5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-cadbb512-6d5d-45b8-95c2-513603075e5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:06.557202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:06.559010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:06.560523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:06.560523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:06.560523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:06.560523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:06.560523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:06.560523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:06.560523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:06.560523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:06.560523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:06.560523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:06.560523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:06.560523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:06.560523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 123/251] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:50:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:06.560523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e68b7-017e-481a-86bc-797db846badc None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:06.561792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e68b7-017e-481a-86bc-797db846badc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:06.561792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e68b7-017e-481a-86bc-797db846badc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:06.584443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6f5e68b7-017e-481a-86bc-797db846badc None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:06.586059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6f5e68b7-017e-481a-86bc-797db846badc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:06.589115 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744dc13-1e80-4413-a17f-ec1c56e38b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:06.589816 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744dc13-1e80-4413-a17f-ec1c56e38b0c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:06.590145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744dc13-1e80-4413-a17f-ec1c56e38b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:06.590422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6744dc13-1e80-4413-a17f-ec1c56e38b0c None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:06.591456 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744dc13-1e80-4413-a17f-ec1c56e38b0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:06.591765 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744dc13-1e80-4413-a17f-ec1c56e38b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:06.593742 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6744dc13-1e80-4413-a17f-ec1c56e38b0c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:06.604927 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 129/252] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:06.605848 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744dc13-1e80-4413-a17f-ec1c56e38b0c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:06.670545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 124/253] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:06.671471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e68b7-017e-481a-86bc-797db846badc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:06.754323 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:06.776312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6744dc13-1e80-4413-a17f-ec1c56e38b0c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:06.783610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:06.845250 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fd1b3-6326-418e-a541-32ceb40fc8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:06.846024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fd1b3-6326-418e-a541-32ceb40fc8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:06.846200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fd1b3-6326-418e-a541-32ceb40fc8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:06.846466 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793fd1b3-6326-418e-a541-32ceb40fc8e1 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:06.847901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fd1b3-6326-418e-a541-32ceb40fc8e1 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:06.849336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793fd1b3-6326-418e-a541-32ceb40fc8e1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:06.850961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 130/254] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:06 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:06.851712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fd1b3-6326-418e-a541-32ceb40fc8e1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:06.860939 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e68b7-017e-481a-86bc-797db846badc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:06.912781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7f61-61fe-45da-ab57-7b67552500c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:06.913385 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7f61-61fe-45da-ab57-7b67552500c5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:06.913666 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7f61-61fe-45da-ab57-7b67552500c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:06.913941 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e7f61-61fe-45da-ab57-7b67552500c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:06.914614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e7f61-61fe-45da-ab57-7b67552500c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:06.914915 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e7f61-61fe-45da-ab57-7b67552500c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:06.919867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e7f61-61fe-45da-ab57-7b67552500c5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:06.925125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 125/255] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:06.925947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7f61-61fe-45da-ab57-7b67552500c5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:07.036623 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e7f61-61fe-45da-ab57-7b67552500c5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:07.048540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:07.050862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793fd1b3-6326-418e-a541-32ceb40fc8e1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:07.073516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6f5ce-49b6-4663-aaeb-5ccc8c18c1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:07.074196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6f5ce-49b6-4663-aaeb-5ccc8c18c1ff None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:07.075093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6f5ce-49b6-4663-aaeb-5ccc8c18c1ff None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:07.075093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e6f5ce-49b6-4663-aaeb-5ccc8c18c1ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:07.075527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6f5ce-49b6-4663-aaeb-5ccc8c18c1ff None admin] RBAC: Adding query filter params (role.id=569b7f0b7a5c4fe5b974abf4cfccfcb2, scope.project.id=ba004675284d4e2fb1037370cf5a047e, user.id=5221446a36ef4240bce53a9b02435110) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:07.076052 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6f5ce-49b6-4663-aaeb-5ccc8c18c1ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:07.077973 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e6f5ce-49b6-4663-aaeb-5ccc8c18c1ff None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:07.083860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 126/256] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:06 2022] GET /identity/v3/role_assignments?user.id=5221446a36ef4240bce53a9b02435110&scope.project.id=ba004675284d4e2fb1037370cf5a047e&role.id=569b7f0b7a5c4fe5b974abf4cfccfcb2 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:07.084692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6f5ce-49b6-4663-aaeb-5ccc8c18c1ff None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:07.097583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a86a5-f4f5-44d8-aea1-acc0b5dbcafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:07.098253 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a86a5-f4f5-44d8-aea1-acc0b5dbcafa None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:07.098539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a86a5-f4f5-44d8-aea1-acc0b5dbcafa None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:07.098816 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a86a5-f4f5-44d8-aea1-acc0b5dbcafa None admin] PATH_INFO: `/v3/users/2ac8b3207ae2425b9de63ce457f90dd6` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:07.100609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a86a5-f4f5-44d8-aea1-acc0b5dbcafa None admin] RBAC: Authorizing `identity:get_user(user_id=2ac8b3207ae2425b9de63ce457f90dd6)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:07.103173 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a86a5-f4f5-44d8-aea1-acc0b5dbcafa None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:07.106365 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 131/257] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:06 2022] GET /identity/v3/users/2ac8b3207ae2425b9de63ce457f90dd6 => generated 283 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:07.108578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a86a5-f4f5-44d8-aea1-acc0b5dbcafa None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:07.163518 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:07.236214 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a86a5-f4f5-44d8-aea1-acc0b5dbcafa None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:07.276567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a08ab-14c6-44a9-90fd-d66372f52236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:07.277676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a08ab-14c6-44a9-90fd-d66372f52236 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:07.278154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a08ab-14c6-44a9-90fd-d66372f52236 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:07.278650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a08ab-14c6-44a9-90fd-d66372f52236 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:07.291771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a08ab-14c6-44a9-90fd-d66372f52236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7a1a08ab-14c6-44a9-90fd-d66372f52236 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:07.298205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:07.299176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:07.300011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:07.300011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:07.300011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:07.300011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:07.300011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:07.300011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:07.300011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:07.300011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:07.300011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:07.300011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:07.300011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:07.300011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:07.300626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e6f5ce-49b6-4663-aaeb-5ccc8c18c1ff None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:07.302958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 132/258] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:07.305497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a08ab-14c6-44a9-90fd-d66372f52236 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:07.365182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac0c56-3609-4ecc-bfb1-e3a91a13cb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:07.365960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac0c56-3609-4ecc-bfb1-e3a91a13cb4b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:07.366244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac0c56-3609-4ecc-bfb1-e3a91a13cb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:07.366579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac0c56-3609-4ecc-bfb1-e3a91a13cb4b None admin] PATH_INFO: `/v3/users/2ac8b3207ae2425b9de63ce457f90dd6` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:07.367755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac0c56-3609-4ecc-bfb1-e3a91a13cb4b None admin] RBAC: Authorizing `identity:get_user(user_id=2ac8b3207ae2425b9de63ce457f90dd6)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:07.369424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac0c56-3609-4ecc-bfb1-e3a91a13cb4b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:07.371124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 127/259] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:07 2022] GET /identity/v3/users/2ac8b3207ae2425b9de63ce457f90dd6 => generated 283 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:07.371967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac0c56-3609-4ecc-bfb1-e3a91a13cb4b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:07.428345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:07.432523 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a08ab-14c6-44a9-90fd-d66372f52236 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:07.436111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:07.471331 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b9739-9325-450c-bd0e-f061291664ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:07.472308 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b9739-9325-450c-bd0e-f061291664ee None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:07.473162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b9739-9325-450c-bd0e-f061291664ee None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:07.473643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69b9739-9325-450c-bd0e-f061291664ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:07.548350 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b9739-9325-450c-bd0e-f061291664ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:07.550555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69b9739-9325-450c-bd0e-f061291664ee None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:07.569802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac0c56-3609-4ecc-bfb1-e3a91a13cb4b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:07.654012 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:07.659448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 133/260] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:07.660628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b9739-9325-450c-bd0e-f061291664ee None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:07.677644 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93581d44-42a1-423d-afdd-5b71cd410171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:07.678293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581d44-42a1-423d-afdd-5b71cd410171 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:07.678581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581d44-42a1-423d-afdd-5b71cd410171 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:07.678856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93581d44-42a1-423d-afdd-5b71cd410171 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:07.679538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93581d44-42a1-423d-afdd-5b71cd410171 None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:07.679860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93581d44-42a1-423d-afdd-5b71cd410171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:07.681307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93581d44-42a1-423d-afdd-5b71cd410171 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:07.702836 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 128/261] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:07.704146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93581d44-42a1-423d-afdd-5b71cd410171 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:07.802581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69b9739-9325-450c-bd0e-f061291664ee None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:07.871250 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e4d69-425f-4523-9242-6c28e9cd58d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:07.872700 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e4d69-425f-4523-9242-6c28e9cd58d3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:07.873212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e4d69-425f-4523-9242-6c28e9cd58d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:07.873703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e4d69-425f-4523-9242-6c28e9cd58d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:07.914541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93581d44-42a1-423d-afdd-5b71cd410171 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:07.924198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:07.945717 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:07.948505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e4d69-425f-4523-9242-6c28e9cd58d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:07.950137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e4d69-425f-4523-9242-6c28e9cd58d3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:07.979788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d6dd-b651-4dfa-aa65-d35b81c8c503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:07.984195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d6dd-b651-4dfa-aa65-d35b81c8c503 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:07.984195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d6dd-b651-4dfa-aa65-d35b81c8c503 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:07.984195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58d6dd-b651-4dfa-aa65-d35b81c8c503 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:07.984597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58d6dd-b651-4dfa-aa65-d35b81c8c503 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:07.986031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58d6dd-b651-4dfa-aa65-d35b81c8c503 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:07.987692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 129/262] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:07 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:07.988535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d6dd-b651-4dfa-aa65-d35b81c8c503 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:08.059144 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 134/263] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:08.060339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e4d69-425f-4523-9242-6c28e9cd58d3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:08.164439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:08.168356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e4d69-425f-4523-9242-6c28e9cd58d3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:08.205258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fd392-983d-4c18-9233-c35048ce3c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:08.206396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fd392-983d-4c18-9233-c35048ce3c97 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:08.206902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fd392-983d-4c18-9233-c35048ce3c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:08.207390 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992fd392-983d-4c18-9233-c35048ce3c97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:08.208395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fd392-983d-4c18-9233-c35048ce3c97 None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=ba004675284d4e2fb1037370cf5a047e, user.id=2ac8b3207ae2425b9de63ce457f90dd6) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:08.208907 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fd392-983d-4c18-9233-c35048ce3c97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:08.210152 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58d6dd-b651-4dfa-aa65-d35b81c8c503 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:08.211169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992fd392-983d-4c18-9233-c35048ce3c97 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:08.219065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 135/264] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:08 2022] GET /identity/v3/role_assignments?user.id=2ac8b3207ae2425b9de63ce457f90dd6&scope.project.id=ba004675284d4e2fb1037370cf5a047e&role.id=68b1888f7bb644a39938b8d41006a813 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:08.220315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fd392-983d-4c18-9233-c35048ce3c97 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:08.302419 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96489f1-cc90-480e-8a87-e0547ac815f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:08.303100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96489f1-cc90-480e-8a87-e0547ac815f2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:08.303375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96489f1-cc90-480e-8a87-e0547ac815f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:08.303770 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96489f1-cc90-480e-8a87-e0547ac815f2 None admin] PATH_INFO: `/v3/users/c139a37866be470ea8f9f13fbc4d9290` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:08.304960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96489f1-cc90-480e-8a87-e0547ac815f2 None admin] RBAC: Authorizing `identity:get_user(user_id=c139a37866be470ea8f9f13fbc4d9290)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:08.306621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96489f1-cc90-480e-8a87-e0547ac815f2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:08.308448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 130/265] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:07 2022] GET /identity/v3/users/c139a37866be470ea8f9f13fbc4d9290 => generated 297 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:08.314139 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96489f1-cc90-480e-8a87-e0547ac815f2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:08.333723 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992fd392-983d-4c18-9233-c35048ce3c97 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:08.372191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad675723-22e7-477a-82e9-5ab743b576c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:08.373220 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad675723-22e7-477a-82e9-5ab743b576c4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:08.373689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad675723-22e7-477a-82e9-5ab743b576c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:08.379583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad675723-22e7-477a-82e9-5ab743b576c4 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:08.379583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad675723-22e7-477a-82e9-5ab743b576c4 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:08.380031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad675723-22e7-477a-82e9-5ab743b576c4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:08.382019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 136/266] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:08 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:08.383206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf97588-6db5-4c64-a5c2-5889df742f8b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:08.383487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf97588-6db5-4c64-a5c2-5889df742f8b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:08.383756 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf97588-6db5-4c64-a5c2-5889df742f8b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:08.385022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 137/267] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:08.389488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c1d54-3b53-4969-90ae-1f43af7ff427 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:08.389488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c1d54-3b53-4969-90ae-1f43af7ff427 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:08.389488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c1d54-3b53-4969-90ae-1f43af7ff427 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:08.392991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 138/268] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:50:08.393505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c1d54-3b53-4969-90ae-1f43af7ff427 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:08.411665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:08.441285 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:08.506336 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96489f1-cc90-480e-8a87-e0547ac815f2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:08.531970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c1d54-3b53-4969-90ae-1f43af7ff427 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:08.554152 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9474af7-afb4-4280-855a-d2ee907fecaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:08.554942 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474af7-afb4-4280-855a-d2ee907fecaf None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:08.555228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474af7-afb4-4280-855a-d2ee907fecaf None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:08.555505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9474af7-afb4-4280-855a-d2ee907fecaf None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:08.557187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9474af7-afb4-4280-855a-d2ee907fecaf None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:08.558624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9474af7-afb4-4280-855a-d2ee907fecaf None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:08.560515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 131/269] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:08 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:08.561514 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e7cea-9bd7-4677-9f4b-09f85e7b2139 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:08.561795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e7cea-9bd7-4677-9f4b-09f85e7b2139 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:08.562072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e7cea-9bd7-4677-9f4b-09f85e7b2139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:08.572704 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbfe4a8-8356-4641-9da2-b55ce0016ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:08.573693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe4a8-8356-4641-9da2-b55ce0016ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:08.573974 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe4a8-8356-4641-9da2-b55ce0016ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:08.574244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbfe4a8-8356-4641-9da2-b55ce0016ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:08.574963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfe4a8-8356-4641-9da2-b55ce0016ab3 None admin] RBAC: Adding query filter params (role.id=d78c47b14910477fa17f456efbbc177c, scope.project.id=ba004675284d4e2fb1037370cf5a047e, user.id=2ac8b3207ae2425b9de63ce457f90dd6) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:08.575270 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfe4a8-8356-4641-9da2-b55ce0016ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:08.577536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbfe4a8-8356-4641-9da2-b55ce0016ab3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:08.582190 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-131e7cea-9bd7-4677-9f4b-09f85e7b2139 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:08.583387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-131e7cea-9bd7-4677-9f4b-09f85e7b2139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:08.583782 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 139/270] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:08 2022] GET /identity/v3/role_assignments?user.id=2ac8b3207ae2425b9de63ce457f90dd6&scope.project.id=ba004675284d4e2fb1037370cf5a047e&role.id=d78c47b14910477fa17f456efbbc177c => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:08.585022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9391047-3ea1-46b9-a5a3-9e07099980a0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:08.585424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9391047-3ea1-46b9-a5a3-9e07099980a0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:08.585598 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9391047-3ea1-46b9-a5a3-9e07099980a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:08.611720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f9391047-3ea1-46b9-a5a3-9e07099980a0 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:08.613439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f9391047-3ea1-46b9-a5a3-9e07099980a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:08.668891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 132/271] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:08.670098 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e7cea-9bd7-4677-9f4b-09f85e7b2139 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:08.736536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 140/272] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:08.742510 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:08.807684 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e7cea-9bd7-4677-9f4b-09f85e7b2139 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:08.843724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e263902-d5fd-43e2-ad99-952aa764546d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:08.844380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e263902-d5fd-43e2-ad99-952aa764546d None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:08.844660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e263902-d5fd-43e2-ad99-952aa764546d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:08.844932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e263902-d5fd-43e2-ad99-952aa764546d None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e/users/c139a37866be470ea8f9f13fbc4d9290/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:08.846937 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e263902-d5fd-43e2-ad99-952aa764546d None admin] RBAC: Authorizing `identity:create_grant(project_id=ba004675284d4e2fb1037370cf5a047e, user_id=c139a37866be470ea8f9f13fbc4d9290, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:08.848406 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e263902-d5fd-43e2-ad99-952aa764546d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:08.933257 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 133/273] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:50:08 2022] PUT /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e/users/c139a37866be470ea8f9f13fbc4d9290/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:08.973022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9391047-3ea1-46b9-a5a3-9e07099980a0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:09.004734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:09.049731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e263902-d5fd-43e2-ad99-952aa764546d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:09.097482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9391047-3ea1-46b9-a5a3-9e07099980a0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:09.146518 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f7810-0566-4065-b487-240dc80a0ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:09.147165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f7810-0566-4065-b487-240dc80a0ed1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:09.147443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f7810-0566-4065-b487-240dc80a0ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:09.147714 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f7810-0566-4065-b487-240dc80a0ed1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:09.163535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f7810-0566-4065-b487-240dc80a0ed1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b55f7810-0566-4065-b487-240dc80a0ed1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:09.168376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:09.169275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:09.170055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:09.170055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:09.170055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:09.170055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:09.170055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:09.170055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:09.170055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:09.170055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:09.170055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:09.170055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:09.170055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:09.170055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:09.170767 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 141/274] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:09.174799 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:09.178569 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e263902-d5fd-43e2-ad99-952aa764546d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:09.179038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f7810-0566-4065-b487-240dc80a0ed1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:09.228826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f79389-3590-4665-bcaf-3e987a3e2025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:09.230567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f79389-3590-4665-bcaf-3e987a3e2025 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:09.230995 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f79389-3590-4665-bcaf-3e987a3e2025 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:09.231434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f79389-3590-4665-bcaf-3e987a3e2025 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:09.234810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f79389-3590-4665-bcaf-3e987a3e2025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:09.237196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f79389-3590-4665-bcaf-3e987a3e2025 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:09.240171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 134/275] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:09.245726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f79389-3590-4665-bcaf-3e987a3e2025 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:09.283227 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:09.299594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f7810-0566-4065-b487-240dc80a0ed1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:09.337346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af28ead-50d3-4541-940b-492e2f8cb633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:09.338329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28ead-50d3-4541-940b-492e2f8cb633 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:09.338906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28ead-50d3-4541-940b-492e2f8cb633 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:09.339497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af28ead-50d3-4541-940b-492e2f8cb633 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:09.340777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af28ead-50d3-4541-940b-492e2f8cb633 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:09.341524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af28ead-50d3-4541-940b-492e2f8cb633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:09.342768 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af28ead-50d3-4541-940b-492e2f8cb633 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:09.354128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f79389-3590-4665-bcaf-3e987a3e2025 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:09.356821 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 142/276] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:09.358459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af28ead-50d3-4541-940b-492e2f8cb633 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:09.397966 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f91cb6c-a9b8-4b07-ae58-feda02963ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:09.398580 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91cb6c-a9b8-4b07-ae58-feda02963ab3 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:09.398853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91cb6c-a9b8-4b07-ae58-feda02963ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:09.399117 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f91cb6c-a9b8-4b07-ae58-feda02963ab3 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:09.399764 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91cb6c-a9b8-4b07-ae58-feda02963ab3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:09.401210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f91cb6c-a9b8-4b07-ae58-feda02963ab3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:09.465700 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af28ead-50d3-4541-940b-492e2f8cb633 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:09.499972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 135/277] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:50:09 2022] POST /identity/v3/users => generated 293 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:50:09.504092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f61989-abad-4ca9-83aa-353f0b04d429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:09.504092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f61989-abad-4ca9-83aa-353f0b04d429 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:09.504092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f61989-abad-4ca9-83aa-353f0b04d429 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:09.504092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f61989-abad-4ca9-83aa-353f0b04d429 None admin] PATH_INFO: `/v3/users/ea73b57b23324f0fa65f1c08da5c4cf3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:09.506048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d90fae-46aa-41f3-85ab-8c2db6ba9041 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:09.506342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d90fae-46aa-41f3-85ab-8c2db6ba9041 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:09.506741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d90fae-46aa-41f3-85ab-8c2db6ba9041 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:09.508323 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 136/278] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:09.514307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dde49-8674-45a7-a485-da91318c5ade None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:09.515045 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dde49-8674-45a7-a485-da91318c5ade None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:09.515587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173dde49-8674-45a7-a485-da91318c5ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:09.527384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f61989-abad-4ca9-83aa-353f0b04d429 None admin] RBAC: Authorizing `identity:get_user(user_id=ea73b57b23324f0fa65f1c08da5c4cf3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:09.529071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f61989-abad-4ca9-83aa-353f0b04d429 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:09.536001 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 143/279] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:09 2022] GET /identity/v3/users/ea73b57b23324f0fa65f1c08da5c4cf3 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:09.539269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f61989-abad-4ca9-83aa-353f0b04d429 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:09.543797 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-173dde49-8674-45a7-a485-da91318c5ade None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:09.545041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-173dde49-8674-45a7-a485-da91318c5ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:09.558461 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:09.565953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:09.652417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 137/280] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:50:09.682236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f61989-abad-4ca9-83aa-353f0b04d429 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:09.723013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c42a-bb91-4902-abac-8b8e5c72fb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:09.723620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c42a-bb91-4902-abac-8b8e5c72fb91 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:09.724954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c42a-bb91-4902-abac-8b8e5c72fb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:09.724954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2c42a-bb91-4902-abac-8b8e5c72fb91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:09.724954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2c42a-bb91-4902-abac-8b8e5c72fb91 None admin] RBAC: Adding query filter params (role.id=75d9054a423c4c66b163c72c8ae7989c, user.id=ea73b57b23324f0fa65f1c08da5c4cf3, scope.system=all) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:09.725316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2c42a-bb91-4902-abac-8b8e5c72fb91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:09.726654 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2c42a-bb91-4902-abac-8b8e5c72fb91 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:09.731920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 144/281] 10.222.0.62 () {56 vars in 1308 bytes} [Wed Aug 24 07:50:09 2022] GET /identity/v3/role_assignments?user.id=ea73b57b23324f0fa65f1c08da5c4cf3&scope.system=all&role.id=75d9054a423c4c66b163c72c8ae7989c => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:09.923662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dde49-8674-45a7-a485-da91318c5ade None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:10.042039 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173dde49-8674-45a7-a485-da91318c5ade None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:10.083337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c74481-8fd2-4f00-80bd-dd816b01c79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:10.084358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c74481-8fd2-4f00-80bd-dd816b01c79d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:10.084856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c74481-8fd2-4f00-80bd-dd816b01c79d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:10.085326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c74481-8fd2-4f00-80bd-dd816b01c79d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:10.098322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c74481-8fd2-4f00-80bd-dd816b01c79d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-11c74481-8fd2-4f00-80bd-dd816b01c79d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:10.103888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:10.104873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:10.105692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:10.105692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:10.105692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:10.105692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:10.105692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:10.105692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:10.105692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:10.105692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:10.105692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:10.105692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:10.105692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:50:10.105692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:10.108694 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 138/282] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:10.115370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c42a-bb91-4902-abac-8b8e5c72fb91 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:10.222551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:10.263084 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2c42a-bb91-4902-abac-8b8e5c72fb91 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:10.307781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3581b-a1f6-491f-8d1c-3c89e05cc565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:10.308844 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3581b-a1f6-491f-8d1c-3c89e05cc565 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:10.309341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3581b-a1f6-491f-8d1c-3c89e05cc565 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:10.309808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3581b-a1f6-491f-8d1c-3c89e05cc565 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:10.310720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3581b-a1f6-491f-8d1c-3c89e05cc565 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:10.311264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3581b-a1f6-491f-8d1c-3c89e05cc565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:10.312960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3581b-a1f6-491f-8d1c-3c89e05cc565 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:10.326139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 145/283] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:10.332342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c74481-8fd2-4f00-80bd-dd816b01c79d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:10.355655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:10.463101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c74481-8fd2-4f00-80bd-dd816b01c79d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:10.499196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c633ba2-f21d-41a1-8547-d6d522833447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:10.499753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c633ba2-f21d-41a1-8547-d6d522833447 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:10.500052 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c633ba2-f21d-41a1-8547-d6d522833447 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:10.500325 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c633ba2-f21d-41a1-8547-d6d522833447 None admin] PATH_INFO: `/v3/users/5221446a36ef4240bce53a9b02435110` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:10.501473 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c633ba2-f21d-41a1-8547-d6d522833447 None admin] RBAC: Authorizing `identity:get_user(user_id=5221446a36ef4240bce53a9b02435110)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:10.502912 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c633ba2-f21d-41a1-8547-d6d522833447 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:10.504726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 139/284] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:10 2022] GET /identity/v3/users/5221446a36ef4240bce53a9b02435110 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:10.510501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3581b-a1f6-491f-8d1c-3c89e05cc565 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:10.667497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3581b-a1f6-491f-8d1c-3c89e05cc565 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:10.712848 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:10.718626 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693f2192-d21c-41a6-8f72-613461dcb256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:10.719540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f2192-d21c-41a6-8f72-613461dcb256 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:10.720047 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f2192-d21c-41a6-8f72-613461dcb256 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:10.720545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693f2192-d21c-41a6-8f72-613461dcb256 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:10.724524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f2192-d21c-41a6-8f72-613461dcb256 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:10.726171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693f2192-d21c-41a6-8f72-613461dcb256 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:10.728131 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 146/285] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:10 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:10.734646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c633ba2-f21d-41a1-8547-d6d522833447 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:10.841776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:10.874654 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c633ba2-f21d-41a1-8547-d6d522833447 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:10.928557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a715a7-397c-47a5-8039-9974104984b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:10.929577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a715a7-397c-47a5-8039-9974104984b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:10.930068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a715a7-397c-47a5-8039-9974104984b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:10.930562 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a715a7-397c-47a5-8039-9974104984b7 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e/users/5221446a36ef4240bce53a9b02435110/roles/569b7f0b7a5c4fe5b974abf4cfccfcb2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:10.932811 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a715a7-397c-47a5-8039-9974104984b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba004675284d4e2fb1037370cf5a047e, user_id=5221446a36ef4240bce53a9b02435110, role_id=569b7f0b7a5c4fe5b974abf4cfccfcb2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:10.934455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a715a7-397c-47a5-8039-9974104984b7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:11.012835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 140/286] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:50:10 2022] PUT /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e/users/5221446a36ef4240bce53a9b02435110/roles/569b7f0b7a5c4fe5b974abf4cfccfcb2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:11.341280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf99ec-be17-4d2f-9a24-3800604eca84 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:11.342798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf99ec-be17-4d2f-9a24-3800604eca84 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:11.343352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddf99ec-be17-4d2f-9a24-3800604eca84 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:11.345261 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 147/287] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:11.351175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d504672-7dfe-4a9f-9937-e82b3f69f7af None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:11.352051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d504672-7dfe-4a9f-9937-e82b3f69f7af None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:11.352548 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d504672-7dfe-4a9f-9937-e82b3f69f7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:11.386706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5d504672-7dfe-4a9f-9937-e82b3f69f7af None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:11.388175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5d504672-7dfe-4a9f-9937-e82b3f69f7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:11.496546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 141/288] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:11.854222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf99ec-be17-4d2f-9a24-3800604eca84 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:11.873294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38a84f-32d4-4b99-9e8f-5970bd7bf6e9 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:11.874263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38a84f-32d4-4b99-9e8f-5970bd7bf6e9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:11.874566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38a84f-32d4-4b99-9e8f-5970bd7bf6e9 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:11.876606 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 142/289] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:11.883007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8957e-2f21-4dec-886e-df6c6a063114 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:11.883296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8957e-2f21-4dec-886e-df6c6a063114 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:11.883574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8957e-2f21-4dec-886e-df6c6a063114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:11.913303 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-28d8957e-2f21-4dec-886e-df6c6a063114 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:11.914501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-28d8957e-2f21-4dec-886e-df6c6a063114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:11.988440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddf99ec-be17-4d2f-9a24-3800604eca84 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:12.006866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:12.012470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 143/290] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:12.013803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67117caa-e5c4-4452-acdf-43dc1b7cc2b1 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:12.014143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67117caa-e5c4-4452-acdf-43dc1b7cc2b1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:12.014416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67117caa-e5c4-4452-acdf-43dc1b7cc2b1 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:12.015862 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 144/291] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:12.021230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653581d-9049-4356-af5f-523819e03d62 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:12.021509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653581d-9049-4356-af5f-523819e03d62 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:12.024058 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2653581d-9049-4356-af5f-523819e03d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:12.034891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12f658-d13f-4c03-80ce-8ad09e68058e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:12.035643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12f658-d13f-4c03-80ce-8ad09e68058e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:12.035953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12f658-d13f-4c03-80ce-8ad09e68058e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:12.036222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12f658-d13f-4c03-80ce-8ad09e68058e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:12.042975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2653581d-9049-4356-af5f-523819e03d62 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:12.044286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2653581d-9049-4356-af5f-523819e03d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:12.053716 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12f658-d13f-4c03-80ce-8ad09e68058e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ff12f658-d13f-4c03-80ce-8ad09e68058e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:12.058670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:12.059628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:12.060460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:12.060460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:12.060460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:12.060460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:12.060460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:12.060460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:12.060460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:12.060460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:12.060460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:12.060460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:12.060460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:12.060460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:12.068339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 148/292] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:12.073944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12f658-d13f-4c03-80ce-8ad09e68058e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:12.127007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 145/293] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:12.136414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b2443-67ca-4a22-b5b4-db80b70ad23d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:12.136702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b2443-67ca-4a22-b5b4-db80b70ad23d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:12.136980 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b2443-67ca-4a22-b5b4-db80b70ad23d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:12.138371 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 146/294] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:12 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:12.142649 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:12.144601 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd44b0-3793-460b-810f-b9417b1f9a8a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:12.144879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd44b0-3793-460b-810f-b9417b1f9a8a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:12.145152 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd44b0-3793-460b-810f-b9417b1f9a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:12.178291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9ccd44b0-3793-460b-810f-b9417b1f9a8a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:12.179481 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9ccd44b0-3793-460b-810f-b9417b1f9a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:12.186829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12f658-d13f-4c03-80ce-8ad09e68058e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:12.222283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4e45c-2858-4420-9af9-27269252cb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:12.222899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4e45c-2858-4420-9af9-27269252cb44 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:12.223177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4e45c-2858-4420-9af9-27269252cb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:12.223448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb4e45c-2858-4420-9af9-27269252cb44 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:12.224141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4e45c-2858-4420-9af9-27269252cb44 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:12.224443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4e45c-2858-4420-9af9-27269252cb44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:12.225803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb4e45c-2858-4420-9af9-27269252cb44 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:12.235138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 149/295] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:12.240403 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4e45c-2858-4420-9af9-27269252cb44 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:12.313856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 147/296] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:12.357269 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd44b0-3793-460b-810f-b9417b1f9a8a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:12.400032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb4e45c-2858-4420-9af9-27269252cb44 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:12.445251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:12.465718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:12.477642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98332a-79d0-4241-86b3-2364c7a129cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:12.478295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98332a-79d0-4241-86b3-2364c7a129cf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:12.478582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98332a-79d0-4241-86b3-2364c7a129cf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:12.478860 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98332a-79d0-4241-86b3-2364c7a129cf None admin] PATH_INFO: `/v3/users/c139a37866be470ea8f9f13fbc4d9290` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:12.484622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98332a-79d0-4241-86b3-2364c7a129cf None admin] RBAC: Authorizing `identity:get_user(user_id=c139a37866be470ea8f9f13fbc4d9290)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:12.486080 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec98332a-79d0-4241-86b3-2364c7a129cf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:12.487707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 150/297] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:12 2022] GET /identity/v3/users/c139a37866be470ea8f9f13fbc4d9290 => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:12.493428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98332a-79d0-4241-86b3-2364c7a129cf None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:12.510391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd44b0-3793-460b-810f-b9417b1f9a8a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:12.551877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683aeb7-eb18-4b7a-8ad5-5c877567b480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:12.552527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683aeb7-eb18-4b7a-8ad5-5c877567b480 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:12.552857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683aeb7-eb18-4b7a-8ad5-5c877567b480 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:12.553132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683aeb7-eb18-4b7a-8ad5-5c877567b480 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:12.565086 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683aeb7-eb18-4b7a-8ad5-5c877567b480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-9683aeb7-eb18-4b7a-8ad5-5c877567b480 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:12.570252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:12.571168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:12.572399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:12.572399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:12.572399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:12.572399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:12.572399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:12.572399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:12.572399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:12.572399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:12.572399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:12.572399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:12.572399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:50:12.572399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:12.572399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 148/298] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:12.573117 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683aeb7-eb18-4b7a-8ad5-5c877567b480 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:12.610138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec98332a-79d0-4241-86b3-2364c7a129cf None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:12.645363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbcea0-7d1a-4fc7-8f45-ce05d76e9fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:12.645892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbcea0-7d1a-4fc7-8f45-ce05d76e9fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:12.646171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbcea0-7d1a-4fc7-8f45-ce05d76e9fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:12.646438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cbcea0-7d1a-4fc7-8f45-ce05d76e9fc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:12.688939 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683aeb7-eb18-4b7a-8ad5-5c877567b480 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:12.705685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:12.712976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:12.716043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbcea0-7d1a-4fc7-8f45-ce05d76e9fc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:12.717781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cbcea0-7d1a-4fc7-8f45-ce05d76e9fc6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:12.730109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493e9f6-4b8c-4fb0-b96c-7c93dcbf3ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:12.731100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493e9f6-4b8c-4fb0-b96c-7c93dcbf3ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:12.731389 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493e9f6-4b8c-4fb0-b96c-7c93dcbf3ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:12.731873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a493e9f6-4b8c-4fb0-b96c-7c93dcbf3ef0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:12.745026 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a493e9f6-4b8c-4fb0-b96c-7c93dcbf3ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a493e9f6-4b8c-4fb0-b96c-7c93dcbf3ef0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:12.752803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:12.753746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:12.754564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:12.754564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:12.754564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:12.754564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:12.754564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:12.754564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:12.754564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:12.754564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:12.754564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:12.754564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:12.754564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:12.754564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:12.755200 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 149/299] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:12.758876 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493e9f6-4b8c-4fb0-b96c-7c93dcbf3ef0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:12.824695 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 151/300] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:50:12.825889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbcea0-7d1a-4fc7-8f45-ce05d76e9fc6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:12.868357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a493e9f6-4b8c-4fb0-b96c-7c93dcbf3ef0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:12.903107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9471d-75f0-4a5f-aaba-17d4a7bd7783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:12.903632 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9471d-75f0-4a5f-aaba-17d4a7bd7783 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:12.903934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9471d-75f0-4a5f-aaba-17d4a7bd7783 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:12.904215 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e9471d-75f0-4a5f-aaba-17d4a7bd7783 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:12.904913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9471d-75f0-4a5f-aaba-17d4a7bd7783 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:12.905218 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9471d-75f0-4a5f-aaba-17d4a7bd7783 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:12.906590 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e9471d-75f0-4a5f-aaba-17d4a7bd7783 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:12.919258 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 150/301] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:12.919258 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9471d-75f0-4a5f-aaba-17d4a7bd7783 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:12.924055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:12.934694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cbcea0-7d1a-4fc7-8f45-ce05d76e9fc6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:12.966432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:12.971110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8c927-3522-4bef-9844-3aa29c78fb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:12.971743 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8c927-3522-4bef-9844-3aa29c78fb58 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:12.972060 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8c927-3522-4bef-9844-3aa29c78fb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:12.972332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f8c927-3522-4bef-9844-3aa29c78fb58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:12.973435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8c927-3522-4bef-9844-3aa29c78fb58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:12.980014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f8c927-3522-4bef-9844-3aa29c78fb58 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:12.980014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 152/302] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:12.980014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8c927-3522-4bef-9844-3aa29c78fb58 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:13.030789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e9471d-75f0-4a5f-aaba-17d4a7bd7783 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:13.067702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342112e5-621f-4a73-a30b-11a292f276e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:13.068340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342112e5-621f-4a73-a30b-11a292f276e4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:13.068620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342112e5-621f-4a73-a30b-11a292f276e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:13.068893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342112e5-621f-4a73-a30b-11a292f276e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:13.069672 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342112e5-621f-4a73-a30b-11a292f276e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:13.069978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342112e5-621f-4a73-a30b-11a292f276e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:13.071353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342112e5-621f-4a73-a30b-11a292f276e4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:13.084837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 151/303] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:13.084837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342112e5-621f-4a73-a30b-11a292f276e4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:13.085062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f8c927-3522-4bef-9844-3aa29c78fb58 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:13.121180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdddd9a-490f-4a5e-8548-298b25d9ef51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:13.121920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdddd9a-490f-4a5e-8548-298b25d9ef51 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:13.122207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdddd9a-490f-4a5e-8548-298b25d9ef51 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:13.122480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdddd9a-490f-4a5e-8548-298b25d9ef51 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:13.124179 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdddd9a-490f-4a5e-8548-298b25d9ef51 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:13.125712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdddd9a-490f-4a5e-8548-298b25d9ef51 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:13.127352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 153/304] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:12 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:13.128139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdddd9a-490f-4a5e-8548-298b25d9ef51 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:13.157041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:13.197679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342112e5-621f-4a73-a30b-11a292f276e4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:13.200438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:13.231403 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdddd9a-490f-4a5e-8548-298b25d9ef51 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:13.233881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faef966-ce91-4c02-a30c-eec1c938f481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:13.234816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faef966-ce91-4c02-a30c-eec1c938f481 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:13.235287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faef966-ce91-4c02-a30c-eec1c938f481 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:13.235770 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faef966-ce91-4c02-a30c-eec1c938f481 None admin] PATH_INFO: `/v3/users/7ed1277a980443e3907582a974a3fc4c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:13.250736 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faef966-ce91-4c02-a30c-eec1c938f481 None admin] RBAC: Authorizing `identity:get_user(user_id=7ed1277a980443e3907582a974a3fc4c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:13.252490 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faef966-ce91-4c02-a30c-eec1c938f481 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:13.254650 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 152/305] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:13 2022] GET /identity/v3/users/7ed1277a980443e3907582a974a3fc4c => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:13.255721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faef966-ce91-4c02-a30c-eec1c938f481 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:13.271510 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905267b8-87ec-4c92-b432-c3de2964ff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:13.272159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905267b8-87ec-4c92-b432-c3de2964ff0c None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:13.272443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905267b8-87ec-4c92-b432-c3de2964ff0c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:13.272717 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905267b8-87ec-4c92-b432-c3de2964ff0c None admin] PATH_INFO: `/v3/groups` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:13.273342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905267b8-87ec-4c92-b432-c3de2964ff0c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:13.274761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905267b8-87ec-4c92-b432-c3de2964ff0c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:13.355352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 154/306] 10.222.0.62 () {60 vars in 1134 bytes} [Wed Aug 24 07:50:13 2022] POST /identity/v3/groups => generated 229 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:50:13.355703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faef966-ce91-4c02-a30c-eec1c938f481 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:13.360928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905267b8-87ec-4c92-b432-c3de2964ff0c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:13.405475 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bb61b-0eca-4877-b327-e4f0a2791414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:13.407359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bb61b-0eca-4877-b327-e4f0a2791414 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:13.407913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bb61b-0eca-4877-b327-e4f0a2791414 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:13.408427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419bb61b-0eca-4877-b327-e4f0a2791414 None admin] PATH_INFO: `/v3/users/ea73b57b23324f0fa65f1c08da5c4cf3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:13.409921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bb61b-0eca-4877-b327-e4f0a2791414 None admin] RBAC: Authorizing `identity:get_user(user_id=ea73b57b23324f0fa65f1c08da5c4cf3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:13.412003 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419bb61b-0eca-4877-b327-e4f0a2791414 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:13.413970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 153/307] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:13 2022] GET /identity/v3/users/ea73b57b23324f0fa65f1c08da5c4cf3 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:13.418949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bb61b-0eca-4877-b327-e4f0a2791414 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:13.455716 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:13.476906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:13.493610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905267b8-87ec-4c92-b432-c3de2964ff0c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:13.532878 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae626c9-4db5-4f6a-bfe1-2906338057d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:13.533916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae626c9-4db5-4f6a-bfe1-2906338057d2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:13.534200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae626c9-4db5-4f6a-bfe1-2906338057d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:13.534474 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae626c9-4db5-4f6a-bfe1-2906338057d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:13.535199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae626c9-4db5-4f6a-bfe1-2906338057d2 None admin] RBAC: Adding query filter params (role.id=75d9054a423c4c66b163c72c8ae7989c, scope.project.id=ba004675284d4e2fb1037370cf5a047e, user.id=c139a37866be470ea8f9f13fbc4d9290) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:13.535504 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae626c9-4db5-4f6a-bfe1-2906338057d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:13.537242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae626c9-4db5-4f6a-bfe1-2906338057d2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:13.544972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 155/308] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:13 2022] GET /identity/v3/role_assignments?user.id=c139a37866be470ea8f9f13fbc4d9290&scope.project.id=ba004675284d4e2fb1037370cf5a047e&role.id=75d9054a423c4c66b163c72c8ae7989c => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:13.546419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae626c9-4db5-4f6a-bfe1-2906338057d2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:13.547206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419bb61b-0eca-4877-b327-e4f0a2791414 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:13.591236 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd62df6-f414-4b00-bef9-26f0fc59d351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:13.591892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd62df6-f414-4b00-bef9-26f0fc59d351 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:13.592722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd62df6-f414-4b00-bef9-26f0fc59d351 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:13.592994 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd62df6-f414-4b00-bef9-26f0fc59d351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:13.593746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd62df6-f414-4b00-bef9-26f0fc59d351 None admin] RBAC: Adding query filter params (role.id=569b7f0b7a5c4fe5b974abf4cfccfcb2, user.id=7ed1277a980443e3907582a974a3fc4c, scope.system=all) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:13.594144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd62df6-f414-4b00-bef9-26f0fc59d351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:13.595638 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd62df6-f414-4b00-bef9-26f0fc59d351 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:13.608595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 154/309] 10.222.0.62 () {56 vars in 1308 bytes} [Wed Aug 24 07:50:13 2022] GET /identity/v3/role_assignments?user.id=7ed1277a980443e3907582a974a3fc4c&scope.system=all&role.id=569b7f0b7a5c4fe5b974abf4cfccfcb2 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:13.610587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96379e42-d574-4ddc-a0b8-132b47f810e2 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:13.610934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96379e42-d574-4ddc-a0b8-132b47f810e2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:13.611316 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96379e42-d574-4ddc-a0b8-132b47f810e2 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:13.613133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 155/310] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:13.619386 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d469773-43bb-478d-bbcb-9af5af1f2c16 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:13.619695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d469773-43bb-478d-bbcb-9af5af1f2c16 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:13.619975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d469773-43bb-478d-bbcb-9af5af1f2c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:13.655946 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5d469773-43bb-478d-bbcb-9af5af1f2c16 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:13.657208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5d469773-43bb-478d-bbcb-9af5af1f2c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:13.694202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae626c9-4db5-4f6a-bfe1-2906338057d2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:13.763194 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 156/311] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:50:13.792713 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c3458-c974-401a-8607-338bf193839d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:13.793440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c3458-c974-401a-8607-338bf193839d None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:13.793726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c3458-c974-401a-8607-338bf193839d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:13.794007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761c3458-c974-401a-8607-338bf193839d None admin] PATH_INFO: `/v3/system/users/ea73b57b23324f0fa65f1c08da5c4cf3/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:13.795738 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c3458-c974-401a-8607-338bf193839d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ea73b57b23324f0fa65f1c08da5c4cf3, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:13.797257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761c3458-c974-401a-8607-338bf193839d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:13.898653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 156/312] 10.222.0.62 () {58 vars in 1334 bytes} [Wed Aug 24 07:50:13 2022] PUT /identity/v3/system/users/ea73b57b23324f0fa65f1c08da5c4cf3/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:14.050637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d469773-43bb-478d-bbcb-9af5af1f2c16 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:14.078410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:14.164457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d469773-43bb-478d-bbcb-9af5af1f2c16 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:14.199802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da4efd-c85d-4adc-9a9e-bf1ed462965e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:14.200459 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da4efd-c85d-4adc-9a9e-bf1ed462965e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:14.200734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da4efd-c85d-4adc-9a9e-bf1ed462965e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:14.200998 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da4efd-c85d-4adc-9a9e-bf1ed462965e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:14.211790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40da4efd-c85d-4adc-9a9e-bf1ed462965e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-40da4efd-c85d-4adc-9a9e-bf1ed462965e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:14.216843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:14.218656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:14.219613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:14.219613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:14.219613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:14.219613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:14.219613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:14.219613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:14.219613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:14.219613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:14.219613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:14.219613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:14.219613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:50:14.219613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:14.219613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 157/313] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:14.226709 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c3458-c974-401a-8607-338bf193839d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:14.251720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:14.332443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761c3458-c974-401a-8607-338bf193839d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:14.371430 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd722b4-1cc1-49ab-aa65-dc6437147855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:14.372446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd722b4-1cc1-49ab-aa65-dc6437147855 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:14.372932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd722b4-1cc1-49ab-aa65-dc6437147855 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:14.374050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd722b4-1cc1-49ab-aa65-dc6437147855 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:14.375440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd722b4-1cc1-49ab-aa65-dc6437147855 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:14.375985 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd722b4-1cc1-49ab-aa65-dc6437147855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:14.377582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd722b4-1cc1-49ab-aa65-dc6437147855 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:14.393655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 157/314] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:14.396965 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da4efd-c85d-4adc-9a9e-bf1ed462965e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:14.493840 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:14.512473 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da4efd-c85d-4adc-9a9e-bf1ed462965e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:14.553574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e9355-d71d-4973-aafb-8ca2d5ce4cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:14.554630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e9355-d71d-4973-aafb-8ca2d5ce4cad None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:14.555138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e9355-d71d-4973-aafb-8ca2d5ce4cad None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:14.555620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e9355-d71d-4973-aafb-8ca2d5ce4cad None admin] PATH_INFO: `/v3/users/5221446a36ef4240bce53a9b02435110` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:14.557200 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e9355-d71d-4973-aafb-8ca2d5ce4cad None admin] RBAC: Authorizing `identity:get_user(user_id=5221446a36ef4240bce53a9b02435110)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:14.559083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e9355-d71d-4973-aafb-8ca2d5ce4cad None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:14.561032 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 158/315] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:14 2022] GET /identity/v3/users/5221446a36ef4240bce53a9b02435110 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:14.567560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd722b4-1cc1-49ab-aa65-dc6437147855 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:14.679868 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:14.696227 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd722b4-1cc1-49ab-aa65-dc6437147855 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:14.808145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f2bfc-e265-4a05-9318-77a609a9b465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:14.809217 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2bfc-e265-4a05-9318-77a609a9b465 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:14.809832 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2bfc-e265-4a05-9318-77a609a9b465 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:14.810302 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2bfc-e265-4a05-9318-77a609a9b465 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:14.900968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f2bfc-e265-4a05-9318-77a609a9b465 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:14.903997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f2bfc-e265-4a05-9318-77a609a9b465 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:14.993979 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:15.027976 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 158/316] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:15.030351 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e9355-d71d-4973-aafb-8ca2d5ce4cad None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:15.165283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e9355-d71d-4973-aafb-8ca2d5ce4cad None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:15.208764 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cba17-d691-448b-ae4f-0b1754c16911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:15.211005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cba17-d691-448b-ae4f-0b1754c16911 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:15.212604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cba17-d691-448b-ae4f-0b1754c16911 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:15.213987 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cba17-d691-448b-ae4f-0b1754c16911 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:15.215646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cba17-d691-448b-ae4f-0b1754c16911 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:15.217484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cba17-d691-448b-ae4f-0b1754c16911 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:15.224114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 159/317] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:15 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:15.226393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f2bfc-e265-4a05-9318-77a609a9b465 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:15.348518 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f2bfc-e265-4a05-9318-77a609a9b465 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:15.387317 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511bfdeb-a313-4d3c-93d9-2c2711841086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:15.393256 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bfdeb-a313-4d3c-93d9-2c2711841086 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:15.393256 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bfdeb-a313-4d3c-93d9-2c2711841086 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:15.393256 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511bfdeb-a313-4d3c-93d9-2c2711841086 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:15.393256 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bfdeb-a313-4d3c-93d9-2c2711841086 None admin] RBAC: Adding query filter params (role.id=569b7f0b7a5c4fe5b974abf4cfccfcb2, scope.project.id=ba004675284d4e2fb1037370cf5a047e, user.id=5221446a36ef4240bce53a9b02435110) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:15.393256 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bfdeb-a313-4d3c-93d9-2c2711841086 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:15.393256 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511bfdeb-a313-4d3c-93d9-2c2711841086 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:15.398102 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 159/318] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:15 2022] GET /identity/v3/role_assignments?user.id=5221446a36ef4240bce53a9b02435110&scope.project.id=ba004675284d4e2fb1037370cf5a047e&role.id=569b7f0b7a5c4fe5b974abf4cfccfcb2 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:15.569645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee851aa-52d0-4632-bcf9-65c2d062e617 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:15.570147 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee851aa-52d0-4632-bcf9-65c2d062e617 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:15.570222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee851aa-52d0-4632-bcf9-65c2d062e617 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:15.571787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 160/319] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:15.577562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa3282-1c81-4f99-ac84-acf0e2b0ef8a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:15.578395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa3282-1c81-4f99-ac84-acf0e2b0ef8a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:15.578862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa3282-1c81-4f99-ac84-acf0e2b0ef8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:15.599145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5efa3282-1c81-4f99-ac84-acf0e2b0ef8a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:15.600781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5efa3282-1c81-4f99-ac84-acf0e2b0ef8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:15.637676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:15.671902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 160/320] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:15.814869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949163c-6451-4818-a839-ae139a6152d0 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:15.815187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949163c-6451-4818-a839-ae139a6152d0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:15.815427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949163c-6451-4818-a839-ae139a6152d0 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:15.816937 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 161/321] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:15.821927 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1182df-2f15-41c9-aaaa-10151a4e55a7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:15.822223 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1182df-2f15-41c9-aaaa-10151a4e55a7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:15.822499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1182df-2f15-41c9-aaaa-10151a4e55a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:15.843431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6f1182df-2f15-41c9-aaaa-10151a4e55a7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:15.844656 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6f1182df-2f15-41c9-aaaa-10151a4e55a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:15.914304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 161/322] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:15.945673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949163c-6451-4818-a839-ae139a6152d0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:15.969357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:15.978606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97cf6d-b2d0-44ae-ad33-1f4bc2c57781 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:15.978906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97cf6d-b2d0-44ae-ad33-1f4bc2c57781 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:15.985219 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97cf6d-b2d0-44ae-ad33-1f4bc2c57781 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:15.985219 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 162/323] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:15.986064 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02caa4c-1671-47e7-92b1-922c7a0df6c5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:15.986352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02caa4c-1671-47e7-92b1-922c7a0df6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:15.986623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02caa4c-1671-47e7-92b1-922c7a0df6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:16.004788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c02caa4c-1671-47e7-92b1-922c7a0df6c5 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:16.005976 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c02caa4c-1671-47e7-92b1-922c7a0df6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:16.054727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949163c-6451-4818-a839-ae139a6152d0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:16.077215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 163/324] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:16.091461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a1f63-ca93-498d-88d4-b5dc0d3ba202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:16.092179 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a1f63-ca93-498d-88d4-b5dc0d3ba202 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:16.092502 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a1f63-ca93-498d-88d4-b5dc0d3ba202 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:16.092836 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964a1f63-ca93-498d-88d4-b5dc0d3ba202 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:16.093936 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a1f63-ca93-498d-88d4-b5dc0d3ba202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:16.095338 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964a1f63-ca93-498d-88d4-b5dc0d3ba202 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:16.099887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 162/325] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:16.102594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02caa4c-1671-47e7-92b1-922c7a0df6c5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:16.133324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:16.190303 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a1f63-ca93-498d-88d4-b5dc0d3ba202 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:16.209098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02caa4c-1671-47e7-92b1-922c7a0df6c5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:16.245264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84891f2-23ff-419f-8f19-006ec734d2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:16.245876 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84891f2-23ff-419f-8f19-006ec734d2d0 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:16.246158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84891f2-23ff-419f-8f19-006ec734d2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:16.246434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84891f2-23ff-419f-8f19-006ec734d2d0 None admin] PATH_INFO: `/v3/groups` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:16.247179 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84891f2-23ff-419f-8f19-006ec734d2d0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:16.249584 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84891f2-23ff-419f-8f19-006ec734d2d0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:16.280372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:16.291656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964a1f63-ca93-498d-88d4-b5dc0d3ba202 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:16.324455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3d508-6b3e-4727-8a09-423fdcbb4263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:16.325075 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3d508-6b3e-4727-8a09-423fdcbb4263 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:16.325348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3d508-6b3e-4727-8a09-423fdcbb4263 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:16.325616 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3d508-6b3e-4727-8a09-423fdcbb4263 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:16.335256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3d508-6b3e-4727-8a09-423fdcbb4263 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-77e3d508-6b3e-4727-8a09-423fdcbb4263 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:16.340009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:16.344209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:16.345033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:16.345033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:16.345033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:16.345033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:16.345033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:16.345033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:16.345033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:16.345033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:16.345033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:16.345033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:16.345033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:50:16.345033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:16.345033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 163/326] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:16.347771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3d508-6b3e-4727-8a09-423fdcbb4263 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:16.366159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 164/327] 10.222.0.62 () {60 vars in 1134 bytes} [Wed Aug 24 07:50:16 2022] POST /identity/v3/groups => generated 226 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:50:16.367241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84891f2-23ff-419f-8f19-006ec734d2d0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:16.458051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3d508-6b3e-4727-8a09-423fdcbb4263 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:16.491005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:16.497840 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea5b53-fe8e-4b76-b4f8-e47a473c9db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:16.498500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5b53-fe8e-4b76-b4f8-e47a473c9db5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:16.498875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5b53-fe8e-4b76-b4f8-e47a473c9db5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:16.499174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea5b53-fe8e-4b76-b4f8-e47a473c9db5 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:16.507821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea5b53-fe8e-4b76-b4f8-e47a473c9db5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:16.507821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea5b53-fe8e-4b76-b4f8-e47a473c9db5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:16.507821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea5b53-fe8e-4b76-b4f8-e47a473c9db5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:16.508074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84891f2-23ff-419f-8f19-006ec734d2d0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:16.511154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 164/328] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:16.517125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea5b53-fe8e-4b76-b4f8-e47a473c9db5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:16.535073 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:16.541038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de29698-ded4-465f-8c5d-8b337592b4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:16.541682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de29698-ded4-465f-8c5d-8b337592b4ff None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:16.541960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de29698-ded4-465f-8c5d-8b337592b4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:16.542849 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de29698-ded4-465f-8c5d-8b337592b4ff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:16.556486 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de29698-ded4-465f-8c5d-8b337592b4ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5de29698-ded4-465f-8c5d-8b337592b4ff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:16.562842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:16.563789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:16.564681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:16.564681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:16.564681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:16.564681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:16.564681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:16.564681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:16.564681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:16.564681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:16.564681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:16.564681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:16.564681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:16.564681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:16.569153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 165/329] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:16.569958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de29698-ded4-465f-8c5d-8b337592b4ff None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:16.651396 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea5b53-fe8e-4b76-b4f8-e47a473c9db5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:16.696415 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b6a5-6004-421b-a338-dda53a2e2148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:16.697301 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b6a5-6004-421b-a338-dda53a2e2148 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:16.697742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b6a5-6004-421b-a338-dda53a2e2148 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:16.698019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942b6a5-6004-421b-a338-dda53a2e2148 None admin] PATH_INFO: `/v3/users/7ed1277a980443e3907582a974a3fc4c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:16.699385 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942b6a5-6004-421b-a338-dda53a2e2148 None admin] RBAC: Authorizing `identity:get_user(user_id=7ed1277a980443e3907582a974a3fc4c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:16.703043 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0942b6a5-6004-421b-a338-dda53a2e2148 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:16.703985 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 165/330] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:16 2022] GET /identity/v3/users/7ed1277a980443e3907582a974a3fc4c => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:16.706184 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de29698-ded4-465f-8c5d-8b337592b4ff None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:16.709833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b6a5-6004-421b-a338-dda53a2e2148 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:16.752745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8faf26-b467-44ef-96c1-0d01e7e44c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:16.753372 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8faf26-b467-44ef-96c1-0d01e7e44c3a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:16.753638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8faf26-b467-44ef-96c1-0d01e7e44c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:16.753910 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8faf26-b467-44ef-96c1-0d01e7e44c3a None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:16.754585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8faf26-b467-44ef-96c1-0d01e7e44c3a None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:16.754880 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8faf26-b467-44ef-96c1-0d01e7e44c3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:16.756799 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8faf26-b467-44ef-96c1-0d01e7e44c3a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:16.773189 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 166/331] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:16.775793 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8faf26-b467-44ef-96c1-0d01e7e44c3a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:16.793969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:16.806700 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:16.832691 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942b6a5-6004-421b-a338-dda53a2e2148 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:16.879687 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bf0c8-5ffe-4248-8bea-1256abc21bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:16.881041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bf0c8-5ffe-4248-8bea-1256abc21bd4 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:16.881322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bf0c8-5ffe-4248-8bea-1256abc21bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:16.881595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495bf0c8-5ffe-4248-8bea-1256abc21bd4 None admin] PATH_INFO: `/v3/system/users/7ed1277a980443e3907582a974a3fc4c/roles/569b7f0b7a5c4fe5b974abf4cfccfcb2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:16.883510 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bf0c8-5ffe-4248-8bea-1256abc21bd4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7ed1277a980443e3907582a974a3fc4c, role_id=569b7f0b7a5c4fe5b974abf4cfccfcb2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:16.885619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495bf0c8-5ffe-4248-8bea-1256abc21bd4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:16.909951 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8faf26-b467-44ef-96c1-0d01e7e44c3a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:16.943794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 166/332] 10.222.0.62 () {58 vars in 1334 bytes} [Wed Aug 24 07:50:16 2022] PUT /identity/v3/system/users/7ed1277a980443e3907582a974a3fc4c/roles/569b7f0b7a5c4fe5b974abf4cfccfcb2 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:16.958916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad00a7-4e87-4071-9a58-094a207e4220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:16.959629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad00a7-4e87-4071-9a58-094a207e4220 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:16.959993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad00a7-4e87-4071-9a58-094a207e4220 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:16.960215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad00a7-4e87-4071-9a58-094a207e4220 None admin] PATH_INFO: `/v3/users/ea73b57b23324f0fa65f1c08da5c4cf3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:16.961450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad00a7-4e87-4071-9a58-094a207e4220 None admin] RBAC: Authorizing `identity:get_user(user_id=ea73b57b23324f0fa65f1c08da5c4cf3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:16.962906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad00a7-4e87-4071-9a58-094a207e4220 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:16.964896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 167/333] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:16 2022] GET /identity/v3/users/ea73b57b23324f0fa65f1c08da5c4cf3 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:16.973171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bf0c8-5ffe-4248-8bea-1256abc21bd4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:17.099944 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495bf0c8-5ffe-4248-8bea-1256abc21bd4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:17.138335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4312ee02-9379-4b54-b910-3d78aef033a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:17.138986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ee02-9379-4b54-b910-3d78aef033a6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:17.139259 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ee02-9379-4b54-b910-3d78aef033a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:17.139526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4312ee02-9379-4b54-b910-3d78aef033a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:17.140282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312ee02-9379-4b54-b910-3d78aef033a6 None admin] RBAC: Adding query filter params (role.id=75d9054a423c4c66b163c72c8ae7989c, user.id=ea73b57b23324f0fa65f1c08da5c4cf3, scope.system=all) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:17.140587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312ee02-9379-4b54-b910-3d78aef033a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:17.142023 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4312ee02-9379-4b54-b910-3d78aef033a6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:17.151411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:17.155680 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 167/334] 10.222.0.62 () {56 vars in 1308 bytes} [Wed Aug 24 07:50:16 2022] GET /identity/v3/role_assignments?user.id=ea73b57b23324f0fa65f1c08da5c4cf3&scope.system=all&role.id=75d9054a423c4c66b163c72c8ae7989c => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:18.671278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f444b-bbdd-48ae-81ac-5bcc1ea1a441 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:18.671278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f444b-bbdd-48ae-81ac-5bcc1ea1a441 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:18.671278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0f444b-bbdd-48ae-81ac-5bcc1ea1a441 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:18.671278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 168/335] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:18.673549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06afa97-8e28-40f3-badd-12b8df1d875e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:18.673935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06afa97-8e28-40f3-badd-12b8df1d875e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:18.674286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06afa97-8e28-40f3-badd-12b8df1d875e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:18.697871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c06afa97-8e28-40f3-badd-12b8df1d875e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:18.699103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c06afa97-8e28-40f3-badd-12b8df1d875e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:18.784905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 168/336] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:18.978555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6461b-55b3-4d50-909f-3b231917d6f3 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:18.978742 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6461b-55b3-4d50-909f-3b231917d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:18.979028 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6461b-55b3-4d50-909f-3b231917d6f3 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:18.980753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 169/337] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:18.986964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d41bb3-ec92-41e5-b04f-ba7a764f7c35 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:18.987243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d41bb3-ec92-41e5-b04f-ba7a764f7c35 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:18.987511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d41bb3-ec92-41e5-b04f-ba7a764f7c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:19.010342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c1d41bb3-ec92-41e5-b04f-ba7a764f7c35 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:19.011525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c1d41bb3-ec92-41e5-b04f-ba7a764f7c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:19.093947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 169/338] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:19.161067 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8d5b1-33f8-4a2e-a47d-c2056d6ebe1f None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:19.161399 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8d5b1-33f8-4a2e-a47d-c2056d6ebe1f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:19.161631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8d5b1-33f8-4a2e-a47d-c2056d6ebe1f None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:19.162980 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 170/339] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:19.168342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d29d7e-05e8-48f3-b3df-36992b0f4b62 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:19.168631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d29d7e-05e8-48f3-b3df-36992b0f4b62 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:19.168903 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d29d7e-05e8-48f3-b3df-36992b0f4b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:19.191625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-43d29d7e-05e8-48f3-b3df-36992b0f4b62 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:19.192862 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-43d29d7e-05e8-48f3-b3df-36992b0f4b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:19.263076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:19.274905 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8d5b1-33f8-4a2e-a47d-c2056d6ebe1f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:19.276248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 170/340] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:19.390113 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:19.418172 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8d5b1-33f8-4a2e-a47d-c2056d6ebe1f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:19.462617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61629857-760a-4621-b01f-6c2180e660b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:19.463261 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61629857-760a-4621-b01f-6c2180e660b4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:19.463542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61629857-760a-4621-b01f-6c2180e660b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:19.463815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61629857-760a-4621-b01f-6c2180e660b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:19.481492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61629857-760a-4621-b01f-6c2180e660b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-61629857-760a-4621-b01f-6c2180e660b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:19.487141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:19.488069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:19.488859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:19.488859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:19.488859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:19.488859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:19.488859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:19.488859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:19.488859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:19.488859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:19.488859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:19.488859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:19.488859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:19.488859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:19.488859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 171/341] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:19.494344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d29d7e-05e8-48f3-b3df-36992b0f4b62 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:19.556247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e8703-cfa7-4166-99b0-2ff3b972bc87 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:19.556559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e8703-cfa7-4166-99b0-2ff3b972bc87 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:19.556810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e8703-cfa7-4166-99b0-2ff3b972bc87 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:19.558449 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 172/342] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:19.564232 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f03763-a2bf-493c-8ba1-ee65d4849854 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:19.564497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f03763-a2bf-493c-8ba1-ee65d4849854 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:19.564777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f03763-a2bf-493c-8ba1-ee65d4849854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:19.591008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-88f03763-a2bf-493c-8ba1-ee65d4849854 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:19.592805 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-88f03763-a2bf-493c-8ba1-ee65d4849854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:19.676408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d29d7e-05e8-48f3-b3df-36992b0f4b62 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:19.712568 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 173/343] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:19.714153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f03763-a2bf-493c-8ba1-ee65d4849854 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:19.723975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d693251-7aac-43e1-bbda-8c3185de5796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:19.724617 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d693251-7aac-43e1-bbda-8c3185de5796 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:19.724978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d693251-7aac-43e1-bbda-8c3185de5796 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:19.725266 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d693251-7aac-43e1-bbda-8c3185de5796 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:19.725993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d693251-7aac-43e1-bbda-8c3185de5796 None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:19.726378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d693251-7aac-43e1-bbda-8c3185de5796 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:19.727779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d693251-7aac-43e1-bbda-8c3185de5796 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:19.748555 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 171/344] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:19.754250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d693251-7aac-43e1-bbda-8c3185de5796 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:19.813471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:19.840543 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:19.846907 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f03763-a2bf-493c-8ba1-ee65d4849854 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:19.888424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd12aa0-dfad-4866-b0bd-ace824b111a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:19.889978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd12aa0-dfad-4866-b0bd-ace824b111a6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:19.890369 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd12aa0-dfad-4866-b0bd-ace824b111a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:19.890719 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd12aa0-dfad-4866-b0bd-ace824b111a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:19.905126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d693251-7aac-43e1-bbda-8c3185de5796 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:19.906171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd12aa0-dfad-4866-b0bd-ace824b111a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8cd12aa0-dfad-4866-b0bd-ace824b111a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:19.911041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:19.912174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:19.913215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:19.913215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:19.913215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:19.913215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:19.913215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:19.913215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:19.913215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:19.913215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:19.913215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:19.913215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:19.913215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:19.913215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:19.915077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 174/345] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:50:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:19.915977 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd12aa0-dfad-4866-b0bd-ace824b111a6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:19.989452 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892019d1-276d-4c19-9cd7-0ecb4e0e4161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:19.990297 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892019d1-276d-4c19-9cd7-0ecb4e0e4161 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:19.990642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892019d1-276d-4c19-9cd7-0ecb4e0e4161 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:19.990950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892019d1-276d-4c19-9cd7-0ecb4e0e4161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:20.034571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd12aa0-dfad-4866-b0bd-ace824b111a6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:20.065558 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:20.071947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3cfda-348a-4c24-9e36-406b27941439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:20.072894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3cfda-348a-4c24-9e36-406b27941439 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:20.073342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3cfda-348a-4c24-9e36-406b27941439 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:20.073754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce3cfda-348a-4c24-9e36-406b27941439 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:20.086151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce3cfda-348a-4c24-9e36-406b27941439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2ce3cfda-348a-4c24-9e36-406b27941439 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:20.092676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:20.093882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:20.094770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:20.094770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:20.094770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:20.094770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:20.094770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:20.094770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:20.094770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:20.094770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:20.094770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:20.094770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:20.094770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 07:50:20.094770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:20.097179 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 175/346] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:20.098311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3cfda-348a-4c24-9e36-406b27941439 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:20.149441 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892019d1-276d-4c19-9cd7-0ecb4e0e4161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:20.151010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892019d1-276d-4c19-9cd7-0ecb4e0e4161 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:20.207010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce3cfda-348a-4c24-9e36-406b27941439 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:20.243824 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f363e-0ca0-4d07-9468-ae5b392a50e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:20.245510 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f363e-0ca0-4d07-9468-ae5b392a50e2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:20.245795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f363e-0ca0-4d07-9468-ae5b392a50e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:20.246063 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9f363e-0ca0-4d07-9468-ae5b392a50e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:20.246735 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f363e-0ca0-4d07-9468-ae5b392a50e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:20.247037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f363e-0ca0-4d07-9468-ae5b392a50e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:20.249162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9f363e-0ca0-4d07-9468-ae5b392a50e2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:20.249284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:20.258503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 176/347] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:20.259340 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f363e-0ca0-4d07-9468-ae5b392a50e2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:20.320763 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 172/348] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:50:20.321625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892019d1-276d-4c19-9cd7-0ecb4e0e4161 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:20.323579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:20.381451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9f363e-0ca0-4d07-9468-ae5b392a50e2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:20.422188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81100a31-46b0-4f7c-9fd6-086520332349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:20.422808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100a31-46b0-4f7c-9fd6-086520332349 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:20.423091 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100a31-46b0-4f7c-9fd6-086520332349 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:20.423369 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81100a31-46b0-4f7c-9fd6-086520332349 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:20.425655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81100a31-46b0-4f7c-9fd6-086520332349 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:20.425978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81100a31-46b0-4f7c-9fd6-086520332349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:20.427403 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81100a31-46b0-4f7c-9fd6-086520332349 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:20.437543 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 177/349] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:20.438452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81100a31-46b0-4f7c-9fd6-086520332349 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:20.452408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892019d1-276d-4c19-9cd7-0ecb4e0e4161 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:20.493687 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addae15-5a4f-429e-8810-e3d424ad328a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:20.494327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addae15-5a4f-429e-8810-e3d424ad328a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:20.494642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addae15-5a4f-429e-8810-e3d424ad328a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:20.495031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7addae15-5a4f-429e-8810-e3d424ad328a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:20.512576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7addae15-5a4f-429e-8810-e3d424ad328a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-7addae15-5a4f-429e-8810-e3d424ad328a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:20.517635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:20.518518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:20.519324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:20.519324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:20.519324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:20.519324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:20.519324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:20.519324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:20.519324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:20.519324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:20.519324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:20.519324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:20.519324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:20.519324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:20.521656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 173/350] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:20.522640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addae15-5a4f-429e-8810-e3d424ad328a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:20.541277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:20.556673 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81100a31-46b0-4f7c-9fd6-086520332349 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:20.572214 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:20.596158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23952152-5acf-4cf7-a6e0-a0b9373bc84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:20.597627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23952152-5acf-4cf7-a6e0-a0b9373bc84c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:20.597627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23952152-5acf-4cf7-a6e0-a0b9373bc84c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:20.597627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23952152-5acf-4cf7-a6e0-a0b9373bc84c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:20.635593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7addae15-5a4f-429e-8810-e3d424ad328a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:20.676245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23952152-5acf-4cf7-a6e0-a0b9373bc84c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:20.677961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23952152-5acf-4cf7-a6e0-a0b9373bc84c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:20.682628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290a8a1-8281-4983-93e1-af9c0c81cd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:20.683260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290a8a1-8281-4983-93e1-af9c0c81cd04 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:20.683534 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290a8a1-8281-4983-93e1-af9c0c81cd04 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:20.683802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290a8a1-8281-4983-93e1-af9c0c81cd04 None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:20.688526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290a8a1-8281-4983-93e1-af9c0c81cd04 None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:20.689968 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290a8a1-8281-4983-93e1-af9c0c81cd04 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:20.693031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 174/351] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:20 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:20.693845 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290a8a1-8281-4983-93e1-af9c0c81cd04 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:20.781054 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:20.792860 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 178/352] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:20.793812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23952152-5acf-4cf7-a6e0-a0b9373bc84c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:20.802177 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290a8a1-8281-4983-93e1-af9c0c81cd04 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:20.811656 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:20.846073 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87506a-6d50-4b38-892c-04d648328470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:20.846625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87506a-6d50-4b38-892c-04d648328470 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:20.846902 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87506a-6d50-4b38-892c-04d648328470 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:20.847175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87506a-6d50-4b38-892c-04d648328470 None admin] PATH_INFO: `/v3/users/7ed1277a980443e3907582a974a3fc4c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:20.848374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87506a-6d50-4b38-892c-04d648328470 None admin] RBAC: Authorizing `identity:get_user(user_id=7ed1277a980443e3907582a974a3fc4c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:20.849812 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87506a-6d50-4b38-892c-04d648328470 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:20.851380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 175/353] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:50:20 2022] GET /identity/v3/users/7ed1277a980443e3907582a974a3fc4c => generated 293 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:20.852162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87506a-6d50-4b38-892c-04d648328470 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:20.915277 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23952152-5acf-4cf7-a6e0-a0b9373bc84c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:20.959020 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06317775-6265-4bf1-8848-1632004fc5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:20.959635 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06317775-6265-4bf1-8848-1632004fc5c6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:20.960333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06317775-6265-4bf1-8848-1632004fc5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:20.960333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06317775-6265-4bf1-8848-1632004fc5c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:20.960877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06317775-6265-4bf1-8848-1632004fc5c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:20.961183 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06317775-6265-4bf1-8848-1632004fc5c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:20.962545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06317775-6265-4bf1-8848-1632004fc5c6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:20.975133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 179/354] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:20.976003 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06317775-6265-4bf1-8848-1632004fc5c6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:20.977550 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87506a-6d50-4b38-892c-04d648328470 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:21.021864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509fcba9-cbf9-413d-ab78-06d7093d693e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:21.022868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fcba9-cbf9-413d-ab78-06d7093d693e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:21.023376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fcba9-cbf9-413d-ab78-06d7093d693e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:21.023876 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509fcba9-cbf9-413d-ab78-06d7093d693e None admin] PATH_INFO: `/v3/groups/e85759ecd1bf454f8af70e9447b8300e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:21.032214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fcba9-cbf9-413d-ab78-06d7093d693e None admin] RBAC: Authorizing `identity:get_group(group_id=e85759ecd1bf454f8af70e9447b8300e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:21.033771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509fcba9-cbf9-413d-ab78-06d7093d693e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:21.035900 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 176/355] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:20 2022] GET /identity/v3/groups/e85759ecd1bf454f8af70e9447b8300e => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:21.037143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de1cf0-b192-4f6a-9a1d-7fb27d30d607 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:21.037435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de1cf0-b192-4f6a-9a1d-7fb27d30d607 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:21.037703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de1cf0-b192-4f6a-9a1d-7fb27d30d607 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:21.039036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 177/356] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:21.039666 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de1cf0-b192-4f6a-9a1d-7fb27d30d607 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:21.061872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:21.074154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:21.099961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06317775-6265-4bf1-8848-1632004fc5c6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:21.142893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccf7b2-df86-486d-b30b-b6722101c318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:21.143528 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccf7b2-df86-486d-b30b-b6722101c318 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:21.143807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccf7b2-df86-486d-b30b-b6722101c318 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:21.144131 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccf7b2-df86-486d-b30b-b6722101c318 None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:21.145267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dccf7b2-df86-486d-b30b-b6722101c318 None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:21.146693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dccf7b2-df86-486d-b30b-b6722101c318 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:21.148647 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 180/357] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:20 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:21.149422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccf7b2-df86-486d-b30b-b6722101c318 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:21.179226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de1cf0-b192-4f6a-9a1d-7fb27d30d607 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:21.225090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119094de-7837-47d8-87ca-f47ee24e1837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:21.226078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119094de-7837-47d8-87ca-f47ee24e1837 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:21.226353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119094de-7837-47d8-87ca-f47ee24e1837 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:21.226674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119094de-7837-47d8-87ca-f47ee24e1837 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:21.227402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119094de-7837-47d8-87ca-f47ee24e1837 None admin] RBAC: Adding query filter params (role.id=569b7f0b7a5c4fe5b974abf4cfccfcb2, user.id=7ed1277a980443e3907582a974a3fc4c, scope.system=all) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:21.227705 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119094de-7837-47d8-87ca-f47ee24e1837 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:21.229940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119094de-7837-47d8-87ca-f47ee24e1837 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:21.244531 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 178/358] 10.222.0.62 () {56 vars in 1308 bytes} [Wed Aug 24 07:50:21 2022] GET /identity/v3/role_assignments?user.id=7ed1277a980443e3907582a974a3fc4c&scope.system=all&role.id=569b7f0b7a5c4fe5b974abf4cfccfcb2 => generated 510 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:21.245305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119094de-7837-47d8-87ca-f47ee24e1837 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:21.271268 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccf7b2-df86-486d-b30b-b6722101c318 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:21.330390 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869a810-3c65-45e0-b8d0-bf26cb6c433d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:21.331065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869a810-3c65-45e0-b8d0-bf26cb6c433d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:21.331347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869a810-3c65-45e0-b8d0-bf26cb6c433d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:21.331620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869a810-3c65-45e0-b8d0-bf26cb6c433d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:21.341338 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:21.352071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:21.385835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119094de-7837-47d8-87ca-f47ee24e1837 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:21.435177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869a810-3c65-45e0-b8d0-bf26cb6c433d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:21.436632 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d9b3bb-9115-4159-9b25-54386afcda9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:21.437225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869a810-3c65-45e0-b8d0-bf26cb6c433d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:21.437408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9b3bb-9115-4159-9b25-54386afcda9d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:21.437657 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9b3bb-9115-4159-9b25-54386afcda9d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:21.437929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d9b3bb-9115-4159-9b25-54386afcda9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:21.438668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9b3bb-9115-4159-9b25-54386afcda9d None admin] RBAC: Adding query filter params (group.id=e85759ecd1bf454f8af70e9447b8300e, role.id=75d9054a423c4c66b163c72c8ae7989c, scope.project.id=48ad6ef4173e4919a439dd1e407c850c) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:21.439071 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9b3bb-9115-4159-9b25-54386afcda9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:21.440468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d9b3bb-9115-4159-9b25-54386afcda9d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:21.446398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 179/359] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 24 07:50:21 2022] GET /identity/v3/role_assignments?group.id=e85759ecd1bf454f8af70e9447b8300e&scope.project.id=48ad6ef4173e4919a439dd1e407c850c&role.id=75d9054a423c4c66b163c72c8ae7989c => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:21.447668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f1877-e07c-403a-ac10-fa5a699cfeea None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:21.448044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f1877-e07c-403a-ac10-fa5a699cfeea None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:21.448319 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f1877-e07c-403a-ac10-fa5a699cfeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:21.472133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-543f1877-e07c-403a-ac10-fa5a699cfeea None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:21.473669 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-543f1877-e07c-403a-ac10-fa5a699cfeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:21.558659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 180/360] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:21.559393 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f1877-e07c-403a-ac10-fa5a699cfeea None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:21.580887 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 181/361] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:21.582180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb17ce-f710-4821-8e9f-9a7362774294 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:21.582467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb17ce-f710-4821-8e9f-9a7362774294 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:21.582742 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb17ce-f710-4821-8e9f-9a7362774294 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:21.587871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 182/362] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:21.587871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb17ce-f710-4821-8e9f-9a7362774294 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:21.653423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:21.663695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:21.695557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f1877-e07c-403a-ac10-fa5a699cfeea None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:21.729263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb17ce-f710-4821-8e9f-9a7362774294 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:21.738226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f1ce7-0984-4d7f-844f-05259a4b6d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:21.739012 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f1ce7-0984-4d7f-844f-05259a4b6d83 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:21.739412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f1ce7-0984-4d7f-844f-05259a4b6d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:21.739780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f1ce7-0984-4d7f-844f-05259a4b6d83 None admin] PATH_INFO: `/v3/groups/e85759ecd1bf454f8af70e9447b8300e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:21.741439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f1ce7-0984-4d7f-844f-05259a4b6d83 None admin] RBAC: Authorizing `identity:get_group(group_id=e85759ecd1bf454f8af70e9447b8300e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:21.742663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f1ce7-0984-4d7f-844f-05259a4b6d83 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:21.745884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 181/363] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:21 2022] GET /identity/v3/groups/e85759ecd1bf454f8af70e9447b8300e => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:21.746685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a5ed5-3141-4c98-b9c7-275fb99459a1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:21.747063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a5ed5-3141-4c98-b9c7-275fb99459a1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:21.747429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110a5ed5-3141-4c98-b9c7-275fb99459a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:21.770322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-110a5ed5-3141-4c98-b9c7-275fb99459a1 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:21.772051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-110a5ed5-3141-4c98-b9c7-275fb99459a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:21.774846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0d8b3-e7b9-46bb-96ef-be97ee3c04d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:21.776169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0d8b3-e7b9-46bb-96ef-be97ee3c04d3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:21.776169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0d8b3-e7b9-46bb-96ef-be97ee3c04d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:21.776388 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a0d8b3-e7b9-46bb-96ef-be97ee3c04d3 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:21.777737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0d8b3-e7b9-46bb-96ef-be97ee3c04d3 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:21.779356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a0d8b3-e7b9-46bb-96ef-be97ee3c04d3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:21.781128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 183/364] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:21 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:21.782782 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0d8b3-e7b9-46bb-96ef-be97ee3c04d3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:21.859795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 182/365] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:21.859795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a5ed5-3141-4c98-b9c7-275fb99459a1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:21.923213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a0d8b3-e7b9-46bb-96ef-be97ee3c04d3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:21.944218 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:21.945804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:21.968537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8991c91-0a90-4e45-95e1-ac951a4d5561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:21.969417 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8991c91-0a90-4e45-95e1-ac951a4d5561 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:21.969836 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8991c91-0a90-4e45-95e1-ac951a4d5561 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:21.970244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8991c91-0a90-4e45-95e1-ac951a4d5561 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:21.971121 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8991c91-0a90-4e45-95e1-ac951a4d5561 None admin] RBAC: Adding query filter params (group.id=e85759ecd1bf454f8af70e9447b8300e, role.id=d78c47b14910477fa17f456efbbc177c, scope.project.id=48ad6ef4173e4919a439dd1e407c850c) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:21.971584 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8991c91-0a90-4e45-95e1-ac951a4d5561 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:21.973198 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8991c91-0a90-4e45-95e1-ac951a4d5561 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:21.981015 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 184/366] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 24 07:50:21 2022] GET /identity/v3/role_assignments?group.id=e85759ecd1bf454f8af70e9447b8300e&scope.project.id=48ad6ef4173e4919a439dd1e407c850c&role.id=d78c47b14910477fa17f456efbbc177c => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:21.982106 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8991c91-0a90-4e45-95e1-ac951a4d5561 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:21.997756 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110a5ed5-3141-4c98-b9c7-275fb99459a1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:22.047533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622abb7-54ae-40ef-81fa-8085e38ff54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:22.048227 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622abb7-54ae-40ef-81fa-8085e38ff54e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:22.048510 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622abb7-54ae-40ef-81fa-8085e38ff54e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:22.048795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622abb7-54ae-40ef-81fa-8085e38ff54e None admin] PATH_INFO: `/v3/groups/e85759ecd1bf454f8af70e9447b8300e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:22.050670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622abb7-54ae-40ef-81fa-8085e38ff54e None admin] RBAC: Authorizing `identity:get_group(group_id=e85759ecd1bf454f8af70e9447b8300e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:22.052386 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622abb7-54ae-40ef-81fa-8085e38ff54e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:22.054332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 183/367] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:21 2022] GET /identity/v3/groups/e85759ecd1bf454f8af70e9447b8300e => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:22.060338 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622abb7-54ae-40ef-81fa-8085e38ff54e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:22.156378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8991c91-0a90-4e45-95e1-ac951a4d5561 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:22.174949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622abb7-54ae-40ef-81fa-8085e38ff54e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:22.205369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:22.211173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c2bc4-e0aa-4b12-952f-91219b176ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:22.211788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c2bc4-e0aa-4b12-952f-91219b176ae7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:22.212096 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c2bc4-e0aa-4b12-952f-91219b176ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:22.212371 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c2bc4-e0aa-4b12-952f-91219b176ae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:22.212700 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91c02c-c489-497b-8069-e477b2ac3a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:22.213101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c2bc4-e0aa-4b12-952f-91219b176ae7 None admin] RBAC: Adding query filter params (group.id=e85759ecd1bf454f8af70e9447b8300e, role.id=75d9054a423c4c66b163c72c8ae7989c, scope.project.id=ba004675284d4e2fb1037370cf5a047e) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:22.213414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c2bc4-e0aa-4b12-952f-91219b176ae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:22.213841 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91c02c-c489-497b-8069-e477b2ac3a45 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:22.214306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91c02c-c489-497b-8069-e477b2ac3a45 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:22.214739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91c02c-c489-497b-8069-e477b2ac3a45 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:22.214846 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c2bc4-e0aa-4b12-952f-91219b176ae7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:22.222239 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 184/368] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 24 07:50:22 2022] GET /identity/v3/role_assignments?group.id=e85759ecd1bf454f8af70e9447b8300e&scope.project.id=ba004675284d4e2fb1037370cf5a047e&role.id=75d9054a423c4c66b163c72c8ae7989c => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:22.240393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91c02c-c489-497b-8069-e477b2ac3a45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2e91c02c-c489-497b-8069-e477b2ac3a45 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:22.246297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:22.247501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:22.248634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:22.248634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:22.248634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:22.248634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:22.248634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:22.248634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:22.248634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:22.248634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:22.248634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:22.248634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:22.248634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:22.248634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:22.250831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 185/369] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:50:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:22.256914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c2bc4-e0aa-4b12-952f-91219b176ae7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:22.322142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91c02c-c489-497b-8069-e477b2ac3a45 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:22.385822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:22.394557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c2bc4-e0aa-4b12-952f-91219b176ae7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:22.431069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d41fa-1550-47ca-af1e-fc58d5f841ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:22.431605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d41fa-1550-47ca-af1e-fc58d5f841ea None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:22.431908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d41fa-1550-47ca-af1e-fc58d5f841ea None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:22.432185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d41fa-1550-47ca-af1e-fc58d5f841ea None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:22.432853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d41fa-1550-47ca-af1e-fc58d5f841ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:22.433164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d41fa-1550-47ca-af1e-fc58d5f841ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:22.436170 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d41fa-1550-47ca-af1e-fc58d5f841ea None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:22.444104 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 185/370] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:22.452688 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d41fa-1550-47ca-af1e-fc58d5f841ea None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:22.489447 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91c02c-c489-497b-8069-e477b2ac3a45 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:22.555731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb1e92-8177-458f-afb7-32aad3d2e877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:22.556207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:22.556422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb1e92-8177-458f-afb7-32aad3d2e877 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:22.557070 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb1e92-8177-458f-afb7-32aad3d2e877 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:22.557350 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb1e92-8177-458f-afb7-32aad3d2e877 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:22.574906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb1e92-8177-458f-afb7-32aad3d2e877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b1bb1e92-8177-458f-afb7-32aad3d2e877 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:22.581420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:22.582311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:22.583509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:22.583509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:22.583509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:22.583509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:22.583509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:22.583509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:22.583509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:22.583509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:22.583509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:22.583509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:22.583509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:50:22.583509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:22.583509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 186/371] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:50:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:22.590507 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb1e92-8177-458f-afb7-32aad3d2e877 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:22.616412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d41fa-1550-47ca-af1e-fc58d5f841ea None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:22.661785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1fa8d-0ed7-46f2-a9ce-aa0255fba689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:22.662468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1fa8d-0ed7-46f2-a9ce-aa0255fba689 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:22.668500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1fa8d-0ed7-46f2-a9ce-aa0255fba689 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:22.668500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1fa8d-0ed7-46f2-a9ce-aa0255fba689 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:22.726362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:22.734407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb1e92-8177-458f-afb7-32aad3d2e877 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:22.754081 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1fa8d-0ed7-46f2-a9ce-aa0255fba689 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:22.755590 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1fa8d-0ed7-46f2-a9ce-aa0255fba689 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:22.783259 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb093fd6-b00e-4072-8a76-78b6d1bb9106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:22.783912 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb093fd6-b00e-4072-8a76-78b6d1bb9106 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:22.784203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb093fd6-b00e-4072-8a76-78b6d1bb9106 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:22.784639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb093fd6-b00e-4072-8a76-78b6d1bb9106 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:22.785650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb093fd6-b00e-4072-8a76-78b6d1bb9106 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:22.786158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb093fd6-b00e-4072-8a76-78b6d1bb9106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:22.787767 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb093fd6-b00e-4072-8a76-78b6d1bb9106 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:22.799681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 187/372] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:22.804997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb093fd6-b00e-4072-8a76-78b6d1bb9106 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:22.833738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:22.923825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 186/373] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:22.933116 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1fa8d-0ed7-46f2-a9ce-aa0255fba689 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:23.000440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb093fd6-b00e-4072-8a76-78b6d1bb9106 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:23.054736 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1fa8d-0ed7-46f2-a9ce-aa0255fba689 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:23.092201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57319b92-99d6-4b72-b163-b1354e086de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:23.092851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57319b92-99d6-4b72-b163-b1354e086de2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:23.093163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57319b92-99d6-4b72-b163-b1354e086de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:23.093402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57319b92-99d6-4b72-b163-b1354e086de2 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:23.094557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57319b92-99d6-4b72-b163-b1354e086de2 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:23.097062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57319b92-99d6-4b72-b163-b1354e086de2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:23.098711 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 187/374] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:22 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:23.104060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57319b92-99d6-4b72-b163-b1354e086de2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:23.104503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43059eb9-b9a6-413b-8eed-de35aa7ab22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:23.105259 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059eb9-b9a6-413b-8eed-de35aa7ab22d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:23.105545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059eb9-b9a6-413b-8eed-de35aa7ab22d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:23.105858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43059eb9-b9a6-413b-8eed-de35aa7ab22d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:23.132622 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:23.179398 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:23.211887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57319b92-99d6-4b72-b163-b1354e086de2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:23.250075 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468384be-fd86-4f43-a059-a85c5f9e2ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:23.250777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468384be-fd86-4f43-a059-a85c5f9e2ffc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:23.250999 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468384be-fd86-4f43-a059-a85c5f9e2ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:23.251271 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468384be-fd86-4f43-a059-a85c5f9e2ffc None admin] PATH_INFO: `/v3/groups/e85759ecd1bf454f8af70e9447b8300e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:23.252446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468384be-fd86-4f43-a059-a85c5f9e2ffc None admin] RBAC: Authorizing `identity:get_group(group_id=e85759ecd1bf454f8af70e9447b8300e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:23.254002 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468384be-fd86-4f43-a059-a85c5f9e2ffc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:23.255929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 188/375] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:23 2022] GET /identity/v3/groups/e85759ecd1bf454f8af70e9447b8300e => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:23.261726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468384be-fd86-4f43-a059-a85c5f9e2ffc None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:23.324690 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43059eb9-b9a6-413b-8eed-de35aa7ab22d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:23.326223 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43059eb9-b9a6-413b-8eed-de35aa7ab22d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:23.362802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:23.371429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468384be-fd86-4f43-a059-a85c5f9e2ffc None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:23.409059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b16bb-49b4-4757-b342-5ecc4bd63079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:23.409688 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b16bb-49b4-4757-b342-5ecc4bd63079 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:23.409967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b16bb-49b4-4757-b342-5ecc4bd63079 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:23.410238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b16bb-49b4-4757-b342-5ecc4bd63079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:23.411062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b16bb-49b4-4757-b342-5ecc4bd63079 None admin] RBAC: Adding query filter params (group.id=e85759ecd1bf454f8af70e9447b8300e, role.id=d78c47b14910477fa17f456efbbc177c, scope.project.id=ba004675284d4e2fb1037370cf5a047e) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:23.411377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b16bb-49b4-4757-b342-5ecc4bd63079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:23.414015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1b16bb-49b4-4757-b342-5ecc4bd63079 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:23.420845 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 189/376] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 24 07:50:23 2022] GET /identity/v3/role_assignments?group.id=e85759ecd1bf454f8af70e9447b8300e&scope.project.id=ba004675284d4e2fb1037370cf5a047e&role.id=d78c47b14910477fa17f456efbbc177c => generated 260 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:23.536137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 188/377] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 731 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:23.542558 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b16bb-49b4-4757-b342-5ecc4bd63079 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:23.668788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b16bb-49b4-4757-b342-5ecc4bd63079 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:23.705834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cb9f80-9c85-4d53-aa6d-5271bba07d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:23.706474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb9f80-9c85-4d53-aa6d-5271bba07d18 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:23.706752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb9f80-9c85-4d53-aa6d-5271bba07d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:23.707025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cb9f80-9c85-4d53-aa6d-5271bba07d18 None admin] PATH_INFO: `/v3/projects/853a156fb9564ec38e1fef2222e14a94` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:23.708203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb9f80-9c85-4d53-aa6d-5271bba07d18 None admin] RBAC: Authorizing `identity:get_project(project_id=853a156fb9564ec38e1fef2222e14a94)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:23.709635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cb9f80-9c85-4d53-aa6d-5271bba07d18 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:23.711615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 190/378] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:23 2022] GET /identity/v3/projects/853a156fb9564ec38e1fef2222e14a94 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:23.718243 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43059eb9-b9a6-413b-8eed-de35aa7ab22d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:23.818669 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:23.868131 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43059eb9-b9a6-413b-8eed-de35aa7ab22d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:23.904796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77907df0-58f9-4516-a5fe-360b511ce2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:23.905455 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77907df0-58f9-4516-a5fe-360b511ce2ee None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:23.905735 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77907df0-58f9-4516-a5fe-360b511ce2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:23.906010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77907df0-58f9-4516-a5fe-360b511ce2ee None admin] PATH_INFO: `/v3/groups/57a130dfb0114428a5ee035ea4346391` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:23.912475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77907df0-58f9-4516-a5fe-360b511ce2ee None admin] RBAC: Authorizing `identity:get_group(group_id=57a130dfb0114428a5ee035ea4346391)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:23.913924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77907df0-58f9-4516-a5fe-360b511ce2ee None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:23.915897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 189/379] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:23 2022] GET /identity/v3/groups/57a130dfb0114428a5ee035ea4346391 => generated 229 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:23.918368 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94a27c-7c16-4698-83eb-655dee2759d7 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:23.918842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94a27c-7c16-4698-83eb-655dee2759d7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:23.918920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e94a27c-7c16-4698-83eb-655dee2759d7 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:23.921219 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 191/380] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:23.923484 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77907df0-58f9-4516-a5fe-360b511ce2ee None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:23.929822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3365e-a302-4e8c-bac8-46226283ca09 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:23.930145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3365e-a302-4e8c-bac8-46226283ca09 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:23.930368 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3365e-a302-4e8c-bac8-46226283ca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:23.970522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d2f3365e-a302-4e8c-bac8-46226283ca09 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:23.972116 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d2f3365e-a302-4e8c-bac8-46226283ca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:24.012938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:24.057900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77907df0-58f9-4516-a5fe-360b511ce2ee None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:24.086082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:24.104621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873d729-4f3f-433a-81b3-57aa816cfac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:24.105237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873d729-4f3f-433a-81b3-57aa816cfac8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:24.105517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873d729-4f3f-433a-81b3-57aa816cfac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:24.105787 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873d729-4f3f-433a-81b3-57aa816cfac8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:24.106523 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873d729-4f3f-433a-81b3-57aa816cfac8 None admin] RBAC: Adding query filter params (group.id=57a130dfb0114428a5ee035ea4346391, role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=853a156fb9564ec38e1fef2222e14a94) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:24.106828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873d729-4f3f-433a-81b3-57aa816cfac8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:24.109515 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4873d729-4f3f-433a-81b3-57aa816cfac8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:24.125321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 190/381] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 24 07:50:23 2022] GET /identity/v3/role_assignments?group.id=57a130dfb0114428a5ee035ea4346391&scope.project.id=853a156fb9564ec38e1fef2222e14a94&role.id=68b1888f7bb644a39938b8d41006a813 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:24.125609 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 192/382] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:24.510090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873d729-4f3f-433a-81b3-57aa816cfac8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:24.640310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dfb5c-7703-41f7-8d63-fbbc64f5d564 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:24.640488 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dfb5c-7703-41f7-8d63-fbbc64f5d564 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:24.640766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285dfb5c-7703-41f7-8d63-fbbc64f5d564 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:24.642345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 193/383] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:24.646271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873d729-4f3f-433a-81b3-57aa816cfac8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:24.648061 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec32116-56cf-446c-931a-11407163ad3a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:24.648350 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec32116-56cf-446c-931a-11407163ad3a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:24.648630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec32116-56cf-446c-931a-11407163ad3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:24.684508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94851b2-60dd-4985-83ec-1f5ba503632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:24.685140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94851b2-60dd-4985-83ec-1f5ba503632d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:24.685996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94851b2-60dd-4985-83ec-1f5ba503632d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:24.686275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94851b2-60dd-4985-83ec-1f5ba503632d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:24.689457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3ec32116-56cf-446c-931a-11407163ad3a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:24.690737 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3ec32116-56cf-446c-931a-11407163ad3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:24.699361 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94851b2-60dd-4985-83ec-1f5ba503632d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b94851b2-60dd-4985-83ec-1f5ba503632d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:24.707392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:24.708362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:24.709161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:24.709161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:24.709161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:24.709161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:24.709161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:24.709161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:24.709161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:24.709161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:24.709161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:24.709161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:24.709161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:24.709161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:24.710443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 191/384] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:24.716666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94851b2-60dd-4985-83ec-1f5ba503632d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:24.773140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:24.827062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 194/385] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:24.831110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94851b2-60dd-4985-83ec-1f5ba503632d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:24.867448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6d01c0-c0fc-45a5-a8cc-5229a5609e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:24.868452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d01c0-c0fc-45a5-a8cc-5229a5609e46 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:24.868974 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d01c0-c0fc-45a5-a8cc-5229a5609e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:24.869436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6d01c0-c0fc-45a5-a8cc-5229a5609e46 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:24.870298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d01c0-c0fc-45a5-a8cc-5229a5609e46 None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:24.870791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d01c0-c0fc-45a5-a8cc-5229a5609e46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:24.872396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6d01c0-c0fc-45a5-a8cc-5229a5609e46 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:24.887601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 192/386] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:24.890375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec32116-56cf-446c-931a-11407163ad3a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:24.984707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:25.005725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec32116-56cf-446c-931a-11407163ad3a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:25.010330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473217d-4563-45bf-8f40-4888482dabf0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:25.010866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473217d-4563-45bf-8f40-4888482dabf0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:25.011354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473217d-4563-45bf-8f40-4888482dabf0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:25.014500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 193/387] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:25.018913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9fd37-5810-42cd-abcb-d2ba6a102bf8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:25.019412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9fd37-5810-42cd-abcb-d2ba6a102bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:25.019908 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b9fd37-5810-42cd-abcb-d2ba6a102bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:25.039823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-01b9fd37-5810-42cd-abcb-d2ba6a102bf8 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:25.041364 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-01b9fd37-5810-42cd-abcb-d2ba6a102bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:25.057981 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342f0ad-19e8-47d3-ac71-1048cfa8e829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:25.057981 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342f0ad-19e8-47d3-ac71-1048cfa8e829 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:25.058262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342f0ad-19e8-47d3-ac71-1048cfa8e829 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:25.058504 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342f0ad-19e8-47d3-ac71-1048cfa8e829 None admin] PATH_INFO: `/v3/groups/e85759ecd1bf454f8af70e9447b8300e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:25.064549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342f0ad-19e8-47d3-ac71-1048cfa8e829 None admin] RBAC: Authorizing `identity:get_group(group_id=e85759ecd1bf454f8af70e9447b8300e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:25.066006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f342f0ad-19e8-47d3-ac71-1048cfa8e829 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:25.071869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 195/388] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:24 2022] GET /identity/v3/groups/e85759ecd1bf454f8af70e9447b8300e => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:25.084994 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342f0ad-19e8-47d3-ac71-1048cfa8e829 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:25.136661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 194/389] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:50:25.197899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342f0ad-19e8-47d3-ac71-1048cfa8e829 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:25.204918 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9fd37-5810-42cd-abcb-d2ba6a102bf8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:25.234375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798425a1-c15f-431c-84d4-e391c5c0f7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:25.235905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798425a1-c15f-431c-84d4-e391c5c0f7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:25.235905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798425a1-c15f-431c-84d4-e391c5c0f7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:25.235905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798425a1-c15f-431c-84d4-e391c5c0f7d7 None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:25.236732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798425a1-c15f-431c-84d4-e391c5c0f7d7 None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:25.238169 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798425a1-c15f-431c-84d4-e391c5c0f7d7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:25.242750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 196/390] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:25 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:25.265528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798425a1-c15f-431c-84d4-e391c5c0f7d7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:25.270015 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:25.308360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:25.333404 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b9fd37-5810-42cd-abcb-d2ba6a102bf8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:25.369352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbff687-c8eb-4698-9da1-672e9c481912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:25.370207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbff687-c8eb-4698-9da1-672e9c481912 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:25.370590 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbff687-c8eb-4698-9da1-672e9c481912 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:25.370962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbff687-c8eb-4698-9da1-672e9c481912 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:25.394875 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbff687-c8eb-4698-9da1-672e9c481912 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-edbff687-c8eb-4698-9da1-672e9c481912 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:25.400631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:25.401546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:25.402356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:25.402356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:25.402356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:25.402356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:25.402356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:25.402356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:25.402356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:25.402356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:25.402356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:25.402356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:25.402356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:25.402356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:25.402356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 195/391] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:50:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:25.408206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbff687-c8eb-4698-9da1-672e9c481912 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:25.469038 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798425a1-c15f-431c-84d4-e391c5c0f7d7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:25.512208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:25.517038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbff687-c8eb-4698-9da1-672e9c481912 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:25.541694 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18956d-c624-4111-8550-1796136bc82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:25.543626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18956d-c624-4111-8550-1796136bc82d None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:25.547170 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18956d-c624-4111-8550-1796136bc82d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:25.547900 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb18956d-c624-4111-8550-1796136bc82d None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c/groups/e85759ecd1bf454f8af70e9447b8300e/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:25.550153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18956d-c624-4111-8550-1796136bc82d None admin] RBAC: Authorizing `identity:create_grant(project_id=48ad6ef4173e4919a439dd1e407c850c, group_id=e85759ecd1bf454f8af70e9447b8300e, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:25.551857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb18956d-c624-4111-8550-1796136bc82d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:25.575173 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810b107-b4d5-4541-8d60-94b96530ffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:25.575821 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810b107-b4d5-4541-8d60-94b96530ffde None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:25.576915 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810b107-b4d5-4541-8d60-94b96530ffde None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:25.577422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1810b107-b4d5-4541-8d60-94b96530ffde None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:25.578286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810b107-b4d5-4541-8d60-94b96530ffde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:25.578598 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810b107-b4d5-4541-8d60-94b96530ffde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:25.580053 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1810b107-b4d5-4541-8d60-94b96530ffde None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:25.589279 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 196/392] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:25.594713 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810b107-b4d5-4541-8d60-94b96530ffde None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:25.631539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 197/393] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Aug 24 07:50:25 2022] PUT /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c/groups/e85759ecd1bf454f8af70e9447b8300e/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:25.633224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18956d-c624-4111-8550-1796136bc82d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:25.746526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:25.748440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1810b107-b4d5-4541-8d60-94b96530ffde None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:25.773560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb18956d-c624-4111-8550-1796136bc82d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:25.816492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e3b9b-5df9-497e-ad4a-cfdafe8c87e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:25.817422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e3b9b-5df9-497e-ad4a-cfdafe8c87e4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:25.817852 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e3b9b-5df9-497e-ad4a-cfdafe8c87e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:25.818272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e3b9b-5df9-497e-ad4a-cfdafe8c87e4 None admin] PATH_INFO: `/v3/groups/e85759ecd1bf454f8af70e9447b8300e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:25.821317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e379060-d957-4a8a-b950-1a4cc3b16d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:25.821997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e3b9b-5df9-497e-ad4a-cfdafe8c87e4 None admin] RBAC: Authorizing `identity:get_group(group_id=e85759ecd1bf454f8af70e9447b8300e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:25.822115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e379060-d957-4a8a-b950-1a4cc3b16d49 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:25.822380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e379060-d957-4a8a-b950-1a4cc3b16d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:25.822706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e379060-d957-4a8a-b950-1a4cc3b16d49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:25.824090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e3b9b-5df9-497e-ad4a-cfdafe8c87e4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:25.826846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 197/394] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:25 2022] GET /identity/v3/groups/e85759ecd1bf454f8af70e9447b8300e => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:25.832073 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e3b9b-5df9-497e-ad4a-cfdafe8c87e4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:25.834737 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e379060-d957-4a8a-b950-1a4cc3b16d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-9e379060-d957-4a8a-b950-1a4cc3b16d49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:25.840100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:25.841030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:25.842708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:25.842708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:25.842708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:25.842708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:25.842708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:25.842708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:25.842708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:25.842708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:25.842708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:25.842708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:25.842708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:25.842708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:25.843563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 198/395] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:25.849023 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e379060-d957-4a8a-b950-1a4cc3b16d49 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:25.870520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:25.950735 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e3b9b-5df9-497e-ad4a-cfdafe8c87e4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:25.956993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e379060-d957-4a8a-b950-1a4cc3b16d49 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:25.990947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba671e-0f8a-49fa-b026-ff9ca2be02bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:25.991588 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba671e-0f8a-49fa-b026-ff9ca2be02bf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:25.992038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba671e-0f8a-49fa-b026-ff9ca2be02bf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:25.992313 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba671e-0f8a-49fa-b026-ff9ca2be02bf None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:25.993611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba671e-0f8a-49fa-b026-ff9ca2be02bf None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:25.994958 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21614e14-e9c2-4e91-bcf3-314263a232b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:25.995426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba671e-0f8a-49fa-b026-ff9ca2be02bf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:25.995609 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21614e14-e9c2-4e91-bcf3-314263a232b6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:25.995856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21614e14-e9c2-4e91-bcf3-314263a232b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:25.996134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21614e14-e9c2-4e91-bcf3-314263a232b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:25.996854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21614e14-e9c2-4e91-bcf3-314263a232b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:25.997087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 198/396] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:25 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:25.997188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21614e14-e9c2-4e91-bcf3-314263a232b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:25.998880 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69f4b4-a8a5-458a-b21c-a2abdad74e37 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:25.999047 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21614e14-e9c2-4e91-bcf3-314263a232b6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:25.999201 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69f4b4-a8a5-458a-b21c-a2abdad74e37 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:25.999468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69f4b4-a8a5-458a-b21c-a2abdad74e37 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:26.006096 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 199/397] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:25 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:26.006884 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69f4b4-a8a5-458a-b21c-a2abdad74e37 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:26.009403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 199/398] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:26.017364 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4be2c-8337-4dda-b8b2-06ecb1155dab None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:26.017645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4be2c-8337-4dda-b8b2-06ecb1155dab None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:26.017914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4be2c-8337-4dda-b8b2-06ecb1155dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:26.036563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-79c4be2c-8337-4dda-b8b2-06ecb1155dab None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:26.037850 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79c4be2c-8337-4dda-b8b2-06ecb1155dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:26.060195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:26.116048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 200/399] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:26.116971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4be2c-8337-4dda-b8b2-06ecb1155dab None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:26.118413 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:26.125748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69f4b4-a8a5-458a-b21c-a2abdad74e37 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:26.162509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b806b1-55bd-4039-b9f9-45697722be17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:26.163172 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b806b1-55bd-4039-b9f9-45697722be17 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:26.163456 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b806b1-55bd-4039-b9f9-45697722be17 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:26.163728 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b806b1-55bd-4039-b9f9-45697722be17 None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c/groups/e85759ecd1bf454f8af70e9447b8300e/roles/d78c47b14910477fa17f456efbbc177c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:26.165941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b806b1-55bd-4039-b9f9-45697722be17 None admin] RBAC: Authorizing `identity:create_grant(project_id=48ad6ef4173e4919a439dd1e407c850c, group_id=e85759ecd1bf454f8af70e9447b8300e, role_id=d78c47b14910477fa17f456efbbc177c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:26.167395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b806b1-55bd-4039-b9f9-45697722be17 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:26.234893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4be2c-8337-4dda-b8b2-06ecb1155dab None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:26.244533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 200/400] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Aug 24 07:50:26 2022] PUT /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c/groups/e85759ecd1bf454f8af70e9447b8300e/roles/d78c47b14910477fa17f456efbbc177c => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:26.270459 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:26.275701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab6a9f-54a3-4bc4-9bce-2847e146a75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:26.276392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab6a9f-54a3-4bc4-9bce-2847e146a75a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:26.276668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab6a9f-54a3-4bc4-9bce-2847e146a75a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:26.276937 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab6a9f-54a3-4bc4-9bce-2847e146a75a None admin] PATH_INFO: `/v3/groups/e85759ecd1bf454f8af70e9447b8300e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:26.278168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab6a9f-54a3-4bc4-9bce-2847e146a75a None admin] RBAC: Authorizing `identity:get_group(group_id=e85759ecd1bf454f8af70e9447b8300e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:26.280728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cab6a9f-54a3-4bc4-9bce-2847e146a75a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:26.285347 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 201/401] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:26 2022] GET /identity/v3/groups/e85759ecd1bf454f8af70e9447b8300e => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:26.288513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b806b1-55bd-4039-b9f9-45697722be17 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:26.404726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b806b1-55bd-4039-b9f9-45697722be17 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:26.441999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c735e-6b93-48f6-8fc3-db21b4d9d6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:26.442638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c735e-6b93-48f6-8fc3-db21b4d9d6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:26.442916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c735e-6b93-48f6-8fc3-db21b4d9d6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:26.443185 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c735e-6b93-48f6-8fc3-db21b4d9d6d9 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:26.444351 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c735e-6b93-48f6-8fc3-db21b4d9d6d9 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:26.445765 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c735e-6b93-48f6-8fc3-db21b4d9d6d9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:26.447683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 201/402] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:26 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:26.454702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab6a9f-54a3-4bc4-9bce-2847e146a75a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:26.559710 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cab6a9f-54a3-4bc4-9bce-2847e146a75a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:26.573972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c735e-6b93-48f6-8fc3-db21b4d9d6d9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:26.604578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1630d70-6fd2-443c-aa00-54ea05dd2e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:26.605244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630d70-6fd2-443c-aa00-54ea05dd2e62 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:26.605522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630d70-6fd2-443c-aa00-54ea05dd2e62 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:26.605790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1630d70-6fd2-443c-aa00-54ea05dd2e62 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e/groups/e85759ecd1bf454f8af70e9447b8300e/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:26.608140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1630d70-6fd2-443c-aa00-54ea05dd2e62 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba004675284d4e2fb1037370cf5a047e, group_id=e85759ecd1bf454f8af70e9447b8300e, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:26.609919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1630d70-6fd2-443c-aa00-54ea05dd2e62 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:26.638896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:26.722457 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c735e-6b93-48f6-8fc3-db21b4d9d6d9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:26.728183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 202/403] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Aug 24 07:50:26 2022] PUT /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e/groups/e85759ecd1bf454f8af70e9447b8300e/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:26.762343 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b9db9-93cf-4d3c-9b46-5355417588ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:26.763055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b9db9-93cf-4d3c-9b46-5355417588ce None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:26.763346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b9db9-93cf-4d3c-9b46-5355417588ce None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:26.764280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b9db9-93cf-4d3c-9b46-5355417588ce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:26.777023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b9db9-93cf-4d3c-9b46-5355417588ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-312b9db9-93cf-4d3c-9b46-5355417588ce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:26.783444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:26.784446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:26.785269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:26.785269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:26.785269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:26.785269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:26.785269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:26.785269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:26.785269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:26.785269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:26.785269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:26.785269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:26.785269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:26.785269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:26.785269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 202/404] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:50:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:26.791821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1630d70-6fd2-443c-aa00-54ea05dd2e62 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:26.879424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:26.889265 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073f396-1931-4ede-aa64-bb3d7d553f84 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:26.891490 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073f396-1931-4ede-aa64-bb3d7d553f84 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:26.891490 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6073f396-1931-4ede-aa64-bb3d7d553f84 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:26.891490 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 203/405] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:50:26.896801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1db7b5-51c3-4b00-a876-7f5e03066511 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:26.897081 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1db7b5-51c3-4b00-a876-7f5e03066511 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:26.897359 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1db7b5-51c3-4b00-a876-7f5e03066511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:26.938008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3f1db7b5-51c3-4b00-a876-7f5e03066511 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:26.939238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3f1db7b5-51c3-4b00-a876-7f5e03066511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:26.942327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1630d70-6fd2-443c-aa00-54ea05dd2e62 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:26.987424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413360e-4492-41e7-9070-667cfe2f13e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:26.988497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413360e-4492-41e7-9070-667cfe2f13e7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:26.989024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413360e-4492-41e7-9070-667cfe2f13e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:26.989485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1413360e-4492-41e7-9070-667cfe2f13e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:26.990453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413360e-4492-41e7-9070-667cfe2f13e7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:26.990968 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413360e-4492-41e7-9070-667cfe2f13e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:26.992929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1413360e-4492-41e7-9070-667cfe2f13e7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:27.003304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 203/406] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:27.008573 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413360e-4492-41e7-9070-667cfe2f13e7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:27.018388 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 204/407] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:50:27.122240 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1413360e-4492-41e7-9070-667cfe2f13e7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:27.146794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:27.165869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f415160-54dc-47d1-a564-1ac9f63bdbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:27.166626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f415160-54dc-47d1-a564-1ac9f63bdbac None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:27.166913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f415160-54dc-47d1-a564-1ac9f63bdbac None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:27.167231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f415160-54dc-47d1-a564-1ac9f63bdbac None admin] PATH_INFO: `/v3/groups/e85759ecd1bf454f8af70e9447b8300e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:27.168414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f415160-54dc-47d1-a564-1ac9f63bdbac None admin] RBAC: Authorizing `identity:get_group(group_id=e85759ecd1bf454f8af70e9447b8300e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:27.170066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f415160-54dc-47d1-a564-1ac9f63bdbac None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:27.171641 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 204/408] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:27 2022] GET /identity/v3/groups/e85759ecd1bf454f8af70e9447b8300e => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:27.177380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1db7b5-51c3-4b00-a876-7f5e03066511 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:27.212231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:27.307654 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1db7b5-51c3-4b00-a876-7f5e03066511 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:27.344617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b88ebe-5a5d-4b79-b7d7-36dfb66e31ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:27.345255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88ebe-5a5d-4b79-b7d7-36dfb66e31ef None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:27.345535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88ebe-5a5d-4b79-b7d7-36dfb66e31ef None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:27.345804 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b88ebe-5a5d-4b79-b7d7-36dfb66e31ef None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:27.346977 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b88ebe-5a5d-4b79-b7d7-36dfb66e31ef None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:27.348501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b88ebe-5a5d-4b79-b7d7-36dfb66e31ef None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:27.350151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 205/409] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:27 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:27.355870 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f415160-54dc-47d1-a564-1ac9f63bdbac None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:27.511574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f415160-54dc-47d1-a564-1ac9f63bdbac None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:27.556582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e369665-11f0-4443-ad9d-34a209c74823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:27.557484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e369665-11f0-4443-ad9d-34a209c74823 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:27.557908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e369665-11f0-4443-ad9d-34a209c74823 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:27.558338 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e369665-11f0-4443-ad9d-34a209c74823 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e/groups/e85759ecd1bf454f8af70e9447b8300e/roles/d78c47b14910477fa17f456efbbc177c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:27.562059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e369665-11f0-4443-ad9d-34a209c74823 None admin] RBAC: Authorizing `identity:create_grant(project_id=ba004675284d4e2fb1037370cf5a047e, group_id=e85759ecd1bf454f8af70e9447b8300e, role_id=d78c47b14910477fa17f456efbbc177c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:27.562203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b88ebe-5a5d-4b79-b7d7-36dfb66e31ef None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:27.563747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e369665-11f0-4443-ad9d-34a209c74823 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:27.651563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:27.658234 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 205/410] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Aug 24 07:50:27 2022] PUT /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e/groups/e85759ecd1bf454f8af70e9447b8300e/roles/d78c47b14910477fa17f456efbbc177c => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:27.676349 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b88ebe-5a5d-4b79-b7d7-36dfb66e31ef None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:27.713779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7519c8b-55ac-4bfc-afa7-850714cab83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:27.714427 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7519c8b-55ac-4bfc-afa7-850714cab83d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:27.714708 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7519c8b-55ac-4bfc-afa7-850714cab83d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:27.715241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7519c8b-55ac-4bfc-afa7-850714cab83d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:27.735258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7519c8b-55ac-4bfc-afa7-850714cab83d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b7519c8b-55ac-4bfc-afa7-850714cab83d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:27.740648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:27.743786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:27.744625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:27.744625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:27.744625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:27.744625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:27.744625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:27.744625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:27.744625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:27.744625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:27.744625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:27.744625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:27.744625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:50:27.744625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:27.744625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 206/411] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:50:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:27.750522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e369665-11f0-4443-ad9d-34a209c74823 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:27.832331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:27.881185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e369665-11f0-4443-ad9d-34a209c74823 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:27.916305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c53eff1-c8a2-4d86-b3ea-398b24495487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:27.916926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53eff1-c8a2-4d86-b3ea-398b24495487 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:27.917205 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53eff1-c8a2-4d86-b3ea-398b24495487 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:27.917475 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c53eff1-c8a2-4d86-b3ea-398b24495487 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:27.918138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53eff1-c8a2-4d86-b3ea-398b24495487 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:27.918439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53eff1-c8a2-4d86-b3ea-398b24495487 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:27.920636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c53eff1-c8a2-4d86-b3ea-398b24495487 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:27.930084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 206/412] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:27.936034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7519c8b-55ac-4bfc-afa7-850714cab83d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:27.970933 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad3ff3-5e78-4213-bfe7-f2b77ef8d2d2 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:27.971248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad3ff3-5e78-4213-bfe7-f2b77ef8d2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:27.971832 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad3ff3-5e78-4213-bfe7-f2b77ef8d2d2 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:27.973733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 207/413] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:50:27.980350 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e46ebc-0bcd-4f97-baf9-555e7eeb53df None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:27.980638 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e46ebc-0bcd-4f97-baf9-555e7eeb53df None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:27.980911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e46ebc-0bcd-4f97-baf9-555e7eeb53df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:28.001939 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-24e46ebc-0bcd-4f97-baf9-555e7eeb53df None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:28.003159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-24e46ebc-0bcd-4f97-baf9-555e7eeb53df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:28.082699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 208/414] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:28.119809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7519c8b-55ac-4bfc-afa7-850714cab83d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:28.157286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f3f88-e879-48b9-8034-36add5e4a26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:28.157931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f3f88-e879-48b9-8034-36add5e4a26e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:28.158210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f3f88-e879-48b9-8034-36add5e4a26e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:28.158484 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f3f88-e879-48b9-8034-36add5e4a26e None admin] PATH_INFO: `/v3/groups/57a130dfb0114428a5ee035ea4346391` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:28.159639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f3f88-e879-48b9-8034-36add5e4a26e None admin] RBAC: Authorizing `identity:get_group(group_id=57a130dfb0114428a5ee035ea4346391)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:28.161100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f3f88-e879-48b9-8034-36add5e4a26e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:28.162969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 207/415] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:27 2022] GET /identity/v3/groups/57a130dfb0114428a5ee035ea4346391 => generated 229 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:28.168565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e46ebc-0bcd-4f97-baf9-555e7eeb53df None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:28.240218 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:28.302550 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e46ebc-0bcd-4f97-baf9-555e7eeb53df None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:28.337674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5ab3f-69c9-4da4-b6d0-d85e2bd5997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:28.338229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5ab3f-69c9-4da4-b6d0-d85e2bd5997d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:28.338509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5ab3f-69c9-4da4-b6d0-d85e2bd5997d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:28.338824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e5ab3f-69c9-4da4-b6d0-d85e2bd5997d None admin] PATH_INFO: `/v3/projects/853a156fb9564ec38e1fef2222e14a94` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:28.340274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5ab3f-69c9-4da4-b6d0-d85e2bd5997d None admin] RBAC: Authorizing `identity:get_project(project_id=853a156fb9564ec38e1fef2222e14a94)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:28.342413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e5ab3f-69c9-4da4-b6d0-d85e2bd5997d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:28.344603 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 209/416] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:28 2022] GET /identity/v3/projects/853a156fb9564ec38e1fef2222e14a94 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:28.350330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f3f88-e879-48b9-8034-36add5e4a26e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:28.379222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:28.413357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5ab3f-69c9-4da4-b6d0-d85e2bd5997d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:28.535615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f3f88-e879-48b9-8034-36add5e4a26e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:28.573945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd34c1-e9f1-4c43-9fe5-1e6309d45b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:28.574656 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd34c1-e9f1-4c43-9fe5-1e6309d45b9c None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:28.574943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd34c1-e9f1-4c43-9fe5-1e6309d45b9c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:28.575219 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd34c1-e9f1-4c43-9fe5-1e6309d45b9c None admin] PATH_INFO: `/v3/projects/853a156fb9564ec38e1fef2222e14a94/groups/57a130dfb0114428a5ee035ea4346391/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:28.578091 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd34c1-e9f1-4c43-9fe5-1e6309d45b9c None admin] RBAC: Authorizing `identity:create_grant(project_id=853a156fb9564ec38e1fef2222e14a94, group_id=57a130dfb0114428a5ee035ea4346391, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:28.579529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd34c1-e9f1-4c43-9fe5-1e6309d45b9c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:28.620209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e5ab3f-69c9-4da4-b6d0-d85e2bd5997d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:28.632103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:28.662783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 208/417] 10.222.0.62 () {58 vars in 1442 bytes} [Wed Aug 24 07:50:28 2022] PUT /identity/v3/projects/853a156fb9564ec38e1fef2222e14a94/groups/57a130dfb0114428a5ee035ea4346391/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:28.663306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dce5b4-4342-4616-90e7-1113b5b6f233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:28.664027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce5b4-4342-4616-90e7-1113b5b6f233 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:28.664311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce5b4-4342-4616-90e7-1113b5b6f233 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:28.664753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dce5b4-4342-4616-90e7-1113b5b6f233 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:28.677390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dce5b4-4342-4616-90e7-1113b5b6f233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-89dce5b4-4342-4616-90e7-1113b5b6f233 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:28.682418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:28.684538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:28.686631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:28.686631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:28.686631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:28.686631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:28.686631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:28.686631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:28.686631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:28.686631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:28.686631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:28.686631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:28.686631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:28.686631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:28.687766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 210/418] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:28.690411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd34c1-e9f1-4c43-9fe5-1e6309d45b9c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:28.771860 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:28.806460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd34c1-e9f1-4c43-9fe5-1e6309d45b9c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:28.843662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57140e6e-f93d-4462-ac28-14f1ab113eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:28.844329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57140e6e-f93d-4462-ac28-14f1ab113eba None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:28.844609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57140e6e-f93d-4462-ac28-14f1ab113eba None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:28.844885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57140e6e-f93d-4462-ac28-14f1ab113eba None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:28.845561 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57140e6e-f93d-4462-ac28-14f1ab113eba None admin] RBAC: Adding query filter params (name=member) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:28.845867 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57140e6e-f93d-4462-ac28-14f1ab113eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:28.847250 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57140e6e-f93d-4462-ac28-14f1ab113eba None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:28.858641 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 209/419] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:28.864534 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dce5b4-4342-4616-90e7-1113b5b6f233 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:28.917595 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1423c-f829-4d45-83fd-f82ec39b4c8b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:28.917873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1423c-f829-4d45-83fd-f82ec39b4c8b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:28.918073 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e1423c-f829-4d45-83fd-f82ec39b4c8b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:28.920615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 210/420] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:50:28.925564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4c0a0-5440-4eb0-ba45-b93a089cfdb7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:28.925853 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4c0a0-5440-4eb0-ba45-b93a089cfdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:28.926132 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4c0a0-5440-4eb0-ba45-b93a089cfdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:28.948009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-63a4c0a0-5440-4eb0-ba45-b93a089cfdb7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:28.949418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-63a4c0a0-5440-4eb0-ba45-b93a089cfdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:29.002142 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dce5b4-4342-4616-90e7-1113b5b6f233 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:29.035699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 211/421] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:29.037076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0cbf3-1ab7-4993-82c3-99538fe40a67 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:29.037360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0cbf3-1ab7-4993-82c3-99538fe40a67 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:29.037635 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0cbf3-1ab7-4993-82c3-99538fe40a67 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:29.039095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 212/422] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:29.044355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bea1bb-538a-4b36-bda0-8edf68be2d6b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:29.045107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052da3e-2b9d-4ed6-b4b8-3802209b09f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:29.045290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bea1bb-538a-4b36-bda0-8edf68be2d6b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:29.045438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bea1bb-538a-4b36-bda0-8edf68be2d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:29.045786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052da3e-2b9d-4ed6-b4b8-3802209b09f2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:29.046076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052da3e-2b9d-4ed6-b4b8-3802209b09f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:29.046346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7052da3e-2b9d-4ed6-b4b8-3802209b09f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:29.078136 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-64bea1bb-538a-4b36-bda0-8edf68be2d6b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:29.079342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-64bea1bb-538a-4b36-bda0-8edf68be2d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:29.126828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:29.168398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052da3e-2b9d-4ed6-b4b8-3802209b09f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:29.169941 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7052da3e-2b9d-4ed6-b4b8-3802209b09f2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:29.194735 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:29.215448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 213/423] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:29.274588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 211/424] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:29.280243 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bea1bb-538a-4b36-bda0-8edf68be2d6b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:29.398158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bea1bb-538a-4b36-bda0-8edf68be2d6b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:29.417368 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052da3e-2b9d-4ed6-b4b8-3802209b09f2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:29.440090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23dfd-8020-47fa-b645-e9a2e1dfa5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:29.440653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23dfd-8020-47fa-b645-e9a2e1dfa5c4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:29.440929 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23dfd-8020-47fa-b645-e9a2e1dfa5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:29.441199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c23dfd-8020-47fa-b645-e9a2e1dfa5c4 None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:29.443506 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c23dfd-8020-47fa-b645-e9a2e1dfa5c4 None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:29.444965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c23dfd-8020-47fa-b645-e9a2e1dfa5c4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:29.447771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 214/425] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:29 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:29.452724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23dfd-8020-47fa-b645-e9a2e1dfa5c4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:29.552169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:29.556320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:29.591679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7052da3e-2b9d-4ed6-b4b8-3802209b09f2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:29.594567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c23dfd-8020-47fa-b645-e9a2e1dfa5c4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:29.629322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241efb99-3298-4652-8a0c-f4e2c6b3d6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:29.630313 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241efb99-3298-4652-8a0c-f4e2c6b3d6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:29.630780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241efb99-3298-4652-8a0c-f4e2c6b3d6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:29.631262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241efb99-3298-4652-8a0c-f4e2c6b3d6f1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:29.631513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e08e5-0d7f-4230-95af-77193e27b59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:29.632376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e08e5-0d7f-4230-95af-77193e27b59b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:29.632655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e08e5-0d7f-4230-95af-77193e27b59b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:29.632974 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e08e5-0d7f-4230-95af-77193e27b59b None admin] PATH_INFO: `/v3/groups/e85759ecd1bf454f8af70e9447b8300e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:29.634086 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e08e5-0d7f-4230-95af-77193e27b59b None admin] RBAC: Authorizing `identity:get_group(group_id=e85759ecd1bf454f8af70e9447b8300e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:29.635509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75e08e5-0d7f-4230-95af-77193e27b59b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:29.637511 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 215/426] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:29 2022] GET /identity/v3/groups/e85759ecd1bf454f8af70e9447b8300e => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:29.638339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e08e5-0d7f-4230-95af-77193e27b59b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:29.642819 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241efb99-3298-4652-8a0c-f4e2c6b3d6f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-241efb99-3298-4652-8a0c-f4e2c6b3d6f1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:29.649501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:29.651612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:29.653588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:29.653588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:29.653588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:29.653588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:29.653588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:29.653588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:29.653588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:29.653588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:29.653588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:29.653588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:29.653588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:29.653588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:29.653588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 212/427] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:50:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:29.653588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241efb99-3298-4652-8a0c-f4e2c6b3d6f1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:29.748678 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75e08e5-0d7f-4230-95af-77193e27b59b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:29.767549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241efb99-3298-4652-8a0c-f4e2c6b3d6f1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:29.775766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:29.785349 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739f19b-4c0d-4e5f-9795-af443ef7d75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:29.786468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739f19b-4c0d-4e5f-9795-af443ef7d75b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:29.786636 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739f19b-4c0d-4e5f-9795-af443ef7d75b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:29.787072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b739f19b-4c0d-4e5f-9795-af443ef7d75b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:29.798027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b739f19b-4c0d-4e5f-9795-af443ef7d75b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:29.798681 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b739f19b-4c0d-4e5f-9795-af443ef7d75b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:29.803283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:29.804826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:29.805661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:29.805661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:29.805661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:29.805661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:29.805661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:29.805661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:29.805661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:29.805661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:29.805661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:29.805661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:29.805661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 07:50:29.805661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:29.805661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 216/428] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:29.806311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739f19b-4c0d-4e5f-9795-af443ef7d75b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:29.808048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a86be0-7ef2-4f51-ba56-e6393c81bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:29.808664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a86be0-7ef2-4f51-ba56-e6393c81bf5f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:29.808945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a86be0-7ef2-4f51-ba56-e6393c81bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:29.809218 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a86be0-7ef2-4f51-ba56-e6393c81bf5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:29.810009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a86be0-7ef2-4f51-ba56-e6393c81bf5f None admin] RBAC: Adding query filter params (group.id=e85759ecd1bf454f8af70e9447b8300e, role.id=75d9054a423c4c66b163c72c8ae7989c, scope.project.id=48ad6ef4173e4919a439dd1e407c850c) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:29.810402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a86be0-7ef2-4f51-ba56-e6393c81bf5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:29.812773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a86be0-7ef2-4f51-ba56-e6393c81bf5f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:29.818775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 213/429] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 24 07:50:29 2022] GET /identity/v3/role_assignments?group.id=e85759ecd1bf454f8af70e9447b8300e&scope.project.id=48ad6ef4173e4919a439dd1e407c850c&role.id=75d9054a423c4c66b163c72c8ae7989c => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:29.819691 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a86be0-7ef2-4f51-ba56-e6393c81bf5f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:29.920091 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b739f19b-4c0d-4e5f-9795-af443ef7d75b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:29.938314 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a86be0-7ef2-4f51-ba56-e6393c81bf5f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:29.957907 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2552b6-eeaa-4fdf-8d8e-ac3e65c75fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:29.958930 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2552b6-eeaa-4fdf-8d8e-ac3e65c75fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:29.959407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2552b6-eeaa-4fdf-8d8e-ac3e65c75fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:29.959893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2552b6-eeaa-4fdf-8d8e-ac3e65c75fb1 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:29.960765 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2552b6-eeaa-4fdf-8d8e-ac3e65c75fb1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:29.961262 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2552b6-eeaa-4fdf-8d8e-ac3e65c75fb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:29.962841 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2552b6-eeaa-4fdf-8d8e-ac3e65c75fb1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:29.972586 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 217/430] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:29.977371 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8c47-8d63-41a3-9e28-46a436296079 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:29.977965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8c47-8d63-41a3-9e28-46a436296079 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:29.978456 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf8c47-8d63-41a3-9e28-46a436296079 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:29.979976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b50fe-56b9-4eec-958c-fa4d23767650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:29.980653 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b50fe-56b9-4eec-958c-fa4d23767650 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:29.980866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 218/431] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:29.980963 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b50fe-56b9-4eec-958c-fa4d23767650 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:29.982741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b50fe-56b9-4eec-958c-fa4d23767650 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:29.982741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b50fe-56b9-4eec-958c-fa4d23767650 None admin] RBAC: Adding query filter params (name=member) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:29.982741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b50fe-56b9-4eec-958c-fa4d23767650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:29.984051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0b50fe-56b9-4eec-958c-fa4d23767650 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:29.984158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf8c47-8d63-41a3-9e28-46a436296079 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:29.994440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 214/432] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:50:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:29.995439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cc601-9681-4236-a7a0-f9015fd8d8b7 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:29.995724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cc601-9681-4236-a7a0-f9015fd8d8b7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:29.996022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4cc601-9681-4236-a7a0-f9015fd8d8b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:30.016285 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7b4cc601-9681-4236-a7a0-f9015fd8d8b7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:30.017476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7b4cc601-9681-4236-a7a0-f9015fd8d8b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:30.046382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:30.082511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:30.104747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf8c47-8d63-41a3-9e28-46a436296079 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:30.112603 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 215/433] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:30.113697 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cc601-9681-4236-a7a0-f9015fd8d8b7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:30.145362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dee29-f358-43dd-8dde-69bc13e7edcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:30.146137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dee29-f358-43dd-8dde-69bc13e7edcd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:30.146418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dee29-f358-43dd-8dde-69bc13e7edcd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:30.146688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dee29-f358-43dd-8dde-69bc13e7edcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:30.225223 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dee29-f358-43dd-8dde-69bc13e7edcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:30.226950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dee29-f358-43dd-8dde-69bc13e7edcd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:30.247173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4cc601-9681-4236-a7a0-f9015fd8d8b7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:30.286894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:30.296352 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51f0d6-1e6c-4b22-8d4b-2bf0300929e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:30.297254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51f0d6-1e6c-4b22-8d4b-2bf0300929e5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:30.297734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51f0d6-1e6c-4b22-8d4b-2bf0300929e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:30.298229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51f0d6-1e6c-4b22-8d4b-2bf0300929e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:30.356399 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 219/434] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:30.362849 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dee29-f358-43dd-8dde-69bc13e7edcd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:30.363289 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:30.377608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51f0d6-1e6c-4b22-8d4b-2bf0300929e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:30.379527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51f0d6-1e6c-4b22-8d4b-2bf0300929e5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:30.477347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dee29-f358-43dd-8dde-69bc13e7edcd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:30.499805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 216/435] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:30.501262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51f0d6-1e6c-4b22-8d4b-2bf0300929e5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:30.525460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258c079-acd9-4798-a30b-ba65661ae13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:30.525460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258c079-acd9-4798-a30b-ba65661ae13a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:30.525460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258c079-acd9-4798-a30b-ba65661ae13a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:30.525835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258c079-acd9-4798-a30b-ba65661ae13a None admin] PATH_INFO: `/v3/projects/48ad6ef4173e4919a439dd1e407c850c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:30.526820 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258c079-acd9-4798-a30b-ba65661ae13a None admin] RBAC: Authorizing `identity:get_project(project_id=48ad6ef4173e4919a439dd1e407c850c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:30.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258c079-acd9-4798-a30b-ba65661ae13a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:30.531460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 220/436] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:30 2022] GET /identity/v3/projects/48ad6ef4173e4919a439dd1e407c850c => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:30.532430 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258c079-acd9-4798-a30b-ba65661ae13a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:30.555739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:30.603872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:30.628062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51f0d6-1e6c-4b22-8d4b-2bf0300929e5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:30.663750 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258c079-acd9-4798-a30b-ba65661ae13a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:30.670011 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4e6c7-9021-4fa8-bfbc-a9c90751669b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:30.670648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4e6c7-9021-4fa8-bfbc-a9c90751669b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:30.670927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4e6c7-9021-4fa8-bfbc-a9c90751669b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:30.671193 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4e6c7-9021-4fa8-bfbc-a9c90751669b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:30.682371 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4e6c7-9021-4fa8-bfbc-a9c90751669b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-6ad4e6c7-9021-4fa8-bfbc-a9c90751669b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:30.687796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:30.692829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:30.693682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:30.693682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:30.693682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:30.693682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:30.693682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:30.693682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:30.693682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:30.693682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:30.693682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:30.693682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:30.693682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:30.693682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:30.693682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 217/437] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:50:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:30.693682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4e6c7-9021-4fa8-bfbc-a9c90751669b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:30.707338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf014b-c6cc-4041-8988-cb7fbb08f571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:30.708038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf014b-c6cc-4041-8988-cb7fbb08f571 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:30.708323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf014b-c6cc-4041-8988-cb7fbb08f571 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:30.708601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caf014b-c6cc-4041-8988-cb7fbb08f571 None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:30.709732 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf014b-c6cc-4041-8988-cb7fbb08f571 None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:30.711406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caf014b-c6cc-4041-8988-cb7fbb08f571 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:30.717649 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 221/438] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:30 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:30.717649 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf014b-c6cc-4041-8988-cb7fbb08f571 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:30.798479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4e6c7-9021-4fa8-bfbc-a9c90751669b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:30.806972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:30.825163 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caf014b-c6cc-4041-8988-cb7fbb08f571 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:30.836170 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb845b-4afd-4835-a637-6f6bc797b10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:30.836895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb845b-4afd-4835-a637-6f6bc797b10d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:30.837356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb845b-4afd-4835-a637-6f6bc797b10d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:30.837635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcb845b-4afd-4835-a637-6f6bc797b10d None admin] PATH_INFO: `/v3/groups/e85759ecd1bf454f8af70e9447b8300e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:30.838756 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb845b-4afd-4835-a637-6f6bc797b10d None admin] RBAC: Authorizing `identity:get_group(group_id=e85759ecd1bf454f8af70e9447b8300e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:30.840489 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcb845b-4afd-4835-a637-6f6bc797b10d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:30.846951 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 218/439] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:30 2022] GET /identity/v3/groups/e85759ecd1bf454f8af70e9447b8300e => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:30.846951 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb845b-4afd-4835-a637-6f6bc797b10d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:30.861989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:30.866879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818dc16-37c2-4c6d-b285-7db452fd3a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:30.867543 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818dc16-37c2-4c6d-b285-7db452fd3a27 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:30.867823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818dc16-37c2-4c6d-b285-7db452fd3a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:30.868122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818dc16-37c2-4c6d-b285-7db452fd3a27 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:30.873315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818dc16-37c2-4c6d-b285-7db452fd3a27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:30.873315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818dc16-37c2-4c6d-b285-7db452fd3a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:30.873315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818dc16-37c2-4c6d-b285-7db452fd3a27 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:30.879444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 222/440] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:30.880274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818dc16-37c2-4c6d-b285-7db452fd3a27 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:30.956080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcb845b-4afd-4835-a637-6f6bc797b10d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:30.992418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54c29b-3fd8-4ab5-a0fc-87e7512e4c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:30.993327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54c29b-3fd8-4ab5-a0fc-87e7512e4c6f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:30.993605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54c29b-3fd8-4ab5-a0fc-87e7512e4c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:30.993876 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54c29b-3fd8-4ab5-a0fc-87e7512e4c6f None admin] PATH_INFO: `/v3/groups/e85759ecd1bf454f8af70e9447b8300e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:30.995009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54c29b-3fd8-4ab5-a0fc-87e7512e4c6f None admin] RBAC: Authorizing `identity:get_group(group_id=e85759ecd1bf454f8af70e9447b8300e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:30.995120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818dc16-37c2-4c6d-b285-7db452fd3a27 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:30.996475 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54c29b-3fd8-4ab5-a0fc-87e7512e4c6f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:30.999966 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 219/441] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:30 2022] GET /identity/v3/groups/e85759ecd1bf454f8af70e9447b8300e => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:30.999966 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54c29b-3fd8-4ab5-a0fc-87e7512e4c6f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:31.036367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5e8b9-2486-45ff-b45d-3cb7d7e02799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:31.036995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5e8b9-2486-45ff-b45d-3cb7d7e02799 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:31.037280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5e8b9-2486-45ff-b45d-3cb7d7e02799 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:31.037561 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5e8b9-2486-45ff-b45d-3cb7d7e02799 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:31.038302 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5e8b9-2486-45ff-b45d-3cb7d7e02799 None admin] RBAC: Adding query filter params (group.id=e85759ecd1bf454f8af70e9447b8300e, role.id=d78c47b14910477fa17f456efbbc177c, scope.project.id=48ad6ef4173e4919a439dd1e407c850c) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:31.038611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5e8b9-2486-45ff-b45d-3cb7d7e02799 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:31.040066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5e8b9-2486-45ff-b45d-3cb7d7e02799 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:31.046286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 223/442] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 24 07:50:30 2022] GET /identity/v3/role_assignments?group.id=e85759ecd1bf454f8af70e9447b8300e&scope.project.id=48ad6ef4173e4919a439dd1e407c850c&role.id=d78c47b14910477fa17f456efbbc177c => generated 611 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:31.046286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5e8b9-2486-45ff-b45d-3cb7d7e02799 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:31.078034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:31.086752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:31.108055 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54c29b-3fd8-4ab5-a0fc-87e7512e4c6f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:31.148067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc0772-470e-44e0-b2f9-21f8f5e6434a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:31.148697 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc0772-470e-44e0-b2f9-21f8f5e6434a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:31.148981 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc0772-470e-44e0-b2f9-21f8f5e6434a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:31.149256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc0772-470e-44e0-b2f9-21f8f5e6434a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:31.174092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5e8b9-2486-45ff-b45d-3cb7d7e02799 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:31.215124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f44de9-4de6-4b72-bc13-400f911d91cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:31.215742 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f44de9-4de6-4b72-bc13-400f911d91cd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:31.216067 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f44de9-4de6-4b72-bc13-400f911d91cd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:31.216428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f44de9-4de6-4b72-bc13-400f911d91cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:31.217240 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f44de9-4de6-4b72-bc13-400f911d91cd None admin] RBAC: Adding query filter params (group.id=e85759ecd1bf454f8af70e9447b8300e, role.id=75d9054a423c4c66b163c72c8ae7989c, scope.project.id=ba004675284d4e2fb1037370cf5a047e) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:31.217463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f44de9-4de6-4b72-bc13-400f911d91cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:31.218964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f44de9-4de6-4b72-bc13-400f911d91cd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:31.226026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 224/443] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 24 07:50:31 2022] GET /identity/v3/role_assignments?group.id=e85759ecd1bf454f8af70e9447b8300e&scope.project.id=ba004675284d4e2fb1037370cf5a047e&role.id=75d9054a423c4c66b163c72c8ae7989c => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:31.226404 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97229a9-ea21-411d-8ecc-35d970f6aa8b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:31.226692 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97229a9-ea21-411d-8ecc-35d970f6aa8b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:31.226961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97229a9-ea21-411d-8ecc-35d970f6aa8b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:31.228386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 225/444] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:31.231692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc0772-470e-44e0-b2f9-21f8f5e6434a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:31.233887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc0772-470e-44e0-b2f9-21f8f5e6434a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:31.234756 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c36d0c-1043-4e71-9438-3f6edfed1279 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:31.235044 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c36d0c-1043-4e71-9438-3f6edfed1279 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:31.235318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c36d0c-1043-4e71-9438-3f6edfed1279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:31.259408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a8c36d0c-1043-4e71-9438-3f6edfed1279 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:31.261222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a8c36d0c-1043-4e71-9438-3f6edfed1279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:31.359242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:31.360780 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 226/445] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:50:31.392545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 220/446] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:31.398346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c36d0c-1043-4e71-9438-3f6edfed1279 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:31.408296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:31.519086 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c36d0c-1043-4e71-9438-3f6edfed1279 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:31.557567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddb0aa-87f5-4623-81bc-05d08b4d22fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:31.558206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb0aa-87f5-4623-81bc-05d08b4d22fc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:31.558490 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb0aa-87f5-4623-81bc-05d08b4d22fc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:31.558766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ddb0aa-87f5-4623-81bc-05d08b4d22fc None admin] PATH_INFO: `/v3/projects/ba004675284d4e2fb1037370cf5a047e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:31.559992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddb0aa-87f5-4623-81bc-05d08b4d22fc None admin] RBAC: Authorizing `identity:get_project(project_id=ba004675284d4e2fb1037370cf5a047e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:31.562278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ddb0aa-87f5-4623-81bc-05d08b4d22fc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:31.564179 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 227/447] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:31 2022] GET /identity/v3/projects/ba004675284d4e2fb1037370cf5a047e => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:31.569505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc0772-470e-44e0-b2f9-21f8f5e6434a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:31.631376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddb0aa-87f5-4623-81bc-05d08b4d22fc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:31.678500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc0772-470e-44e0-b2f9-21f8f5e6434a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:31.711667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:31.712720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8ec01-1332-40c2-997b-264c3e85829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:31.713349 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8ec01-1332-40c2-997b-264c3e85829c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:31.713979 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8ec01-1332-40c2-997b-264c3e85829c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:31.714257 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8ec01-1332-40c2-997b-264c3e85829c None admin] PATH_INFO: `/v3/groups/e85759ecd1bf454f8af70e9447b8300e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:31.715684 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8ec01-1332-40c2-997b-264c3e85829c None admin] RBAC: Authorizing `identity:get_group(group_id=e85759ecd1bf454f8af70e9447b8300e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:31.717229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8ec01-1332-40c2-997b-264c3e85829c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:31.718953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 221/448] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:31 2022] GET /identity/v3/groups/e85759ecd1bf454f8af70e9447b8300e => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:31.724659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8ec01-1332-40c2-997b-264c3e85829c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:31.736426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ddb0aa-87f5-4623-81bc-05d08b4d22fc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:31.769630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd56cd-7571-4465-ac29-f7420c9f2bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:31.770258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd56cd-7571-4465-ac29-f7420c9f2bfc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:31.770537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd56cd-7571-4465-ac29-f7420c9f2bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:31.770803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd56cd-7571-4465-ac29-f7420c9f2bfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:31.773813 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:31.780632 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd56cd-7571-4465-ac29-f7420c9f2bfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b7dd56cd-7571-4465-ac29-f7420c9f2bfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:31.786442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:31.787477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:31.788325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:31.788325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:31.788325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:31.788325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:31.788325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:31.788325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:31.788325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:31.788325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:31.788325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:31.788325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:31.788325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:50:31.788325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:31.788325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 228/449] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:50:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:31.793194 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd56cd-7571-4465-ac29-f7420c9f2bfc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:31.825127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8ec01-1332-40c2-997b-264c3e85829c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:31.857846 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb13bb-d0e7-445f-a326-2d06ca506747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:31.858492 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb13bb-d0e7-445f-a326-2d06ca506747 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:31.858775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb13bb-d0e7-445f-a326-2d06ca506747 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:31.859048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bb13bb-d0e7-445f-a326-2d06ca506747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:31.859769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb13bb-d0e7-445f-a326-2d06ca506747 None admin] RBAC: Adding query filter params (group.id=e85759ecd1bf454f8af70e9447b8300e, role.id=d78c47b14910477fa17f456efbbc177c, scope.project.id=ba004675284d4e2fb1037370cf5a047e) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:31.860105 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb13bb-d0e7-445f-a326-2d06ca506747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:31.861540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bb13bb-d0e7-445f-a326-2d06ca506747 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:31.867182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 222/450] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 24 07:50:31 2022] GET /identity/v3/role_assignments?group.id=e85759ecd1bf454f8af70e9447b8300e&scope.project.id=ba004675284d4e2fb1037370cf5a047e&role.id=d78c47b14910477fa17f456efbbc177c => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:31.892673 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd56cd-7571-4465-ac29-f7420c9f2bfc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:31.929101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5e5e1-83b7-407a-880c-8c73cd92c9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:31.929717 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5e5e1-83b7-407a-880c-8c73cd92c9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:31.929991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5e5e1-83b7-407a-880c-8c73cd92c9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:31.930258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5e5e1-83b7-407a-880c-8c73cd92c9f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:31.930930 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5e5e1-83b7-407a-880c-8c73cd92c9f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:31.931231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5e5e1-83b7-407a-880c-8c73cd92c9f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:31.932701 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5e5e1-83b7-407a-880c-8c73cd92c9f1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:31.934311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:31.943537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 229/451] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:31.949447 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb13bb-d0e7-445f-a326-2d06ca506747 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:32.053030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bb13bb-d0e7-445f-a326-2d06ca506747 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:32.067167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:32.086600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f755f-b6da-413a-af6f-e6e3db5063c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:32.087207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f755f-b6da-413a-af6f-e6e3db5063c7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:32.087484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f755f-b6da-413a-af6f-e6e3db5063c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:32.087754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f755f-b6da-413a-af6f-e6e3db5063c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:32.157799 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f755f-b6da-413a-af6f-e6e3db5063c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:32.159183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f755f-b6da-413a-af6f-e6e3db5063c7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:32.256393 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 223/452] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:32.262255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5e5e1-83b7-407a-880c-8c73cd92c9f1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:32.357920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5e5e1-83b7-407a-880c-8c73cd92c9f1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:32.390119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29f57d-bb3a-4771-b55d-2a66892a48e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:32.390737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29f57d-bb3a-4771-b55d-2a66892a48e3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:32.391013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29f57d-bb3a-4771-b55d-2a66892a48e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:32.391283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a29f57d-bb3a-4771-b55d-2a66892a48e3 None admin] PATH_INFO: `/v3/projects/853a156fb9564ec38e1fef2222e14a94` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:32.392421 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29f57d-bb3a-4771-b55d-2a66892a48e3 None admin] RBAC: Authorizing `identity:get_project(project_id=853a156fb9564ec38e1fef2222e14a94)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:32.393840 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a29f57d-bb3a-4771-b55d-2a66892a48e3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:32.395430 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 230/453] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:50:32 2022] GET /identity/v3/projects/853a156fb9564ec38e1fef2222e14a94 => generated 344 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:32.400907 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f755f-b6da-413a-af6f-e6e3db5063c7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:32.415872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:32.496100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f755f-b6da-413a-af6f-e6e3db5063c7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:32.528197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55f3f4-2d10-4b09-9311-7863bccc9088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:32.529399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55f3f4-2d10-4b09-9311-7863bccc9088 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:32.529674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55f3f4-2d10-4b09-9311-7863bccc9088 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:32.529943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55f3f4-2d10-4b09-9311-7863bccc9088 None admin] PATH_INFO: `/v3/groups/57a130dfb0114428a5ee035ea4346391` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:32.531029 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55f3f4-2d10-4b09-9311-7863bccc9088 None admin] RBAC: Authorizing `identity:get_group(group_id=57a130dfb0114428a5ee035ea4346391)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:32.532470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55f3f4-2d10-4b09-9311-7863bccc9088 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:32.534059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 224/454] 10.222.0.62 () {56 vars in 1180 bytes} [Wed Aug 24 07:50:32 2022] GET /identity/v3/groups/57a130dfb0114428a5ee035ea4346391 => generated 229 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:32.539936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29f57d-bb3a-4771-b55d-2a66892a48e3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:32.598993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:32.634409 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a29f57d-bb3a-4771-b55d-2a66892a48e3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:32.666728 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d3124-046f-478e-a7d4-e2f605683d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:32.667256 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d3124-046f-478e-a7d4-e2f605683d5f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:32.667532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d3124-046f-478e-a7d4-e2f605683d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:32.667801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d3124-046f-478e-a7d4-e2f605683d5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:32.668541 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d3124-046f-478e-a7d4-e2f605683d5f None admin] RBAC: Adding query filter params (group.id=57a130dfb0114428a5ee035ea4346391, role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=853a156fb9564ec38e1fef2222e14a94) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:32.668844 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d3124-046f-478e-a7d4-e2f605683d5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:32.670271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084d3124-046f-478e-a7d4-e2f605683d5f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:32.675748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 231/455] 10.222.0.62 () {56 vars in 1376 bytes} [Wed Aug 24 07:50:32 2022] GET /identity/v3/role_assignments?group.id=57a130dfb0114428a5ee035ea4346391&scope.project.id=853a156fb9564ec38e1fef2222e14a94&role.id=68b1888f7bb644a39938b8d41006a813 => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:34.919976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300e53b-c7f3-4ccb-9277-a63aa5b4facd None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:34.920490 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300e53b-c7f3-4ccb-9277-a63aa5b4facd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:34.920861 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300e53b-c7f3-4ccb-9277-a63aa5b4facd None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:34.922588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 225/456] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:34.927743 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cfe44-ac2e-41ad-8d19-8f7d3fba7fd3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:34.928641 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cfe44-ac2e-41ad-8d19-8f7d3fba7fd3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:34.929129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0cfe44-ac2e-41ad-8d19-8f7d3fba7fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:34.950141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8a0cfe44-ac2e-41ad-8d19-8f7d3fba7fd3 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:34.951945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8a0cfe44-ac2e-41ad-8d19-8f7d3fba7fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:35.046206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 232/457] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:35.159096 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2fa13-8795-4ab7-9f18-905597c38b93 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:35.159418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2fa13-8795-4ab7-9f18-905597c38b93 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:35.159652 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2fa13-8795-4ab7-9f18-905597c38b93 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:35.161304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 226/458] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:35.166529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7babb4-0789-4f45-bb16-46887a726747 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:35.167034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7babb4-0789-4f45-bb16-46887a726747 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:35.167508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7babb4-0789-4f45-bb16-46887a726747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:35.191789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-df7babb4-0789-4f45-bb16-46887a726747 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:35.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-df7babb4-0789-4f45-bb16-46887a726747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:35.260331 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:35.279235 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 233/459] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:35.346383 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2fa13-8795-4ab7-9f18-905597c38b93 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:35.441499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:35.473593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2fa13-8795-4ab7-9f18-905597c38b93 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:35.491560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e0cd9-2714-4639-b5d8-ea88320aed9e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:35.492083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e0cd9-2714-4639-b5d8-ea88320aed9e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:35.492514 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e0cd9-2714-4639-b5d8-ea88320aed9e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:35.494216 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 234/460] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:35.500185 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88edfed-ab87-48b1-b8bc-088f87b341a8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:35.500714 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88edfed-ab87-48b1-b8bc-088f87b341a8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:35.501213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88edfed-ab87-48b1-b8bc-088f87b341a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:35.520394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b88edfed-ab87-48b1-b8bc-088f87b341a8 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:35.521970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b88edfed-ab87-48b1-b8bc-088f87b341a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:35.527490 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389b685-b6e5-4859-b3b0-8c7f914cb768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:35.528153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389b685-b6e5-4859-b3b0-8c7f914cb768 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:35.528434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389b685-b6e5-4859-b3b0-8c7f914cb768 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:35.528862 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389b685-b6e5-4859-b3b0-8c7f914cb768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:35.548155 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389b685-b6e5-4859-b3b0-8c7f914cb768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:35.549655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a389b685-b6e5-4859-b3b0-8c7f914cb768 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a389b685-b6e5-4859-b3b0-8c7f914cb768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:35.577222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:35.578188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:35.579062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:35.579062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:35.579062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:35.579234 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 227/461] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:35.584840 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389b685-b6e5-4859-b3b0-8c7f914cb768 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:35.635947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 235/462] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:35.701637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88edfed-ab87-48b1-b8bc-088f87b341a8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:35.732750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389b685-b6e5-4859-b3b0-8c7f914cb768 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:35.789079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a0801e-785c-49b3-9470-dd942899f93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:35.790069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0801e-785c-49b3-9470-dd942899f93d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:35.790522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0801e-785c-49b3-9470-dd942899f93d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:35.790939 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a0801e-785c-49b3-9470-dd942899f93d None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:35.791732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0801e-785c-49b3-9470-dd942899f93d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:35.792210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0801e-785c-49b3-9470-dd942899f93d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:35.793746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a0801e-785c-49b3-9470-dd942899f93d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:35.796159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:35.807768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 228/463] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:35.809367 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691af3-e26d-4fa8-84f4-ba8182d688bc None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:35.809905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691af3-e26d-4fa8-84f4-ba8182d688bc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:35.810816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a691af3-e26d-4fa8-84f4-ba8182d688bc None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:35.812454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 229/464] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:35.814695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a691af3-e26d-4fa8-84f4-ba8182d688bc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:35.855432 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88edfed-ab87-48b1-b8bc-088f87b341a8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:35.877378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:35.895822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da16359-5e38-430b-b5b0-c6beee06925b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:35.897002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da16359-5e38-430b-b5b0-c6beee06925b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:35.897002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da16359-5e38-430b-b5b0-c6beee06925b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:35.897451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da16359-5e38-430b-b5b0-c6beee06925b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:35.909061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da16359-5e38-430b-b5b0-c6beee06925b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:35.911455 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da16359-5e38-430b-b5b0-c6beee06925b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:35.931210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a691af3-e26d-4fa8-84f4-ba8182d688bc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-9da16359-5e38-430b-b5b0-c6beee06925b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:35.932293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:35.933591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:35.934439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:35.934439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:35.934439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:35.934439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 236/465] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:35.939393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb641af4-d457-4ce4-8890-b618bbb816c3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:35.939393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb641af4-d457-4ce4-8890-b618bbb816c3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:35.939393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb641af4-d457-4ce4-8890-b618bbb816c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:35.959907 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-eb641af4-d457-4ce4-8890-b618bbb816c3 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:35.961265 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-eb641af4-d457-4ce4-8890-b618bbb816c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:35.978401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef413c-507a-415d-83c4-38f9ef629da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:35.979335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef413c-507a-415d-83c4-38f9ef629da6 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:35.979973 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef413c-507a-415d-83c4-38f9ef629da6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:35.980438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ef413c-507a-415d-83c4-38f9ef629da6 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:35.981359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef413c-507a-415d-83c4-38f9ef629da6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:35.983656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ef413c-507a-415d-83c4-38f9ef629da6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:36.035893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 237/466] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:36.040691 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb641af4-d457-4ce4-8890-b618bbb816c3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:36.092119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 230/467] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:50:35 2022] POST /identity/v3/users => generated 246 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:50:36.100939 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef413c-507a-415d-83c4-38f9ef629da6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:36.166476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:36.171791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb641af4-d457-4ce4-8890-b618bbb816c3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:36.214697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acd1e6-47b6-450d-aac5-86b3dfc32c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:36.215959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd1e6-47b6-450d-aac5-86b3dfc32c20 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:36.217031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd1e6-47b6-450d-aac5-86b3dfc32c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:36.217543 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acd1e6-47b6-450d-aac5-86b3dfc32c20 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:36.219245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acd1e6-47b6-450d-aac5-86b3dfc32c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:36.219785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acd1e6-47b6-450d-aac5-86b3dfc32c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:36.221828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acd1e6-47b6-450d-aac5-86b3dfc32c20 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:36.224519 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:36.246710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 238/468] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:36.253136 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acd1e6-47b6-450d-aac5-86b3dfc32c20 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:36.308962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ef413c-507a-415d-83c4-38f9ef629da6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:36.350572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cec99-8982-4fa8-aaec-fcae80a02fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:36.351866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cec99-8982-4fa8-aaec-fcae80a02fff None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:36.351866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cec99-8982-4fa8-aaec-fcae80a02fff None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:36.351866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cec99-8982-4fa8-aaec-fcae80a02fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:36.362860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cec99-8982-4fa8-aaec-fcae80a02fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:36.364353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56cec99-8982-4fa8-aaec-fcae80a02fff None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a56cec99-8982-4fa8-aaec-fcae80a02fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:36.381948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:36.382860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:36.383701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:36.383701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:36.383701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:36.383701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 231/469] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:36.388491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cec99-8982-4fa8-aaec-fcae80a02fff None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:36.396102 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acd1e6-47b6-450d-aac5-86b3dfc32c20 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:36.441287 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7ebe4-0120-482a-9687-659c1eba5ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:36.441910 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7ebe4-0120-482a-9687-659c1eba5ac5 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:36.442190 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7ebe4-0120-482a-9687-659c1eba5ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:36.442462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7ebe4-0120-482a-9687-659c1eba5ac5 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:36.443110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7ebe4-0120-482a-9687-659c1eba5ac5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:36.445218 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7ebe4-0120-482a-9687-659c1eba5ac5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:36.509644 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cec99-8982-4fa8-aaec-fcae80a02fff None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:36.511262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:36.528028 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 239/470] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:50:36 2022] POST /identity/v3/users => generated 248 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:50:36.530297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7ebe4-0120-482a-9687-659c1eba5ac5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:36.556961 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59e196-26b4-4f6a-807d-b3e518819f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:36.557821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e196-26b4-4f6a-807d-b3e518819f5f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:36.558202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e196-26b4-4f6a-807d-b3e518819f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:36.558477 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba59e196-26b4-4f6a-807d-b3e518819f5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:36.576290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:36.585001 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59e196-26b4-4f6a-807d-b3e518819f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:36.586468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba59e196-26b4-4f6a-807d-b3e518819f5f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ba59e196-26b4-4f6a-807d-b3e518819f5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:36.619990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:36.620983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:36.621981 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:36.621981 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:36.621981 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:36.621981 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 232/471] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:36.627712 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59e196-26b4-4f6a-807d-b3e518819f5f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:36.734079 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7ebe4-0120-482a-9687-659c1eba5ac5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:36.774412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c6fad5-0c12-4af5-a8ca-d06d5f70d0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:36.775157 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6fad5-0c12-4af5-a8ca-d06d5f70d0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:36.775438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6fad5-0c12-4af5-a8ca-d06d5f70d0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:36.775752 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c6fad5-0c12-4af5-a8ca-d06d5f70d0e8 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:36.776420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6fad5-0c12-4af5-a8ca-d06d5f70d0e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:36.776828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6fad5-0c12-4af5-a8ca-d06d5f70d0e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:36.778321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c6fad5-0c12-4af5-a8ca-d06d5f70d0e8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:36.780600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba59e196-26b4-4f6a-807d-b3e518819f5f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:36.791242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 240/472] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:36.792656 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a2ef7-1c5b-43a8-ac6a-5870beb7a994 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:36.792948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a2ef7-1c5b-43a8-ac6a-5870beb7a994 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:36.793223 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34a2ef7-1c5b-43a8-ac6a-5870beb7a994 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:36.794727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 241/473] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:36.802452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d67ee-b8b9-45d4-842e-8f3520623215 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:36.802742 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d67ee-b8b9-45d4-842e-8f3520623215 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:36.803009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9d67ee-b8b9-45d4-842e-8f3520623215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:36.822919 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9d9d67ee-b8b9-45d4-842e-8f3520623215 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:36.824484 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9d9d67ee-b8b9-45d4-842e-8f3520623215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:36.829407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39ca1-04c8-44e8-9943-6771bbce0dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:36.830052 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39ca1-04c8-44e8-9943-6771bbce0dce None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:36.830332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39ca1-04c8-44e8-9943-6771bbce0dce None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:36.830601 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39ca1-04c8-44e8-9943-6771bbce0dce None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:36.831249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39ca1-04c8-44e8-9943-6771bbce0dce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:36.831551 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39ca1-04c8-44e8-9943-6771bbce0dce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:36.832949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39ca1-04c8-44e8-9943-6771bbce0dce None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:36.846722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 233/474] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:36.847590 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39ca1-04c8-44e8-9943-6771bbce0dce None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:36.868889 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:36.902449 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 242/475] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:36.903598 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d67ee-b8b9-45d4-842e-8f3520623215 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:36.912311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:36.961624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39ca1-04c8-44e8-9943-6771bbce0dce None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:37.023404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7c284-9687-424f-91eb-77702437948b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:37.024039 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7c284-9687-424f-91eb-77702437948b None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:37.024325 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7c284-9687-424f-91eb-77702437948b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:37.024648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b7c284-9687-424f-91eb-77702437948b None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:37.025240 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7c284-9687-424f-91eb-77702437948b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:37.026858 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b7c284-9687-424f-91eb-77702437948b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:37.060955 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9d67ee-b8b9-45d4-842e-8f3520623215 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:37.098984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f6fed-7855-44c3-b6db-9713074afce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:37.099884 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6fed-7855-44c3-b6db-9713074afce8 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:37.100328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6fed-7855-44c3-b6db-9713074afce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:37.100748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005f6fed-7855-44c3-b6db-9713074afce8 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:37.101598 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f6fed-7855-44c3-b6db-9713074afce8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:37.103155 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005f6fed-7855-44c3-b6db-9713074afce8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:37.137929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 234/476] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:50:36 2022] POST /identity/v3/users => generated 248 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:50:37.194666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 243/477] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:50:36 2022] POST /identity/v3/users => generated 249 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:50:37.227226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7c284-9687-424f-91eb-77702437948b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:37.337745 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:37.382604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b7c284-9687-424f-91eb-77702437948b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:37.428165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32492d-4964-4390-9238-bdc4d6d67be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:37.429079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32492d-4964-4390-9238-bdc4d6d67be3 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:37.429541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32492d-4964-4390-9238-bdc4d6d67be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:37.429989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32492d-4964-4390-9238-bdc4d6d67be3 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:37.430868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32492d-4964-4390-9238-bdc4d6d67be3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:37.432445 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32492d-4964-4390-9238-bdc4d6d67be3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:37.479830 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.sql.core [None req-4a32492d-4964-4390-9238-bdc4d6d67be3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 07:50:37.479830 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 07:50:37.479830 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [parameters: {'id': 'c7e61b271ce640ebb724200243a930e3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 07:50:37.479830 dv-cinder-852211-5-smb devstack@keystone.service[81602]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81602) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-4a32492d-4964-4390-9238-bdc4d6d67be3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Aug 24 07:50:37.497288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:50:37.498776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application yield resource Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise self.value Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application session.commit() Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 07:50:37.499750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.session.flush() Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application compat.raise_( Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 07:50:37.500713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:50:37.503499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application result.read() Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:50:37.509136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [parameters: {'id': 'c7e61b271ce640ebb724200243a930e3', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:37.511189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 07:50:37.515307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:37.519552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 235/478] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Aug 24 07:50:37 2022] POST /identity/v3/roles => generated 144 bytes in 278 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:37.519696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f6fed-7855-44c3-b6db-9713074afce8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:37.664321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:37.739205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005f6fed-7855-44c3-b6db-9713074afce8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:37.824577 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30a86c-0bd9-4111-bd97-9d8a5c096415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:37.825227 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a86c-0bd9-4111-bd97-9d8a5c096415 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:37.826065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a86c-0bd9-4111-bd97-9d8a5c096415 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:37.826893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30a86c-0bd9-4111-bd97-9d8a5c096415 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:37.844776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30a86c-0bd9-4111-bd97-9d8a5c096415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-4d30a86c-0bd9-4111-bd97-9d8a5c096415 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:37.849981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:37.850851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:37.852100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:37.852100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:37.852100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:37.852100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:37.852100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:37.852100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:37.852100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:37.852100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:37.852100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:37.852100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:37.852100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 07:50:37.852100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:37.852100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 244/479] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:50:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:37.856933 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32492d-4964-4390-9238-bdc4d6d67be3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:38.062815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32492d-4964-4390-9238-bdc4d6d67be3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:38.134862 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5cde67-dd43-4081-b0a5-2a81557d5c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:38.135839 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cde67-dd43-4081-b0a5-2a81557d5c86 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:38.136345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cde67-dd43-4081-b0a5-2a81557d5c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:38.136845 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5cde67-dd43-4081-b0a5-2a81557d5c86 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:38.137734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5cde67-dd43-4081-b0a5-2a81557d5c86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:38.138551 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5cde67-dd43-4081-b0a5-2a81557d5c86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:38.140393 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5cde67-dd43-4081-b0a5-2a81557d5c86 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:38.142397 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:38.160751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 236/480] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:38.524592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf90d8-6b2a-43d6-ae6e-1beac7faf386 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:38.525579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf90d8-6b2a-43d6-ae6e-1beac7faf386 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:38.526146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf90d8-6b2a-43d6-ae6e-1beac7faf386 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:38.527986 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 245/481] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:38.533269 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc52fe-f376-4cbe-9246-eb06851a7052 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:38.533822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc52fe-f376-4cbe-9246-eb06851a7052 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:38.534312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc52fe-f376-4cbe-9246-eb06851a7052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:38.558827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-48cc52fe-f376-4cbe-9246-eb06851a7052 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:38.560782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-48cc52fe-f376-4cbe-9246-eb06851a7052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:38.671159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 237/482] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:38.976901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf90d8-6b2a-43d6-ae6e-1beac7faf386 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:39.057315 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94feb9-0299-4b47-b26b-6d478bffd3f3 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:39.057699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94feb9-0299-4b47-b26b-6d478bffd3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:39.057980 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94feb9-0299-4b47-b26b-6d478bffd3f3 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:39.059577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 238/483] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:39.065424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4c1ed-c98e-446e-8276-d7c69d5a0e7e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:39.066382 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4c1ed-c98e-446e-8276-d7c69d5a0e7e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:39.066849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca4c1ed-c98e-446e-8276-d7c69d5a0e7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:39.096954 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fca4c1ed-c98e-446e-8276-d7c69d5a0e7e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:39.098471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fca4c1ed-c98e-446e-8276-d7c69d5a0e7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:39.108505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf90d8-6b2a-43d6-ae6e-1beac7faf386 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:39.145879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:39.162533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cc665-9026-4ec2-a72b-e7bdee1ef462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:39.163170 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cc665-9026-4ec2-a72b-e7bdee1ef462 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:39.163445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cc665-9026-4ec2-a72b-e7bdee1ef462 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:39.163714 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cc665-9026-4ec2-a72b-e7bdee1ef462 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:39.187069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cc665-9026-4ec2-a72b-e7bdee1ef462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f12cc665-9026-4ec2-a72b-e7bdee1ef462 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:39.193097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:39.193968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:39.194846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:39.194846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:39.194846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:39.194846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:39.194846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:39.194846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:39.194846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:39.194846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:39.194846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:39.194846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:39.194846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:39.194846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:39.195464 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 246/484] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:39.202117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cc665-9026-4ec2-a72b-e7bdee1ef462 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:39.229159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 239/485] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:39.320435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cc665-9026-4ec2-a72b-e7bdee1ef462 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:39.363492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d23b1-5904-47c3-bfb1-d3aaefc2abf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:39.364133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d23b1-5904-47c3-bfb1-d3aaefc2abf0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:39.364414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d23b1-5904-47c3-bfb1-d3aaefc2abf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:39.364687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d23b1-5904-47c3-bfb1-d3aaefc2abf0 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:39.365357 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d23b1-5904-47c3-bfb1-d3aaefc2abf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:39.365662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d23b1-5904-47c3-bfb1-d3aaefc2abf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:39.367036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d23b1-5904-47c3-bfb1-d3aaefc2abf0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:39.388416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 247/486] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:39.393873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4c1ed-c98e-446e-8276-d7c69d5a0e7e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:39.475359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:39.532753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca4c1ed-c98e-446e-8276-d7c69d5a0e7e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:39.557058 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d23b1-5904-47c3-bfb1-d3aaefc2abf0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:39.599349 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abfed3-29bb-4766-921a-d434d7a08cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:39.600387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abfed3-29bb-4766-921a-d434d7a08cb5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:39.600859 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abfed3-29bb-4766-921a-d434d7a08cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:39.601317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96abfed3-29bb-4766-921a-d434d7a08cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:39.613571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:39.624234 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abfed3-29bb-4766-921a-d434d7a08cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:39.627359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96abfed3-29bb-4766-921a-d434d7a08cb5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-96abfed3-29bb-4766-921a-d434d7a08cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:39.652416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:39.653463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:39.654391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:39.654391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:39.654391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:39.656198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 240/487] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:39.663720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abfed3-29bb-4766-921a-d434d7a08cb5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:39.678503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d23b1-5904-47c3-bfb1-d3aaefc2abf0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:39.738333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9bff8-c07a-4287-bfc0-c1fa15b13c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:39.739221 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9bff8-c07a-4287-bfc0-c1fa15b13c39 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:39.739596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9bff8-c07a-4287-bfc0-c1fa15b13c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:39.739989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9bff8-c07a-4287-bfc0-c1fa15b13c39 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:39.764899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9bff8-c07a-4287-bfc0-c1fa15b13c39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-21a9bff8-c07a-4287-bfc0-c1fa15b13c39 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:39.770450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:39.771407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:39.772210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:39.772210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:39.772210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:39.772210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:39.772210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:39.772210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:39.772210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:39.772210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:39.772210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:39.772210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:39.772210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:39.772210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:39.772210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 248/488] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:39.783945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9bff8-c07a-4287-bfc0-c1fa15b13c39 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:39.831509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96abfed3-29bb-4766-921a-d434d7a08cb5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:39.841925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:39.872604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3639579-6caa-4dc0-96d5-19ece05dfac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:39.873207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639579-6caa-4dc0-96d5-19ece05dfac8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:39.873483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639579-6caa-4dc0-96d5-19ece05dfac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:39.873751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3639579-6caa-4dc0-96d5-19ece05dfac8 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:39.874389 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3639579-6caa-4dc0-96d5-19ece05dfac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:39.874688 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3639579-6caa-4dc0-96d5-19ece05dfac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:39.876065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3639579-6caa-4dc0-96d5-19ece05dfac8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:39.889659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 241/489] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:39.890925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206faca-cc12-49eb-94d0-6c251fc70f77 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:39.891451 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206faca-cc12-49eb-94d0-6c251fc70f77 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:39.891789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8206faca-cc12-49eb-94d0-6c251fc70f77 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:39.895971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 242/490] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:39.897480 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f77e25-fbd9-4099-bac4-cbe3800edfab None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:39.897997 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f77e25-fbd9-4099-bac4-cbe3800edfab None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:39.898172 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f77e25-fbd9-4099-bac4-cbe3800edfab None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:39.900542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9bff8-c07a-4287-bfc0-c1fa15b13c39 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:39.904310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 243/491] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:39.904682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:39.904818 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f77e25-fbd9-4099-bac4-cbe3800edfab None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:39.941265 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62955158-e42c-44c2-97ea-2d6218fb16c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:39.941865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955158-e42c-44c2-97ea-2d6218fb16c8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:39.942138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955158-e42c-44c2-97ea-2d6218fb16c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:39.942410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62955158-e42c-44c2-97ea-2d6218fb16c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:39.943066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62955158-e42c-44c2-97ea-2d6218fb16c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:39.943363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62955158-e42c-44c2-97ea-2d6218fb16c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:39.944745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62955158-e42c-44c2-97ea-2d6218fb16c8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:39.958779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 249/492] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:39.958779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2862d1-a317-4430-9a7d-0f03cba39fc9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:39.958779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2862d1-a317-4430-9a7d-0f03cba39fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:39.958779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2862d1-a317-4430-9a7d-0f03cba39fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:39.976440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9c2862d1-a317-4430-9a7d-0f03cba39fc9 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:39.977613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9c2862d1-a317-4430-9a7d-0f03cba39fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:40.017938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f77e25-fbd9-4099-bac4-cbe3800edfab None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:40.055950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 250/493] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:40.055950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762be08-9454-4bb2-93dc-230096c09b9e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:40.055950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762be08-9454-4bb2-93dc-230096c09b9e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:40.055950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b762be08-9454-4bb2-93dc-230096c09b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:40.066046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01063a-cc13-406a-8837-58f2759f2d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:40.066769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01063a-cc13-406a-8837-58f2759f2d88 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:40.067123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01063a-cc13-406a-8837-58f2759f2d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:40.067470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a01063a-cc13-406a-8837-58f2759f2d88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:40.072176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b762be08-9454-4bb2-93dc-230096c09b9e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:40.073532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b762be08-9454-4bb2-93dc-230096c09b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:40.075109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01063a-cc13-406a-8837-58f2759f2d88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:40.077253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a01063a-cc13-406a-8837-58f2759f2d88 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-0a01063a-cc13-406a-8837-58f2759f2d88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:40.090485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:40.092167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:40.093082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:40.093082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:40.093082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:40.093082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:40.093082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:40.093082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:40.093082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:40.093082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:40.093082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:50:40.093082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:40.093082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 244/494] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 24 07:50:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:40.093904 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01063a-cc13-406a-8837-58f2759f2d88 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:40.123517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:40.157438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 251/495] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:40.158947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762be08-9454-4bb2-93dc-230096c09b9e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:40.211042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:40.221995 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a01063a-cc13-406a-8837-58f2759f2d88 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:40.257917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956a952-582b-4837-aee7-bb9419082242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:40.258549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956a952-582b-4837-aee7-bb9419082242 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:40.258826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956a952-582b-4837-aee7-bb9419082242 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:40.259100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956a952-582b-4837-aee7-bb9419082242 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:40.277131 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956a952-582b-4837-aee7-bb9419082242 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:40.279278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956a952-582b-4837-aee7-bb9419082242 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-1956a952-582b-4837-aee7-bb9419082242 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:40.302298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:40.303238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:40.304134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:40.304134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:40.304134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:40.310677 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 245/496] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:40.312124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956a952-582b-4837-aee7-bb9419082242 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:40.371714 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b762be08-9454-4bb2-93dc-230096c09b9e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:40.422853 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbeb72-3030-4618-a751-92bb83ae4b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:40.423712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbeb72-3030-4618-a751-92bb83ae4b74 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:40.424161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbeb72-3030-4618-a751-92bb83ae4b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:40.424745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbeb72-3030-4618-a751-92bb83ae4b74 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:40.426121 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbeb72-3030-4618-a751-92bb83ae4b74 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:40.426593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbeb72-3030-4618-a751-92bb83ae4b74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:40.428708 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dbeb72-3030-4618-a751-92bb83ae4b74 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:40.442063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:40.463483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956a952-582b-4837-aee7-bb9419082242 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:40.479488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 252/497] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 24 07:50:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:40.480788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbeb72-3030-4618-a751-92bb83ae4b74 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:40.502613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a93cc8-5c27-4e4c-b33c-b57c0cd22296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:40.503458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a93cc8-5c27-4e4c-b33c-b57c0cd22296 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:40.503928 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a93cc8-5c27-4e4c-b33c-b57c0cd22296 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:40.504211 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a93cc8-5c27-4e4c-b33c-b57c0cd22296 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:40.504853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a93cc8-5c27-4e4c-b33c-b57c0cd22296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:40.505170 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a93cc8-5c27-4e4c-b33c-b57c0cd22296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:40.506517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a93cc8-5c27-4e4c-b33c-b57c0cd22296 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:40.519731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 246/498] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:40.520617 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a93cc8-5c27-4e4c-b33c-b57c0cd22296 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:40.569963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:40.586968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbeb72-3030-4618-a751-92bb83ae4b74 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:40.624598 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24208204-28ac-485e-9a45-199f24b897da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:40.625242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24208204-28ac-485e-9a45-199f24b897da None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:40.625523 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24208204-28ac-485e-9a45-199f24b897da None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:40.625804 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24208204-28ac-485e-9a45-199f24b897da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:40.631931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a93cc8-5c27-4e4c-b33c-b57c0cd22296 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:40.636388 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24208204-28ac-485e-9a45-199f24b897da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-24208204-28ac-485e-9a45-199f24b897da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:40.641761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:40.642637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:40.643414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:40.643414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:40.643414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:40.643414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:40.643414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:40.643414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:40.643414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:40.643414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:40.643414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:40.643414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:40.643414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:40.643414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:40.643414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 253/499] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:40.644116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24208204-28ac-485e-9a45-199f24b897da None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:40.673899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b903f9d-37d2-454e-a98f-0449c2533a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:40.685795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903f9d-37d2-454e-a98f-0449c2533a4c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:40.685795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903f9d-37d2-454e-a98f-0449c2533a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:40.685795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b903f9d-37d2-454e-a98f-0449c2533a4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:40.685795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:40.687445 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b903f9d-37d2-454e-a98f-0449c2533a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-4b903f9d-37d2-454e-a98f-0449c2533a4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:40.692168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:40.693069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:40.693873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:40.693873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:40.693873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:40.693873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:40.693873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:40.693873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:40.693873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:40.693873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:40.693873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:40.693873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:40.693873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:40.693873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:40.696154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 247/500] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:40.697887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b903f9d-37d2-454e-a98f-0449c2533a4c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:40.754737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24208204-28ac-485e-9a45-199f24b897da None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:40.788592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82104b2-fe04-49e8-b3c2-679092d1d77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:40.789197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82104b2-fe04-49e8-b3c2-679092d1d77c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:40.789480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82104b2-fe04-49e8-b3c2-679092d1d77c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:40.789754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82104b2-fe04-49e8-b3c2-679092d1d77c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:40.799367 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b903f9d-37d2-454e-a98f-0449c2533a4c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:40.804455 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:40.832709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d18e8-3bcc-45b2-88a9-43c3d19bac4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:40.833265 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d18e8-3bcc-45b2-88a9-43c3d19bac4f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:40.833547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d18e8-3bcc-45b2-88a9-43c3d19bac4f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:40.833819 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873d18e8-3bcc-45b2-88a9-43c3d19bac4f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:40.841863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d18e8-3bcc-45b2-88a9-43c3d19bac4f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:40.842966 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873d18e8-3bcc-45b2-88a9-43c3d19bac4f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-873d18e8-3bcc-45b2-88a9-43c3d19bac4f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:40.853894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:40.854795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:40.861468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:40.861468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:40.861468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:40.861468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:40.861468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:40.861468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:40.861468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:40.861468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:40.861468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:50:40.861468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:40.861468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 248/501] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:40.861468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d18e8-3bcc-45b2-88a9-43c3d19bac4f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:40.864603 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82104b2-fe04-49e8-b3c2-679092d1d77c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:40.866056 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82104b2-fe04-49e8-b3c2-679092d1d77c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:40.914611 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:40.956457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873d18e8-3bcc-45b2-88a9-43c3d19bac4f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:40.963336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 254/502] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:40.964638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82104b2-fe04-49e8-b3c2-679092d1d77c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:40.989929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9084f110-acf3-4f3e-a5f3-0862bdcbe93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:40.990526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084f110-acf3-4f3e-a5f3-0862bdcbe93e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:40.990804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084f110-acf3-4f3e-a5f3-0862bdcbe93e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:40.991075 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9084f110-acf3-4f3e-a5f3-0862bdcbe93e None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:40.991737 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084f110-acf3-4f3e-a5f3-0862bdcbe93e None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:40.992068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084f110-acf3-4f3e-a5f3-0862bdcbe93e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:40.993422 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9084f110-acf3-4f3e-a5f3-0862bdcbe93e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:41.002066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 249/503] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:41.003362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d47af-0057-433b-a943-bce9cd80caf3 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:41.003649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d47af-0057-433b-a943-bce9cd80caf3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:41.003948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d47af-0057-433b-a943-bce9cd80caf3 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:41.008214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 250/504] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:41.008214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d47af-0057-433b-a943-bce9cd80caf3 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:41.013330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:41.067717 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82104b2-fe04-49e8-b3c2-679092d1d77c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:41.100977 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf4c83-2702-4d00-ad1e-20b41b29f172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:41.101505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf4c83-2702-4d00-ad1e-20b41b29f172 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:41.101784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf4c83-2702-4d00-ad1e-20b41b29f172 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:41.102059 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf4c83-2702-4d00-ad1e-20b41b29f172 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:41.102707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf4c83-2702-4d00-ad1e-20b41b29f172 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:41.103007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf4c83-2702-4d00-ad1e-20b41b29f172 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:41.104400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf4c83-2702-4d00-ad1e-20b41b29f172 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:41.109240 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d47af-0057-433b-a943-bce9cd80caf3 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:41.112849 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 255/505] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:41.113633 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf4c83-2702-4d00-ad1e-20b41b29f172 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:41.133307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:41.145352 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdac10-11dd-42cf-b242-18023bf76efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:41.145949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdac10-11dd-42cf-b242-18023bf76efb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:41.148228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdac10-11dd-42cf-b242-18023bf76efb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:41.148228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cdac10-11dd-42cf-b242-18023bf76efb None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:41.148228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdac10-11dd-42cf-b242-18023bf76efb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:41.148228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdac10-11dd-42cf-b242-18023bf76efb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:41.149842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cdac10-11dd-42cf-b242-18023bf76efb None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:41.186268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 251/506] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Aug 24 07:50:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:41.187079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdac10-11dd-42cf-b242-18023bf76efb None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:41.211396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf4c83-2702-4d00-ad1e-20b41b29f172 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:41.218939 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:41.246363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8767491-6711-4176-b746-03b730539fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:41.246995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8767491-6711-4176-b746-03b730539fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:41.247272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8767491-6711-4176-b746-03b730539fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:41.247545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8767491-6711-4176-b746-03b730539fb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:41.257364 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8767491-6711-4176-b746-03b730539fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:41.258807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8767491-6711-4176-b746-03b730539fb9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e8767491-6711-4176-b746-03b730539fb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:41.273116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:41.274034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:41.275431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:41.275431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:41.275431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:41.275431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 256/507] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:41.275431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57ad41-105d-4a6d-8004-217fbc201f45 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:41.275779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57ad41-105d-4a6d-8004-217fbc201f45 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:41.275888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd57ad41-105d-4a6d-8004-217fbc201f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:41.290333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cdac10-11dd-42cf-b242-18023bf76efb None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:41.293195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bd57ad41-105d-4a6d-8004-217fbc201f45 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:41.294469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bd57ad41-105d-4a6d-8004-217fbc201f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:41.323436 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd08354-c4f8-4712-a87e-6aa2c2b15d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:41.324081 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd08354-c4f8-4712-a87e-6aa2c2b15d6e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:41.324357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd08354-c4f8-4712-a87e-6aa2c2b15d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:41.324624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd08354-c4f8-4712-a87e-6aa2c2b15d6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:41.334743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd08354-c4f8-4712-a87e-6aa2c2b15d6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:41.336208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd08354-c4f8-4712-a87e-6aa2c2b15d6e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-dbd08354-c4f8-4712-a87e-6aa2c2b15d6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:41.350773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:41.351782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:41.353125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:41.353125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:41.353125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:41.353125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 252/508] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:41.353125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd08354-c4f8-4712-a87e-6aa2c2b15d6e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:41.364091 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 257/509] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:41.364937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57ad41-105d-4a6d-8004-217fbc201f45 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:41.388698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:41.466457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd08354-c4f8-4712-a87e-6aa2c2b15d6e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:41.470887 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:41.483041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd57ad41-105d-4a6d-8004-217fbc201f45 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:41.504969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d4865-28f1-4c72-b91d-996f41ebd39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:41.505792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d4865-28f1-4c72-b91d-996f41ebd39f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:41.506214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d4865-28f1-4c72-b91d-996f41ebd39f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:41.506670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d4865-28f1-4c72-b91d-996f41ebd39f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:41.517286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db96d1a-8a7c-4683-8f15-c78a4914ddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:41.517725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d4865-28f1-4c72-b91d-996f41ebd39f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:41.517891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db96d1a-8a7c-4683-8f15-c78a4914ddf0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:41.518171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db96d1a-8a7c-4683-8f15-c78a4914ddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:41.518443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db96d1a-8a7c-4683-8f15-c78a4914ddf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:41.519867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d4865-28f1-4c72-b91d-996f41ebd39f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-990d4865-28f1-4c72-b91d-996f41ebd39f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:41.536174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:41.537292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:41.538366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:41.538366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:41.538366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:41.542039 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 253/510] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:41.542963 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d4865-28f1-4c72-b91d-996f41ebd39f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:41.587579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db96d1a-8a7c-4683-8f15-c78a4914ddf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:41.589062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db96d1a-8a7c-4683-8f15-c78a4914ddf0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:41.631116 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:41.647942 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d4865-28f1-4c72-b91d-996f41ebd39f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:41.674129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:41.682147 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcf675-e4fe-45be-8824-1a9e37c4b533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:41.682740 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcf675-e4fe-45be-8824-1a9e37c4b533 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:41.683018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcf675-e4fe-45be-8824-1a9e37c4b533 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:41.683293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcf675-e4fe-45be-8824-1a9e37c4b533 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:41.684200 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcf675-e4fe-45be-8824-1a9e37c4b533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:41.684313 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcf675-e4fe-45be-8824-1a9e37c4b533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:41.686725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcf675-e4fe-45be-8824-1a9e37c4b533 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:41.687305 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 258/511] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:41.688154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db96d1a-8a7c-4683-8f15-c78a4914ddf0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:41.698331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 254/512] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:41.699156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcf675-e4fe-45be-8824-1a9e37c4b533 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:41.782812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db96d1a-8a7c-4683-8f15-c78a4914ddf0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:41.816418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf8fe3-7870-44e4-9a6a-9929f167a441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:41.817026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf8fe3-7870-44e4-9a6a-9929f167a441 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:41.817302 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf8fe3-7870-44e4-9a6a-9929f167a441 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:41.817569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf8fe3-7870-44e4-9a6a-9929f167a441 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:41.818199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf8fe3-7870-44e4-9a6a-9929f167a441 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:41.818499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf8fe3-7870-44e4-9a6a-9929f167a441 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:41.819839 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf8fe3-7870-44e4-9a6a-9929f167a441 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:41.830579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 259/513] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:41.831357 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf8fe3-7870-44e4-9a6a-9929f167a441 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:41.851103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcf675-e4fe-45be-8824-1a9e37c4b533 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:41.878349 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:41.883893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d83a59-3b89-44b0-af4e-01eac9b821f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:41.884444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d83a59-3b89-44b0-af4e-01eac9b821f9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:41.884726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d83a59-3b89-44b0-af4e-01eac9b821f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:41.892011 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d83a59-3b89-44b0-af4e-01eac9b821f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:41.892011 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d83a59-3b89-44b0-af4e-01eac9b821f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:41.892011 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d83a59-3b89-44b0-af4e-01eac9b821f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:41.892011 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d83a59-3b89-44b0-af4e-01eac9b821f9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:41.898682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 255/514] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:41.899477 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d83a59-3b89-44b0-af4e-01eac9b821f9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:41.904543 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:41.928273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf8fe3-7870-44e4-9a6a-9929f167a441 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:41.960539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad7efe-8b0d-4c9d-9ebe-0440e805a198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:41.961156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad7efe-8b0d-4c9d-9ebe-0440e805a198 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:41.961431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad7efe-8b0d-4c9d-9ebe-0440e805a198 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:41.961698 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad7efe-8b0d-4c9d-9ebe-0440e805a198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:41.972667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad7efe-8b0d-4c9d-9ebe-0440e805a198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:41.974109 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad7efe-8b0d-4c9d-9ebe-0440e805a198 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-faad7efe-8b0d-4c9d-9ebe-0440e805a198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:41.989655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:41.990683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:41.991562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:41.991562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:41.991562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:41.991562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 260/515] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:41.991562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad7efe-8b0d-4c9d-9ebe-0440e805a198 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:42.002973 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d83a59-3b89-44b0-af4e-01eac9b821f9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:42.036174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d98950-06f9-49fa-ae7d-2f743baa0065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:42.036800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d98950-06f9-49fa-ae7d-2f743baa0065 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:42.037079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d98950-06f9-49fa-ae7d-2f743baa0065 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:42.037350 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d98950-06f9-49fa-ae7d-2f743baa0065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:42.048129 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d98950-06f9-49fa-ae7d-2f743baa0065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:42.049739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d98950-06f9-49fa-ae7d-2f743baa0065 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f7d98950-06f9-49fa-ae7d-2f743baa0065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:42.063110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:42.064063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:42.064918 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:42.064918 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:42.064918 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:42.064918 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 256/516] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:42.065132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d98950-06f9-49fa-ae7d-2f743baa0065 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:42.086803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:42.090040 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad7efe-8b0d-4c9d-9ebe-0440e805a198 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:42.122663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:42.124390 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016af17a-8c8c-4240-850d-044e2b141e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:42.125022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016af17a-8c8c-4240-850d-044e2b141e51 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:42.125301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016af17a-8c8c-4240-850d-044e2b141e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:42.125570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016af17a-8c8c-4240-850d-044e2b141e51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:42.132019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016af17a-8c8c-4240-850d-044e2b141e51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:42.133510 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016af17a-8c8c-4240-850d-044e2b141e51 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-016af17a-8c8c-4240-850d-044e2b141e51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:50:42.145356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:42.146213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:42.147101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:50:42.147101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:50:42.147101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:50:42.147101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:50:42.147101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:50:42.147101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:50:42.147101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:42.147101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:42.147101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 261/517] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:42.147101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016af17a-8c8c-4240-850d-044e2b141e51 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:42.171136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d98950-06f9-49fa-ae7d-2f743baa0065 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:42.204344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9f8e0-2183-4d5a-98a9-32ea9856fb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:42.204965 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9f8e0-2183-4d5a-98a9-32ea9856fb4b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:42.205244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9f8e0-2183-4d5a-98a9-32ea9856fb4b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:42.205517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede9f8e0-2183-4d5a-98a9-32ea9856fb4b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:42.212701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9f8e0-2183-4d5a-98a9-32ea9856fb4b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:42.214111 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede9f8e0-2183-4d5a-98a9-32ea9856fb4b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ede9f8e0-2183-4d5a-98a9-32ea9856fb4b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:42.225826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:42.226731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:42.232539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:42.232539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:42.232539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:42.232539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:42.232539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:42.232539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:42.232539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:42.232539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:42.232539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:50:42.232539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:42.232539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 257/518] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:42.232539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9f8e0-2183-4d5a-98a9-32ea9856fb4b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:42.246788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016af17a-8c8c-4240-850d-044e2b141e51 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:42.280327 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a4af9-2244-4175-bdd0-592d9240c361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:42.280957 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a4af9-2244-4175-bdd0-592d9240c361 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:42.281244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a4af9-2244-4175-bdd0-592d9240c361 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:42.281518 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a4af9-2244-4175-bdd0-592d9240c361 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:42.288839 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a4af9-2244-4175-bdd0-592d9240c361 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:42.290277 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62a4af9-2244-4175-bdd0-592d9240c361 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c62a4af9-2244-4175-bdd0-592d9240c361 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:42.302382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:42.303488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:42.304653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:42.304653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:42.304653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:42.304653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:42.304653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:42.304653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:42.304653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:42.304653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:42.304653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:50:42.304653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:42.304653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 262/519] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:42.304653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a4af9-2244-4175-bdd0-592d9240c361 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:42.326956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:42.332584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede9f8e0-2183-4d5a-98a9-32ea9856fb4b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:42.348980 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:42.365958 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6529e1-fa09-4faf-8937-06c586549770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:42.366558 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6529e1-fa09-4faf-8937-06c586549770 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:42.372252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6529e1-fa09-4faf-8937-06c586549770 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:42.372252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6529e1-fa09-4faf-8937-06c586549770 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:42.372252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6529e1-fa09-4faf-8937-06c586549770 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:42.372252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6529e1-fa09-4faf-8937-06c586549770 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:42.372252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6529e1-fa09-4faf-8937-06c586549770 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:42.382098 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 258/520] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:42.383055 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6529e1-fa09-4faf-8937-06c586549770 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:42.407503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a4af9-2244-4175-bdd0-592d9240c361 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:42.440733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32727c3b-3c6f-4553-823f-dda4663caf71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:42.441337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32727c3b-3c6f-4553-823f-dda4663caf71 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:42.441618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32727c3b-3c6f-4553-823f-dda4663caf71 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:42.441894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32727c3b-3c6f-4553-823f-dda4663caf71 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:42.442534 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32727c3b-3c6f-4553-823f-dda4663caf71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:42.442840 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32727c3b-3c6f-4553-823f-dda4663caf71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:42.444239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32727c3b-3c6f-4553-823f-dda4663caf71 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:42.455535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 263/521] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:42.456362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32727c3b-3c6f-4553-823f-dda4663caf71 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:42.483239 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6529e1-fa09-4faf-8937-06c586549770 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:42.517228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a0e06-7a23-4786-ac1d-e45b25f0f5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:42.517827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a0e06-7a23-4786-ac1d-e45b25f0f5b7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:42.518111 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a0e06-7a23-4786-ac1d-e45b25f0f5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:42.518385 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42a0e06-7a23-4786-ac1d-e45b25f0f5b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:42.519067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a0e06-7a23-4786-ac1d-e45b25f0f5b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:42.519370 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a0e06-7a23-4786-ac1d-e45b25f0f5b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:42.520817 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42a0e06-7a23-4786-ac1d-e45b25f0f5b7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:42.535889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:42.539324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 259/522] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:50:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:42.540164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a0e06-7a23-4786-ac1d-e45b25f0f5b7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:42.554040 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32727c3b-3c6f-4553-823f-dda4663caf71 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:42.575714 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:42.587913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f36ad-486e-4011-8f2a-525c11ab3282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:42.588543 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f36ad-486e-4011-8f2a-525c11ab3282 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:42.588822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f36ad-486e-4011-8f2a-525c11ab3282 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:42.589098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f36ad-486e-4011-8f2a-525c11ab3282 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:42.590081 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f36ad-486e-4011-8f2a-525c11ab3282 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:42.590389 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f36ad-486e-4011-8f2a-525c11ab3282 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:42.592454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f36ad-486e-4011-8f2a-525c11ab3282 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:42.610260 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 264/523] 10.222.0.62 () {56 vars in 1139 bytes} [Wed Aug 24 07:50:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:42.611131 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f36ad-486e-4011-8f2a-525c11ab3282 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:42.640844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42a0e06-7a23-4786-ac1d-e45b25f0f5b7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:42.673923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc0d3b-ecdc-4051-82d5-5720f9036b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:42.674458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc0d3b-ecdc-4051-82d5-5720f9036b7e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:42.674736 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc0d3b-ecdc-4051-82d5-5720f9036b7e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:42.675006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc0d3b-ecdc-4051-82d5-5720f9036b7e None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:42.675733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc0d3b-ecdc-4051-82d5-5720f9036b7e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:42.676061 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc0d3b-ecdc-4051-82d5-5720f9036b7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:42.677480 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc0d3b-ecdc-4051-82d5-5720f9036b7e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:42.694844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 260/524] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Aug 24 07:50:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:42.695679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc0d3b-ecdc-4051-82d5-5720f9036b7e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:42.712038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f36ad-486e-4011-8f2a-525c11ab3282 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:42.745133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a96de4-17b1-4b61-b390-de4e83d033cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:42.745785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a96de4-17b1-4b61-b390-de4e83d033cc None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:42.746064 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a96de4-17b1-4b61-b390-de4e83d033cc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:42.746331 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a96de4-17b1-4b61-b390-de4e83d033cc None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:42.746959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a96de4-17b1-4b61-b390-de4e83d033cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:42.748919 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a96de4-17b1-4b61-b390-de4e83d033cc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:42.758626 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:42.789790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:42.796218 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc0d3b-ecdc-4051-82d5-5720f9036b7e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:42.829027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d82136-4cff-426a-ba42-68e6e0e01e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:42.829648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d82136-4cff-426a-ba42-68e6e0e01e74 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:42.829923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d82136-4cff-426a-ba42-68e6e0e01e74 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:42.830189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d82136-4cff-426a-ba42-68e6e0e01e74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:42.836449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d82136-4cff-426a-ba42-68e6e0e01e74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:42.837871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d82136-4cff-426a-ba42-68e6e0e01e74 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-97d82136-4cff-426a-ba42-68e6e0e01e74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:50:42.849719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:42.850732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:42.851898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:50:42.851898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:50:42.851898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:50:42.851898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:50:42.851898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:50:42.851898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:50:42.851898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:42.851898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:42.851898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 261/525] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:42.851898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d82136-4cff-426a-ba42-68e6e0e01e74 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:42.891181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 265/526] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:50:42 2022] POST /identity/v3/users => generated 247 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:50:42.892042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a96de4-17b1-4b61-b390-de4e83d033cc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:42.967004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d82136-4cff-426a-ba42-68e6e0e01e74 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:43.004089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a96de4-17b1-4b61-b390-de4e83d033cc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:43.006006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46d82f-ba98-4b08-9ae8-68fab85ce2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:43.006629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46d82f-ba98-4b08-9ae8-68fab85ce2e8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:43.006909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46d82f-ba98-4b08-9ae8-68fab85ce2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:43.007184 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a46d82f-ba98-4b08-9ae8-68fab85ce2e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:43.007960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46d82f-ba98-4b08-9ae8-68fab85ce2e8 None admin] RBAC: Adding query filter params (role.id=bd638a70b0d5447ab1d78f20ef54200e, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=9b99cff7a5f549adadee002f8ab1f5d9) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:43.008278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46d82f-ba98-4b08-9ae8-68fab85ce2e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:43.009753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a46d82f-ba98-4b08-9ae8-68fab85ce2e8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:43.016390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 262/527] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:42 2022] GET /identity/v3/role_assignments?user.id=9b99cff7a5f549adadee002f8ab1f5d9&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=bd638a70b0d5447ab1d78f20ef54200e => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:43.017262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46d82f-ba98-4b08-9ae8-68fab85ce2e8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:43.040942 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:43.062152 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220a202-dc7d-483e-9f3c-ba8a7a8b2722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:43.063434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220a202-dc7d-483e-9f3c-ba8a7a8b2722 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:43.063434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220a202-dc7d-483e-9f3c-ba8a7a8b2722 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:43.063434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220a202-dc7d-483e-9f3c-ba8a7a8b2722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:43.153761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a46d82f-ba98-4b08-9ae8-68fab85ce2e8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:43.162827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:43.174037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220a202-dc7d-483e-9f3c-ba8a7a8b2722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:43.176104 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220a202-dc7d-483e-9f3c-ba8a7a8b2722 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:43.194325 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bc11d-d3b9-4642-8641-bec5a604fa65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:43.195252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bc11d-d3b9-4642-8641-bec5a604fa65 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:43.195730 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bc11d-d3b9-4642-8641-bec5a604fa65 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:43.196213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3bc11d-d3b9-4642-8641-bec5a604fa65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:43.274832 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bc11d-d3b9-4642-8641-bec5a604fa65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:43.276588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3bc11d-d3b9-4642-8641-bec5a604fa65 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:43.302597 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 266/528] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:43.303204 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:43.304638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220a202-dc7d-483e-9f3c-ba8a7a8b2722 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:43.390884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 263/529] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:43.392451 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bc11d-d3b9-4642-8641-bec5a604fa65 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:43.442667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:43.449924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220a202-dc7d-483e-9f3c-ba8a7a8b2722 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:43.496812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa8f00-1aee-4bde-93a2-29369391afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:43.497381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa8f00-1aee-4bde-93a2-29369391afe4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:43.497867 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa8f00-1aee-4bde-93a2-29369391afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:43.498335 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa8f00-1aee-4bde-93a2-29369391afe4 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:43.499054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa8f00-1aee-4bde-93a2-29369391afe4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:43.499365 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa8f00-1aee-4bde-93a2-29369391afe4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:43.501550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa8f00-1aee-4bde-93a2-29369391afe4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:43.525409 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 267/530] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:50:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:43.526557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa8f00-1aee-4bde-93a2-29369391afe4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:43.538439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3bc11d-d3b9-4642-8641-bec5a604fa65 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:43.563109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:43.584479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454a929-8d3e-4a03-a2bf-a3988ce091e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:43.585330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a929-8d3e-4a03-a2bf-a3988ce091e2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:43.586153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a929-8d3e-4a03-a2bf-a3988ce091e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:43.586153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a929-8d3e-4a03-a2bf-a3988ce091e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:43.602558 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454a929-8d3e-4a03-a2bf-a3988ce091e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:43.604606 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6454a929-8d3e-4a03-a2bf-a3988ce091e2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-6454a929-8d3e-4a03-a2bf-a3988ce091e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:43.624642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:43.625815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:43.626911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:43.626911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:43.626911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:43.629240 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 264/531] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:43.630502 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454a929-8d3e-4a03-a2bf-a3988ce091e2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:43.641646 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa8f00-1aee-4bde-93a2-29369391afe4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:43.680543 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f05f10-da9b-4ee4-bddb-d7c978c8f347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:43.681322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f05f10-da9b-4ee4-bddb-d7c978c8f347 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:43.681668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f05f10-da9b-4ee4-bddb-d7c978c8f347 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:43.682008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f05f10-da9b-4ee4-bddb-d7c978c8f347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:43.693634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f05f10-da9b-4ee4-bddb-d7c978c8f347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:43.695507 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f05f10-da9b-4ee4-bddb-d7c978c8f347 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-22f05f10-da9b-4ee4-bddb-d7c978c8f347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:43.712746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:43.713896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:43.715244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:43.715244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:43.715244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:43.716629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 268/532] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:43.717710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f05f10-da9b-4ee4-bddb-d7c978c8f347 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:43.728140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:43.761035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454a929-8d3e-4a03-a2bf-a3988ce091e2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:43.798202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632242cf-6fc3-4f2a-b9fa-517eb793c1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:43.798758 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632242cf-6fc3-4f2a-b9fa-517eb793c1ab None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:43.799036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632242cf-6fc3-4f2a-b9fa-517eb793c1ab None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:43.799359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632242cf-6fc3-4f2a-b9fa-517eb793c1ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:43.800206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632242cf-6fc3-4f2a-b9fa-517eb793c1ab None admin] RBAC: Adding query filter params (role.id=bd638a70b0d5447ab1d78f20ef54200e, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=6c83e30a9fd04385b44ee3a3b72e5099) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:43.800573 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632242cf-6fc3-4f2a-b9fa-517eb793c1ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:43.802125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632242cf-6fc3-4f2a-b9fa-517eb793c1ab None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:43.808308 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 265/533] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:43 2022] GET /identity/v3/role_assignments?user.id=6c83e30a9fd04385b44ee3a3b72e5099&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=bd638a70b0d5447ab1d78f20ef54200e => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:43.808907 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632242cf-6fc3-4f2a-b9fa-517eb793c1ab None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:43.842925 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f05f10-da9b-4ee4-bddb-d7c978c8f347 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:43.880915 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:43.884447 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e819d-e9d1-4fff-91c3-37c62ca59c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:43.886174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e819d-e9d1-4fff-91c3-37c62ca59c2b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:43.886670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e819d-e9d1-4fff-91c3-37c62ca59c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:43.887111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e819d-e9d1-4fff-91c3-37c62ca59c2b None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:43.888646 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e819d-e9d1-4fff-91c3-37c62ca59c2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:43.894273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e819d-e9d1-4fff-91c3-37c62ca59c2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:43.894273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e819d-e9d1-4fff-91c3-37c62ca59c2b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:43.906972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 269/534] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:43.912182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e819d-e9d1-4fff-91c3-37c62ca59c2b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:43.990855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:44.028832 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e819d-e9d1-4fff-91c3-37c62ca59c2b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:44.066480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1f6de-8821-4b8b-af23-42113e2f89bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:44.067453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1f6de-8821-4b8b-af23-42113e2f89bd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:44.067965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1f6de-8821-4b8b-af23-42113e2f89bd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:44.068437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f1f6de-8821-4b8b-af23-42113e2f89bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:44.076315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1f6de-8821-4b8b-af23-42113e2f89bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:44.078305 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f1f6de-8821-4b8b-af23-42113e2f89bd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c3f1f6de-8821-4b8b-af23-42113e2f89bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:50:44.091885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:44.092829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:44.093699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:50:44.093699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:50:44.093699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:50:44.093699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:50:44.093699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:50:44.093699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:50:44.093699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:44.093699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:44.096807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 270/535] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:44.097129 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632242cf-6fc3-4f2a-b9fa-517eb793c1ab None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:44.104888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1f6de-8821-4b8b-af23-42113e2f89bd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:44.139042 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645fce7-34cb-47a0-a190-0e3355de6f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:44.139918 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645fce7-34cb-47a0-a190-0e3355de6f65 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:44.140339 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645fce7-34cb-47a0-a190-0e3355de6f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:44.140750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645fce7-34cb-47a0-a190-0e3355de6f65 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:44.141528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645fce7-34cb-47a0-a190-0e3355de6f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:44.141994 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645fce7-34cb-47a0-a190-0e3355de6f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:44.143483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645fce7-34cb-47a0-a190-0e3355de6f65 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:44.156239 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 266/536] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:44.162288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645fce7-34cb-47a0-a190-0e3355de6f65 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:44.282278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:44.282480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f1f6de-8821-4b8b-af23-42113e2f89bd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:44.291034 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645fce7-34cb-47a0-a190-0e3355de6f65 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:44.328986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25293c-f07e-4515-a066-ffbb52aad6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:44.330367 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25293c-f07e-4515-a066-ffbb52aad6e9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:44.331265 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25293c-f07e-4515-a066-ffbb52aad6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:44.332081 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25293c-f07e-4515-a066-ffbb52aad6e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:44.340208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25293c-f07e-4515-a066-ffbb52aad6e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:44.342620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25293c-f07e-4515-a066-ffbb52aad6e9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:44.353892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-8c25293c-f07e-4515-a066-ffbb52aad6e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:50:44.358248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:44.368448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:44.369296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:50:44.369296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:50:44.369296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:50:44.369296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:50:44.369296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:50:44.369296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:50:44.369296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:44.369296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:44.369296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 267/537] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:44.369296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25293c-f07e-4515-a066-ffbb52aad6e9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:44.376363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a2dff-fe40-49a3-b4b5-7a02a95f0a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:44.376363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2dff-fe40-49a3-b4b5-7a02a95f0a02 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:44.376363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2dff-fe40-49a3-b4b5-7a02a95f0a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:44.383893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2dff-fe40-49a3-b4b5-7a02a95f0a02 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:44.383893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a2dff-fe40-49a3-b4b5-7a02a95f0a02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:44.383893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a2dff-fe40-49a3-b4b5-7a02a95f0a02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:44.384605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a2dff-fe40-49a3-b4b5-7a02a95f0a02 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:44.414589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 271/538] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:50:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:44.419715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a2dff-fe40-49a3-b4b5-7a02a95f0a02 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:44.584372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25293c-f07e-4515-a066-ffbb52aad6e9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:44.632037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a2dff-fe40-49a3-b4b5-7a02a95f0a02 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:44.659410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5499a6-129c-4765-8560-55a84c8f3841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:44.660055 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5499a6-129c-4765-8560-55a84c8f3841 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:44.662863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5499a6-129c-4765-8560-55a84c8f3841 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:44.663143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5499a6-129c-4765-8560-55a84c8f3841 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:44.663867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5499a6-129c-4765-8560-55a84c8f3841 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:44.665282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5499a6-129c-4765-8560-55a84c8f3841 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:44.666719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5499a6-129c-4765-8560-55a84c8f3841 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:44.692872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 268/539] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:50:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:44.695507 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5499a6-129c-4765-8560-55a84c8f3841 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:44.701950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4228974-46b8-4c27-acef-e057fe511e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:44.702568 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228974-46b8-4c27-acef-e057fe511e5d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:44.702855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228974-46b8-4c27-acef-e057fe511e5d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:44.703126 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4228974-46b8-4c27-acef-e057fe511e5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:44.703878 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4228974-46b8-4c27-acef-e057fe511e5d None admin] RBAC: Adding query filter params (role.id=bd638a70b0d5447ab1d78f20ef54200e, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=f49116f202774e4da0c96875ffa08288) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:44.704191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4228974-46b8-4c27-acef-e057fe511e5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:44.708950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4228974-46b8-4c27-acef-e057fe511e5d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:44.718659 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 272/540] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:44 2022] GET /identity/v3/role_assignments?user.id=f49116f202774e4da0c96875ffa08288&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=bd638a70b0d5447ab1d78f20ef54200e => generated 259 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:44.724441 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:44.888547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5499a6-129c-4765-8560-55a84c8f3841 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:44.937141 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26bcc2-283c-46d0-8527-e24ae3e3e892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:44.937761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26bcc2-283c-46d0-8527-e24ae3e3e892 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:44.938037 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26bcc2-283c-46d0-8527-e24ae3e3e892 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:44.938305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26bcc2-283c-46d0-8527-e24ae3e3e892 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:44.939035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26bcc2-283c-46d0-8527-e24ae3e3e892 None admin] RBAC: Adding query filter params (role.id=bd638a70b0d5447ab1d78f20ef54200e, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=c33f1237eb614223a062bafb7a49eac6) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:44.939343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26bcc2-283c-46d0-8527-e24ae3e3e892 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:44.940785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26bcc2-283c-46d0-8527-e24ae3e3e892 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:44.953162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 269/541] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:44 2022] GET /identity/v3/role_assignments?user.id=c33f1237eb614223a062bafb7a49eac6&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=bd638a70b0d5447ab1d78f20ef54200e => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:45.037516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456b4b-1f8b-4458-93d5-62ef07fced89 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:45.037855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456b4b-1f8b-4458-93d5-62ef07fced89 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:45.038078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81456b4b-1f8b-4458-93d5-62ef07fced89 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:45.039608 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 273/542] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:45.045655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb084291-79c1-4e4d-bd9c-00db26011031 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:45.045947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb084291-79c1-4e4d-bd9c-00db26011031 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:45.046213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb084291-79c1-4e4d-bd9c-00db26011031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:45.072230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fb084291-79c1-4e4d-bd9c-00db26011031 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:45.073478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fb084291-79c1-4e4d-bd9c-00db26011031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:45.156068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 270/543] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:50:45.251324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e08579-3d62-44b3-865c-521b0c8c542e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:45.252339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e08579-3d62-44b3-865c-521b0c8c542e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:45.253112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e08579-3d62-44b3-865c-521b0c8c542e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:45.255732 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 274/544] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:50:45.261611 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f8820-34a9-4a56-9fe4-7cb94c12a174 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:45.262085 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f8820-34a9-4a56-9fe4-7cb94c12a174 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:45.262171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f8820-34a9-4a56-9fe4-7cb94c12a174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:45.288881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2a7f8820-34a9-4a56-9fe4-7cb94c12a174 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:45.290095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2a7f8820-34a9-4a56-9fe4-7cb94c12a174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:45.292219 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:45.374065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 271/545] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:45.533763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e08579-3d62-44b3-865c-521b0c8c542e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:45.601757 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:45.660887 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e08579-3d62-44b3-865c-521b0c8c542e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:45.696522 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c758bc-2974-47ff-bcf3-87b6396c58e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:45.697155 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c758bc-2974-47ff-bcf3-87b6396c58e8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:45.697437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c758bc-2974-47ff-bcf3-87b6396c58e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:45.697709 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c758bc-2974-47ff-bcf3-87b6396c58e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:45.708590 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c758bc-2974-47ff-bcf3-87b6396c58e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-65c758bc-2974-47ff-bcf3-87b6396c58e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:45.715097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:45.716869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:45.717944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:45.717944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:45.717944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:45.717944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:45.717944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:45.717944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:45.717944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:45.717944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:45.717944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:45.717944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:45.717944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:45.717944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:45.717944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 275/546] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:45.721883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f8820-34a9-4a56-9fe4-7cb94c12a174 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:45.758052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c758bc-2974-47ff-bcf3-87b6396c58e8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:45.900999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c758bc-2974-47ff-bcf3-87b6396c58e8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:45.925235 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:45.951236 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f8820-34a9-4a56-9fe4-7cb94c12a174 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:45.975394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f7511-4714-426a-9156-2c1eb6981fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:45.976455 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f7511-4714-426a-9156-2c1eb6981fea None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:45.976940 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f7511-4714-426a-9156-2c1eb6981fea None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:45.977435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386f7511-4714-426a-9156-2c1eb6981fea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:46.000457 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386f7511-4714-426a-9156-2c1eb6981fea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-386f7511-4714-426a-9156-2c1eb6981fea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:46.005554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:46.006440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:46.007246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:46.007246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:46.007246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:46.007246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:46.007246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:46.007246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:46.007246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:46.007246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:46.007246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:46.007246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:46.007246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:46.007246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:46.017329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 276/547] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:46.024650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f7511-4714-426a-9156-2c1eb6981fea None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:46.045288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cb49b-d2a8-4bb9-bc57-95c47090f616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:46.045919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cb49b-d2a8-4bb9-bc57-95c47090f616 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:46.046196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cb49b-d2a8-4bb9-bc57-95c47090f616 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:46.046464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9cb49b-d2a8-4bb9-bc57-95c47090f616 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:46.047130 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cb49b-d2a8-4bb9-bc57-95c47090f616 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:46.047431 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cb49b-d2a8-4bb9-bc57-95c47090f616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:46.052952 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9cb49b-d2a8-4bb9-bc57-95c47090f616 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:46.060919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:46.065744 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 272/548] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:46.073127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cb49b-d2a8-4bb9-bc57-95c47090f616 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:46.161681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386f7511-4714-426a-9156-2c1eb6981fea None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:46.194133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9cb49b-d2a8-4bb9-bc57-95c47090f616 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:46.199191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08f8272-aeee-43cd-83a7-e7b1a8053c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:46.199811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8272-aeee-43cd-83a7-e7b1a8053c19 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:46.201053 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8272-aeee-43cd-83a7-e7b1a8053c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:46.201472 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08f8272-aeee-43cd-83a7-e7b1a8053c19 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:46.202186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f8272-aeee-43cd-83a7-e7b1a8053c19 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:46.202495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f8272-aeee-43cd-83a7-e7b1a8053c19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:46.203871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08f8272-aeee-43cd-83a7-e7b1a8053c19 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:46.217923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 277/549] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:46.219373 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72d4ec-4ee3-4ad1-a4e9-e0b3d02655da None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:46.219664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72d4ec-4ee3-4ad1-a4e9-e0b3d02655da None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:46.219961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72d4ec-4ee3-4ad1-a4e9-e0b3d02655da None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:46.221506 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 278/550] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:46.222750 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72d4ec-4ee3-4ad1-a4e9-e0b3d02655da None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:46.237548 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f4b3e-64be-4cdb-a800-3e17b97624c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:46.238189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f4b3e-64be-4cdb-a800-3e17b97624c6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:46.238473 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f4b3e-64be-4cdb-a800-3e17b97624c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:46.239291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f4b3e-64be-4cdb-a800-3e17b97624c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:46.253638 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f4b3e-64be-4cdb-a800-3e17b97624c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:46.255679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f4b3e-64be-4cdb-a800-3e17b97624c6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:46.263767 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-077f4b3e-64be-4cdb-a800-3e17b97624c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:46.276267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:46.283228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:46.284210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:46.284210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:46.284210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:46.284210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 273/551] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:46.284210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580af3cb-853f-4d12-a9f0-30afc405695e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:46.284210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580af3cb-853f-4d12-a9f0-30afc405695e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:46.284210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580af3cb-853f-4d12-a9f0-30afc405695e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:46.307856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-580af3cb-853f-4d12-a9f0-30afc405695e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:46.309118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-580af3cb-853f-4d12-a9f0-30afc405695e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:46.355550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee72d4ec-4ee3-4ad1-a4e9-e0b3d02655da None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:46.359141 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:46.388162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 274/552] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:46.389313 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580af3cb-853f-4d12-a9f0-30afc405695e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:46.407890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1a064-73ca-4e67-8cae-6906e5d04d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:46.407890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1a064-73ca-4e67-8cae-6906e5d04d74 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:46.407890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1a064-73ca-4e67-8cae-6906e5d04d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:46.407890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1a064-73ca-4e67-8cae-6906e5d04d74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:46.414512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1a064-73ca-4e67-8cae-6906e5d04d74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:46.416058 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1a064-73ca-4e67-8cae-6906e5d04d74 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-4bb1a064-73ca-4e67-8cae-6906e5d04d74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:46.433994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:46.435746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:46.436731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:46.436731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:46.436731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:46.440699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 279/553] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:46.441902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1a064-73ca-4e67-8cae-6906e5d04d74 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:46.540374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:46.578242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1a064-73ca-4e67-8cae-6906e5d04d74 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:46.595314 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580af3cb-853f-4d12-a9f0-30afc405695e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:46.635566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce435ea5-4b5e-4bd6-9a8a-31090b754519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:46.636269 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce435ea5-4b5e-4bd6-9a8a-31090b754519 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:46.636551 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce435ea5-4b5e-4bd6-9a8a-31090b754519 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:46.636873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce435ea5-4b5e-4bd6-9a8a-31090b754519 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:46.638375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce435ea5-4b5e-4bd6-9a8a-31090b754519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:46.638802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce435ea5-4b5e-4bd6-9a8a-31090b754519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:46.640844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce435ea5-4b5e-4bd6-9a8a-31090b754519 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:46.659204 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 275/554] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:46.660683 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce435ea5-4b5e-4bd6-9a8a-31090b754519 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:46.678664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdc3d6-5cac-428a-8eb7-020abb7c0c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:46.678664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdc3d6-5cac-428a-8eb7-020abb7c0c46 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:46.678664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdc3d6-5cac-428a-8eb7-020abb7c0c46 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:46.678664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcdc3d6-5cac-428a-8eb7-020abb7c0c46 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:46.679197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdc3d6-5cac-428a-8eb7-020abb7c0c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:46.679357 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdc3d6-5cac-428a-8eb7-020abb7c0c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:46.681071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcdc3d6-5cac-428a-8eb7-020abb7c0c46 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:46.708531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 280/555] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:46.709843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdc3d6-5cac-428a-8eb7-020abb7c0c46 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:46.714557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:46.777104 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce435ea5-4b5e-4bd6-9a8a-31090b754519 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:46.819100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7a075-0fde-408d-a6b2-a2fb7b46f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:46.820261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7a075-0fde-408d-a6b2-a2fb7b46f986 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:46.820613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7a075-0fde-408d-a6b2-a2fb7b46f986 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:46.820959 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7a075-0fde-408d-a6b2-a2fb7b46f986 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:46.831800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7a075-0fde-408d-a6b2-a2fb7b46f986 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:46.833823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7a075-0fde-408d-a6b2-a2fb7b46f986 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:46.846180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcdc3d6-5cac-428a-8eb7-020abb7c0c46 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-c2f7a075-0fde-408d-a6b2-a2fb7b46f986 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:46.850006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:46.850921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:46.851837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:46.851837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:46.851837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:46.851837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:46.851837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:46.851837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:46.851837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:46.851837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:46.851837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:50:46.851837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:46.855822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 276/556] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:50:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:46.857263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7a075-0fde-408d-a6b2-a2fb7b46f986 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:46.893637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a87b9-a307-481b-aa5b-daeea7cc0f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:46.894277 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a87b9-a307-481b-aa5b-daeea7cc0f3b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:46.894562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a87b9-a307-481b-aa5b-daeea7cc0f3b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:46.895086 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a87b9-a307-481b-aa5b-daeea7cc0f3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:46.908731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a87b9-a307-481b-aa5b-daeea7cc0f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-314a87b9-a307-481b-aa5b-daeea7cc0f3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:46.913707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:46.914711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:46.916007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:46.916007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:46.916007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:46.916007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:46.916007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:46.916007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:46.916007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:46.916007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:46.916007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:46.916007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:46.916007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:46.916007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:46.916007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 281/557] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:46.916007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a87b9-a307-481b-aa5b-daeea7cc0f3b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:46.920732 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:46.982463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7a075-0fde-408d-a6b2-a2fb7b46f986 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:46.984195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:47.018955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb496d-3b97-4b92-b429-7a4a1430a042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:47.019733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb496d-3b97-4b92-b429-7a4a1430a042 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.020154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb496d-3b97-4b92-b429-7a4a1430a042 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.020522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb496d-3b97-4b92-b429-7a4a1430a042 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.028995 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb496d-3b97-4b92-b429-7a4a1430a042 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:47.029159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a87b9-a307-481b-aa5b-daeea7cc0f3b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:47.030632 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cb496d-3b97-4b92-b429-7a4a1430a042 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-68cb496d-3b97-4b92-b429-7a4a1430a042 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:47.043024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:47.044615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:47.045643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:47.045643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:47.045643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:47.045643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:47.045643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:47.045643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:47.045643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:47.045643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:47.045643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:50:47.045643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:47.049828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 277/558] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 24 07:50:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:47.050757 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb496d-3b97-4b92-b429-7a4a1430a042 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:47.071682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c44a7f-8197-4e7a-8c96-c369ad708722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:47.072630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c44a7f-8197-4e7a-8c96-c369ad708722 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.073114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c44a7f-8197-4e7a-8c96-c369ad708722 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.073569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c44a7f-8197-4e7a-8c96-c369ad708722 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.074577 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c44a7f-8197-4e7a-8c96-c369ad708722 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:47.075085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c44a7f-8197-4e7a-8c96-c369ad708722 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:47.076726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c44a7f-8197-4e7a-8c96-c369ad708722 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:47.107417 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 282/559] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Aug 24 07:50:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:47.108726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c44a7f-8197-4e7a-8c96-c369ad708722 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:47.157851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb496d-3b97-4b92-b429-7a4a1430a042 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:47.179156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:47.194038 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f438a4-ab7a-44d0-81b2-30d4b5ce5632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:47.194645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f438a4-ab7a-44d0-81b2-30d4b5ce5632 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.194919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f438a4-ab7a-44d0-81b2-30d4b5ce5632 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.195193 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f438a4-ab7a-44d0-81b2-30d4b5ce5632 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.197769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f438a4-ab7a-44d0-81b2-30d4b5ce5632 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:47.197769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f438a4-ab7a-44d0-81b2-30d4b5ce5632 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:47.197769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f438a4-ab7a-44d0-81b2-30d4b5ce5632 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:47.205589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 278/560] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:47.209804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f438a4-ab7a-44d0-81b2-30d4b5ce5632 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:47.220082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c44a7f-8197-4e7a-8c96-c369ad708722 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:47.236016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:47.254055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38fb8f3-0865-4f15-8311-e0bd7a5619d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:47.254656 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb8f3-0865-4f15-8311-e0bd7a5619d2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.254939 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb8f3-0865-4f15-8311-e0bd7a5619d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.255213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fb8f3-0865-4f15-8311-e0bd7a5619d2 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.255965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fb8f3-0865-4f15-8311-e0bd7a5619d2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:47.256274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fb8f3-0865-4f15-8311-e0bd7a5619d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:47.257690 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38fb8f3-0865-4f15-8311-e0bd7a5619d2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:47.274541 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 283/561] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 24 07:50:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:47.275770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fab49-8da9-4b74-ba64-ecb88b830250 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.276106 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fab49-8da9-4b74-ba64-ecb88b830250 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.276386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fab49-8da9-4b74-ba64-ecb88b830250 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.277616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 284/562] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:47.279353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217072d6-e7fc-4ad3-97fc-7e18506bcef3 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.279807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217072d6-e7fc-4ad3-97fc-7e18506bcef3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.279948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217072d6-e7fc-4ad3-97fc-7e18506bcef3 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.282446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 285/563] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:47.282446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217072d6-e7fc-4ad3-97fc-7e18506bcef3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:47.316953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f438a4-ab7a-44d0-81b2-30d4b5ce5632 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:47.352628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f2687-1460-425d-b998-206aff6c0574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:47.353233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2687-1460-425d-b998-206aff6c0574 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.353514 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2687-1460-425d-b998-206aff6c0574 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.353784 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f2687-1460-425d-b998-206aff6c0574 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.383694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217072d6-e7fc-4ad3-97fc-7e18506bcef3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:47.403811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:47.417039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a05039-d9cc-4ba5-af3e-ccd3d29df2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:47.417667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a05039-d9cc-4ba5-af3e-ccd3d29df2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.417975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a05039-d9cc-4ba5-af3e-ccd3d29df2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.418258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a05039-d9cc-4ba5-af3e-ccd3d29df2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.425128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f2687-1460-425d-b998-206aff6c0574 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:47.426565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f2687-1460-425d-b998-206aff6c0574 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:47.428689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a05039-d9cc-4ba5-af3e-ccd3d29df2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:47.430104 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a05039-d9cc-4ba5-af3e-ccd3d29df2f2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b6a05039-d9cc-4ba5-af3e-ccd3d29df2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:47.445516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:47.446535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:47.447435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:47.447435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:47.447435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:47.447435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 286/564] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:47.447435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a05039-d9cc-4ba5-af3e-ccd3d29df2f2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:47.454295 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:47.529347 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 279/565] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:47.530612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25fe23-c9e2-4d4d-bf27-eb527e07d5b8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.530893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25fe23-c9e2-4d4d-bf27-eb527e07d5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.531166 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25fe23-c9e2-4d4d-bf27-eb527e07d5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.547274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a05039-d9cc-4ba5-af3e-ccd3d29df2f2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:47.548221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-bb25fe23-c9e2-4d4d-bf27-eb527e07d5b8 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:47.549400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bb25fe23-c9e2-4d4d-bf27-eb527e07d5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:47.580969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7823a57a-2621-48cc-8bac-89814c93e6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:47.581597 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a57a-2621-48cc-8bac-89814c93e6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.581880 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a57a-2621-48cc-8bac-89814c93e6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.582155 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7823a57a-2621-48cc-8bac-89814c93e6c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.593277 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823a57a-2621-48cc-8bac-89814c93e6c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:47.594710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7823a57a-2621-48cc-8bac-89814c93e6c3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7823a57a-2621-48cc-8bac-89814c93e6c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:47.608440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:47.609448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:47.610745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:47.610745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:47.610745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:47.610745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 287/566] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:47.610745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270422-508b-4594-b212-0521b01ca05c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.611105 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270422-508b-4594-b212-0521b01ca05c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.611105 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1270422-508b-4594-b212-0521b01ca05c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.616489 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 280/567] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:47.617339 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25fe23-c9e2-4d4d-bf27-eb527e07d5b8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:47.632737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a1270422-508b-4594-b212-0521b01ca05c None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:47.633910 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a1270422-508b-4594-b212-0521b01ca05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:47.652786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:47.684339 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:47.704891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 288/568] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:47.705733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1270422-508b-4594-b212-0521b01ca05c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:47.760541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25fe23-c9e2-4d4d-bf27-eb527e07d5b8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:47.798769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9baea-4674-4a11-ab44-efc66cb9ffed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:47.799680 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9baea-4674-4a11-ab44-efc66cb9ffed None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.800201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9baea-4674-4a11-ab44-efc66cb9ffed None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.800676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9baea-4674-4a11-ab44-efc66cb9ffed None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.801688 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9baea-4674-4a11-ab44-efc66cb9ffed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:47.802217 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9baea-4674-4a11-ab44-efc66cb9ffed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:47.803912 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d9baea-4674-4a11-ab44-efc66cb9ffed None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:47.818925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 281/569] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:47.820187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9baea-4674-4a11-ab44-efc66cb9ffed None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:47.844568 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1270422-508b-4594-b212-0521b01ca05c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:47.881840 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d772b-3881-46ab-adcf-0ec7af0c2ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:47.882857 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d772b-3881-46ab-adcf-0ec7af0c2ec9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.883406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d772b-3881-46ab-adcf-0ec7af0c2ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.883931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d772b-3881-46ab-adcf-0ec7af0c2ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.895868 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d772b-3881-46ab-adcf-0ec7af0c2ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:47.897411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d772b-3881-46ab-adcf-0ec7af0c2ec9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-961d772b-3881-46ab-adcf-0ec7af0c2ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:47.912736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:47.913721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:47.914661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:47.914661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:47.914661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:47.914661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 289/570] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:47.914661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d772b-3881-46ab-adcf-0ec7af0c2ec9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:47.924115 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:47.941744 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9baea-4674-4a11-ab44-efc66cb9ffed None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:47.957178 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:47.979080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba376f1-d869-46b1-980a-a558ab6e5bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:47.979687 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba376f1-d869-46b1-980a-a558ab6e5bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:47.980005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba376f1-d869-46b1-980a-a558ab6e5bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:47.980277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba376f1-d869-46b1-980a-a558ab6e5bb1 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:47.980988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba376f1-d869-46b1-980a-a558ab6e5bb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:47.981317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba376f1-d869-46b1-980a-a558ab6e5bb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:47.982932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba376f1-d869-46b1-980a-a558ab6e5bb1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:47.994549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 282/571] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:47.995345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba376f1-d869-46b1-980a-a558ab6e5bb1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:48.019151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d772b-3881-46ab-adcf-0ec7af0c2ec9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:48.051914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd0156-da06-4c59-a49e-87ec357dcd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:48.052488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd0156-da06-4c59-a49e-87ec357dcd3f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:48.052770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd0156-da06-4c59-a49e-87ec357dcd3f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:48.053048 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd0156-da06-4c59-a49e-87ec357dcd3f None admin] PATH_INFO: `/v3/users/glance` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:48.060763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd0156-da06-4c59-a49e-87ec357dcd3f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:48.062184 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd0156-da06-4c59-a49e-87ec357dcd3f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-70bd0156-da06-4c59-a49e-87ec357dcd3f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:48.072901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:48.073891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:48.075045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:48.075045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:48.075045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:48.075045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:48.075045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:48.075045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:48.075045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:48.075045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:48.075045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:50:48.075045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:48.075045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 290/572] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:48.075045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd0156-da06-4c59-a49e-87ec357dcd3f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:48.094294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba376f1-d869-46b1-980a-a558ab6e5bb1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:48.128385 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3828f-fa8f-4dbb-9479-01fe75d445bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:48.129006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3828f-fa8f-4dbb-9479-01fe75d445bd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:48.129280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3828f-fa8f-4dbb-9479-01fe75d445bd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:48.129548 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3828f-fa8f-4dbb-9479-01fe75d445bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:48.139384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3828f-fa8f-4dbb-9479-01fe75d445bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:48.143123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-39f3828f-fa8f-4dbb-9479-01fe75d445bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:48.144110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:48.145272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:48.146423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:48.146423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:48.146423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:48.146423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:48.146423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:48.146423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:48.146423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:48.146423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:48.146423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:48.146423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:48.146423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:48.146423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:48.146423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 283/573] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:48.146423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3828f-fa8f-4dbb-9479-01fe75d445bd None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:48.180643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:48.183619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd0156-da06-4c59-a49e-87ec357dcd3f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:48.217231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5dbe1-1d41-4ebb-a321-4402c0e7f05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:48.217835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5dbe1-1d41-4ebb-a321-4402c0e7f05d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:48.218109 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5dbe1-1d41-4ebb-a321-4402c0e7f05d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:48.218382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d5dbe1-1d41-4ebb-a321-4402c0e7f05d None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:48.219009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5dbe1-1d41-4ebb-a321-4402c0e7f05d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:48.219308 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5dbe1-1d41-4ebb-a321-4402c0e7f05d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:48.220751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d5dbe1-1d41-4ebb-a321-4402c0e7f05d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:48.232334 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 291/574] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:48.233130 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5dbe1-1d41-4ebb-a321-4402c0e7f05d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:48.248788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3828f-fa8f-4dbb-9479-01fe75d445bd None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:48.282784 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814aeeeb-5160-42e1-8f3d-2b780e75837f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:48.283624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814aeeeb-5160-42e1-8f3d-2b780e75837f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:48.284052 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814aeeeb-5160-42e1-8f3d-2b780e75837f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:48.284330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814aeeeb-5160-42e1-8f3d-2b780e75837f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:48.294884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814aeeeb-5160-42e1-8f3d-2b780e75837f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-814aeeeb-5160-42e1-8f3d-2b780e75837f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:48.299636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:48.300761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:48.301814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:48.301814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:48.301814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:48.301814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:48.301814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:48.301814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:48.301814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:48.301814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:48.301814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:48.301814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:48.301814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:48.301814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:48.301814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 284/575] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:48.302824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814aeeeb-5160-42e1-8f3d-2b780e75837f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:48.334995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d5dbe1-1d41-4ebb-a321-4402c0e7f05d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:48.360574 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:48.368867 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb0700-2f29-4c26-bc3c-f187ddc56a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:48.369518 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb0700-2f29-4c26-bc3c-f187ddc56a87 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:48.369775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb0700-2f29-4c26-bc3c-f187ddc56a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:48.370049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb0700-2f29-4c26-bc3c-f187ddc56a87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:48.378275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb0700-2f29-4c26-bc3c-f187ddc56a87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:48.378275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb0700-2f29-4c26-bc3c-f187ddc56a87 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-3dcb0700-2f29-4c26-bc3c-f187ddc56a87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:50:48.390306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:48.392123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:48.393112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:50:48.393112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:50:48.393112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:50:48.393112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:50:48.393112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:50:48.393112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:50:48.393112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:48.393112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:48.396100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 292/576] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:48.397360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb0700-2f29-4c26-bc3c-f187ddc56a87 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:48.400431 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:48.408845 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814aeeeb-5160-42e1-8f3d-2b780e75837f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:48.441925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b0eba-27f3-4d99-98ab-c78fe17fa1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:48.442524 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b0eba-27f3-4d99-98ab-c78fe17fa1b6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:48.442801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b0eba-27f3-4d99-98ab-c78fe17fa1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:48.443071 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b0eba-27f3-4d99-98ab-c78fe17fa1b6 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:48.443791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b0eba-27f3-4d99-98ab-c78fe17fa1b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:48.444122 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b0eba-27f3-4d99-98ab-c78fe17fa1b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:48.445530 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3b0eba-27f3-4d99-98ab-c78fe17fa1b6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:48.462357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 285/577] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Aug 24 07:50:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:48.463151 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b0eba-27f3-4d99-98ab-c78fe17fa1b6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:48.500386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb0700-2f29-4c26-bc3c-f187ddc56a87 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:48.534048 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcf94a-0243-48a4-810a-44c9b12c0bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:48.534645 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcf94a-0243-48a4-810a-44c9b12c0bfe None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:48.534922 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcf94a-0243-48a4-810a-44c9b12c0bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:48.535194 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bcf94a-0243-48a4-810a-44c9b12c0bfe None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:48.536275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcf94a-0243-48a4-810a-44c9b12c0bfe None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:48.536579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcf94a-0243-48a4-810a-44c9b12c0bfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:48.538271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bcf94a-0243-48a4-810a-44c9b12c0bfe None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:48.547031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 293/578] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:48.547819 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcf94a-0243-48a4-810a-44c9b12c0bfe None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:48.563648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b0eba-27f3-4d99-98ab-c78fe17fa1b6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:48.595222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:48.597502 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e72b01-c418-4fd5-ac39-86fdf8d198f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:48.598122 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e72b01-c418-4fd5-ac39-86fdf8d198f0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:48.598452 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e72b01-c418-4fd5-ac39-86fdf8d198f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:48.604462 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e72b01-c418-4fd5-ac39-86fdf8d198f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:48.605284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e72b01-c418-4fd5-ac39-86fdf8d198f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:48.606707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e72b01-c418-4fd5-ac39-86fdf8d198f0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-11e72b01-c418-4fd5-ac39-86fdf8d198f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:50:48.617443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:48.618362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:48.619268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:50:48.619268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:50:48.619268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:50:48.619268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:50:48.619268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:50:48.619268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:50:48.619268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:48.619268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:48.620566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 286/579] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:48.621552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e72b01-c418-4fd5-ac39-86fdf8d198f0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:48.637158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:48.647315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bcf94a-0243-48a4-810a-44c9b12c0bfe None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:48.679569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c563d-e57f-48fd-a25a-faf150963291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:48.680192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c563d-e57f-48fd-a25a-faf150963291 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:48.680466 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c563d-e57f-48fd-a25a-faf150963291 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:48.680731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c563d-e57f-48fd-a25a-faf150963291 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:48.681377 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c563d-e57f-48fd-a25a-faf150963291 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:48.681676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c563d-e57f-48fd-a25a-faf150963291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:48.683016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c563d-e57f-48fd-a25a-faf150963291 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:48.691493 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 294/580] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:48.692305 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c563d-e57f-48fd-a25a-faf150963291 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:48.727222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e72b01-c418-4fd5-ac39-86fdf8d198f0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:48.761149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d68714-5b89-458f-98c0-5ff0364d307c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:48.761754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d68714-5b89-458f-98c0-5ff0364d307c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:48.762035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d68714-5b89-458f-98c0-5ff0364d307c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:48.762306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d68714-5b89-458f-98c0-5ff0364d307c None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:48.763541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d68714-5b89-458f-98c0-5ff0364d307c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:48.763937 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d68714-5b89-458f-98c0-5ff0364d307c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:48.765293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d68714-5b89-458f-98c0-5ff0364d307c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:48.776442 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 287/581] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:50:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:48.777230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d68714-5b89-458f-98c0-5ff0364d307c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:48.790021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c563d-e57f-48fd-a25a-faf150963291 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:48.800138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:48.823157 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3147f8-f776-4f03-9854-31f1739c43d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:48.823720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3147f8-f776-4f03-9854-31f1739c43d4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:48.824033 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3147f8-f776-4f03-9854-31f1739c43d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:48.824304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3147f8-f776-4f03-9854-31f1739c43d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:48.835211 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3147f8-f776-4f03-9854-31f1739c43d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:48.836663 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3147f8-f776-4f03-9854-31f1739c43d4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:48.847793 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5d3147f8-f776-4f03-9854-31f1739c43d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:48.850495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:48.851883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:48.852803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:48.852803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:48.852803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:48.852803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 295/582] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:48.852803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3147f8-f776-4f03-9854-31f1739c43d4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:48.883155 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d68714-5b89-458f-98c0-5ff0364d307c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:48.916649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce3f7c-4dfe-4c55-bd08-649f27917d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:48.917348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce3f7c-4dfe-4c55-bd08-649f27917d4f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:48.917630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce3f7c-4dfe-4c55-bd08-649f27917d4f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:48.917899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bce3f7c-4dfe-4c55-bd08-649f27917d4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:48.928574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce3f7c-4dfe-4c55-bd08-649f27917d4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:48.930005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bce3f7c-4dfe-4c55-bd08-649f27917d4f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-1bce3f7c-4dfe-4c55-bd08-649f27917d4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:48.944412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:48.945457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:48.946908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:48.946908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:48.946908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:48.946908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 288/583] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:48.946908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce3f7c-4dfe-4c55-bd08-649f27917d4f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:48.953940 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3147f8-f776-4f03-9854-31f1739c43d4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:48.988695 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff4fdb-b412-42ec-b0e2-51d99d424775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:48.989300 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff4fdb-b412-42ec-b0e2-51d99d424775 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:48.989584 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff4fdb-b412-42ec-b0e2-51d99d424775 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:48.989860 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ff4fdb-b412-42ec-b0e2-51d99d424775 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:48.990552 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff4fdb-b412-42ec-b0e2-51d99d424775 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:48.990870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff4fdb-b412-42ec-b0e2-51d99d424775 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:48.992335 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ff4fdb-b412-42ec-b0e2-51d99d424775 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:49.005197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 296/584] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:50:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:49.005960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff4fdb-b412-42ec-b0e2-51d99d424775 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:49.029508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:49.052260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bce3f7c-4dfe-4c55-bd08-649f27917d4f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:49.075530 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:49.085877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01664ace-77a1-4b55-abd4-8c4babc4b626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:49.086489 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01664ace-77a1-4b55-abd4-8c4babc4b626 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:49.086766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01664ace-77a1-4b55-abd4-8c4babc4b626 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:49.087033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01664ace-77a1-4b55-abd4-8c4babc4b626 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:49.098024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01664ace-77a1-4b55-abd4-8c4babc4b626 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:49.099441 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01664ace-77a1-4b55-abd4-8c4babc4b626 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:49.104102 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ff4fdb-b412-42ec-b0e2-51d99d424775 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-01664ace-77a1-4b55-abd4-8c4babc4b626 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:49.113556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:49.119822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:49.120791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:49.120791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:49.120791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:49.120791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 289/585] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:49.120791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01664ace-77a1-4b55-abd4-8c4babc4b626 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:49.146022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c385907-c92e-4f09-8b97-fc7835467c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:49.146681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c385907-c92e-4f09-8b97-fc7835467c8d None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:49.146962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c385907-c92e-4f09-8b97-fc7835467c8d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:49.147239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c385907-c92e-4f09-8b97-fc7835467c8d None admin] PATH_INFO: `/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/9b99cff7a5f549adadee002f8ab1f5d9/roles/bd638a70b0d5447ab1d78f20ef54200e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:49.161236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c385907-c92e-4f09-8b97-fc7835467c8d None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1074e261454981a85d02b4b0f75ec5, user_id=9b99cff7a5f549adadee002f8ab1f5d9, role_id=bd638a70b0d5447ab1d78f20ef54200e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:49.162680 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c385907-c92e-4f09-8b97-fc7835467c8d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:49.216011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 297/586] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:50:49 2022] PUT /identity/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/9b99cff7a5f549adadee002f8ab1f5d9/roles/bd638a70b0d5447ab1d78f20ef54200e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:49.218348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01664ace-77a1-4b55-abd4-8c4babc4b626 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:49.227220 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c385907-c92e-4f09-8b97-fc7835467c8d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:49.257859 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa826c-210f-45b5-9928-1749558f7758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:49.258514 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa826c-210f-45b5-9928-1749558f7758 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:49.258798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa826c-210f-45b5-9928-1749558f7758 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:49.259069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aa826c-210f-45b5-9928-1749558f7758 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:49.259722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa826c-210f-45b5-9928-1749558f7758 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:49.260058 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa826c-210f-45b5-9928-1749558f7758 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:49.261477 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aa826c-210f-45b5-9928-1749558f7758 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:49.275203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 290/587] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:49.276229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa826c-210f-45b5-9928-1749558f7758 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:49.316543 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:49.321008 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:49.350151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c385907-c92e-4f09-8b97-fc7835467c8d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:49.392524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23274646-5450-40a9-8785-6c837fff316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:49.393136 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23274646-5450-40a9-8785-6c837fff316b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:49.393416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23274646-5450-40a9-8785-6c837fff316b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:49.393685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23274646-5450-40a9-8785-6c837fff316b None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:49.394324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23274646-5450-40a9-8785-6c837fff316b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:49.394625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23274646-5450-40a9-8785-6c837fff316b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:49.396025 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23274646-5450-40a9-8785-6c837fff316b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:49.401138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aa826c-210f-45b5-9928-1749558f7758 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:49.409654 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 298/588] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:49.410796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23274646-5450-40a9-8785-6c837fff316b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:49.442989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c5d18-6712-4773-84eb-c5e02a26a925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:49.443596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c5d18-6712-4773-84eb-c5e02a26a925 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:49.443896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c5d18-6712-4773-84eb-c5e02a26a925 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:49.444173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c5d18-6712-4773-84eb-c5e02a26a925 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:49.444905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c5d18-6712-4773-84eb-c5e02a26a925 None admin] RBAC: Adding query filter params (role.id=bd638a70b0d5447ab1d78f20ef54200e, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=8255043f01fd46e4a8a5fde8e81c2bed) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:49.445212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c5d18-6712-4773-84eb-c5e02a26a925 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:49.446638 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c5d18-6712-4773-84eb-c5e02a26a925 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:49.453092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 291/589] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:49 2022] GET /identity/v3/role_assignments?user.id=8255043f01fd46e4a8a5fde8e81c2bed&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=bd638a70b0d5447ab1d78f20ef54200e => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:49.453900 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c5d18-6712-4773-84eb-c5e02a26a925 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:49.548834 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23274646-5450-40a9-8785-6c837fff316b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:49.581801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:49.583759 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:49.587757 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c5d18-6712-4773-84eb-c5e02a26a925 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:49.600050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb887f9-8218-43cc-b587-4205c2111d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:49.600050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb887f9-8218-43cc-b587-4205c2111d81 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:49.600050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb887f9-8218-43cc-b587-4205c2111d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:49.600050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb887f9-8218-43cc-b587-4205c2111d81 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:49.600449 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb887f9-8218-43cc-b587-4205c2111d81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:49.600449 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb887f9-8218-43cc-b587-4205c2111d81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:49.600449 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb887f9-8218-43cc-b587-4205c2111d81 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:49.606972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 299/590] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:49.608158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb887f9-8218-43cc-b587-4205c2111d81 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:49.629857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1580d45-ea12-4e2a-82b6-580f0d8cd855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:49.631151 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1580d45-ea12-4e2a-82b6-580f0d8cd855 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:49.631151 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1580d45-ea12-4e2a-82b6-580f0d8cd855 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:49.631607 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1580d45-ea12-4e2a-82b6-580f0d8cd855 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:49.641701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1580d45-ea12-4e2a-82b6-580f0d8cd855 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:49.642850 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1580d45-ea12-4e2a-82b6-580f0d8cd855 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f1580d45-ea12-4e2a-82b6-580f0d8cd855 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:50:49.664964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:49.665909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:49.666837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:50:49.666837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:50:49.666837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:50:49.666837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:50:49.666837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:50:49.666837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:50:49.666837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:49.666837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:49.667579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 292/591] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:49.668247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1580d45-ea12-4e2a-82b6-580f0d8cd855 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:49.738062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb887f9-8218-43cc-b587-4205c2111d81 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:49.784524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410dec2-fe1a-41a4-891c-4fb7add58b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:49.785337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410dec2-fe1a-41a4-891c-4fb7add58b12 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:49.785680 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410dec2-fe1a-41a4-891c-4fb7add58b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:49.786022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410dec2-fe1a-41a4-891c-4fb7add58b12 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:49.793695 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410dec2-fe1a-41a4-891c-4fb7add58b12 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:49.793835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1580d45-ea12-4e2a-82b6-580f0d8cd855 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:49.795254 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410dec2-fe1a-41a4-891c-4fb7add58b12 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f410dec2-fe1a-41a4-891c-4fb7add58b12 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:49.807314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:49.808292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:49.809347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:49.809347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:49.809347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:49.809347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:49.809347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:49.809347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:49.809347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:49.809347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:49.809347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:50:49.809347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:49.809347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 300/592] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:49.810020 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410dec2-fe1a-41a4-891c-4fb7add58b12 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:49.834598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c978cc-f2f6-4373-bc64-8f882204795a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:49.835552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c978cc-f2f6-4373-bc64-8f882204795a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:49.836046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c978cc-f2f6-4373-bc64-8f882204795a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:49.836592 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c978cc-f2f6-4373-bc64-8f882204795a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:49.845970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c978cc-f2f6-4373-bc64-8f882204795a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:49.847709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c978cc-f2f6-4373-bc64-8f882204795a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-48c978cc-f2f6-4373-bc64-8f882204795a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:49.860479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:49.861413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:49.862365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:49.862365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:49.862365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:49.862365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:49.862365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:49.862365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:49.862365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:49.862365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:49.862365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:50:49.862365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:49.865001 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 293/593] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:49.865955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c978cc-f2f6-4373-bc64-8f882204795a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:49.871916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:49.891062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:49.922277 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410dec2-fe1a-41a4-891c-4fb7add58b12 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:49.962060 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69438a-89fd-4598-8845-372f3a4be2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:49.962624 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69438a-89fd-4598-8845-372f3a4be2e9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:49.962973 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69438a-89fd-4598-8845-372f3a4be2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:49.963329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f69438a-89fd-4598-8845-372f3a4be2e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:49.964369 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69438a-89fd-4598-8845-372f3a4be2e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:49.964753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69438a-89fd-4598-8845-372f3a4be2e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:49.967350 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f69438a-89fd-4598-8845-372f3a4be2e9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:49.979834 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 301/594] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:50:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:49.980813 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69438a-89fd-4598-8845-372f3a4be2e9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:49.987690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c978cc-f2f6-4373-bc64-8f882204795a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:50.041734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae939e-ed44-453b-af64-f1b6c2685939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:50.043016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae939e-ed44-453b-af64-f1b6c2685939 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:50.043741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae939e-ed44-453b-af64-f1b6c2685939 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:50.044199 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae939e-ed44-453b-af64-f1b6c2685939 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:50.045353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae939e-ed44-453b-af64-f1b6c2685939 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:50.045833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae939e-ed44-453b-af64-f1b6c2685939 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:50.048615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae939e-ed44-453b-af64-f1b6c2685939 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:50.072293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 294/595] 10.222.0.62 () {56 vars in 1139 bytes} [Wed Aug 24 07:50:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:50.073778 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae939e-ed44-453b-af64-f1b6c2685939 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:50.089798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f69438a-89fd-4598-8845-372f3a4be2e9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:50.105429 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:50.127247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958966d6-959a-4725-898b-bfd16b300b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:50.127979 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958966d6-959a-4725-898b-bfd16b300b62 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:50.128354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958966d6-959a-4725-898b-bfd16b300b62 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:50.128725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958966d6-959a-4725-898b-bfd16b300b62 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:50.129599 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958966d6-959a-4725-898b-bfd16b300b62 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:50.130036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958966d6-959a-4725-898b-bfd16b300b62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:50.131537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958966d6-959a-4725-898b-bfd16b300b62 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:50.150706 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 302/596] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Aug 24 07:50:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:50.151687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958966d6-959a-4725-898b-bfd16b300b62 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:50.187223 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:50.218977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae939e-ed44-453b-af64-f1b6c2685939 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:50.264360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958966d6-959a-4725-898b-bfd16b300b62 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:50.264822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0026c7-84d6-424c-8a40-32bf127210f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:50.265536 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0026c7-84d6-424c-8a40-32bf127210f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:50.265816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0026c7-84d6-424c-8a40-32bf127210f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:50.266089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0026c7-84d6-424c-8a40-32bf127210f8 None admin] PATH_INFO: `/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/6c83e30a9fd04385b44ee3a3b72e5099/roles/bd638a70b0d5447ab1d78f20ef54200e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:50.285189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0026c7-84d6-424c-8a40-32bf127210f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1074e261454981a85d02b4b0f75ec5, user_id=6c83e30a9fd04385b44ee3a3b72e5099, role_id=bd638a70b0d5447ab1d78f20ef54200e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:50.287092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0026c7-84d6-424c-8a40-32bf127210f8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:50.305099 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954104b-82f5-4d83-8908-00cd84d40c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:50.305756 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954104b-82f5-4d83-8908-00cd84d40c11 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:50.306036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954104b-82f5-4d83-8908-00cd84d40c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:50.306309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e954104b-82f5-4d83-8908-00cd84d40c11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:50.319231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954104b-82f5-4d83-8908-00cd84d40c11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:50.320749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e954104b-82f5-4d83-8908-00cd84d40c11 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e954104b-82f5-4d83-8908-00cd84d40c11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:50.337505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:50.341865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:50.342775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:50.342775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:50.342775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:50.342775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 303/597] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:50.342775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954104b-82f5-4d83-8908-00cd84d40c11 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:50.358988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 295/598] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:50:50 2022] PUT /identity/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/6c83e30a9fd04385b44ee3a3b72e5099/roles/bd638a70b0d5447ab1d78f20ef54200e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:50.360145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0026c7-84d6-424c-8a40-32bf127210f8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:50.397478 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:50.542768 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e954104b-82f5-4d83-8908-00cd84d40c11 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:50.550705 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0026c7-84d6-424c-8a40-32bf127210f8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:50.587811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5800eb-efcb-4315-a4f7-46fb8972d1aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:50.589244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5800eb-efcb-4315-a4f7-46fb8972d1aa None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:50.589851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5800eb-efcb-4315-a4f7-46fb8972d1aa None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:50.590485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5800eb-efcb-4315-a4f7-46fb8972d1aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:50.592688 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef220eb-0132-4f63-b01a-c82afc0ee820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:50.593306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef220eb-0132-4f63-b01a-c82afc0ee820 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:50.593577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef220eb-0132-4f63-b01a-c82afc0ee820 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:50.593866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef220eb-0132-4f63-b01a-c82afc0ee820 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:50.594673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef220eb-0132-4f63-b01a-c82afc0ee820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:50.594983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef220eb-0132-4f63-b01a-c82afc0ee820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:50.596735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef220eb-0132-4f63-b01a-c82afc0ee820 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:50.600192 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:50.603783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5800eb-efcb-4315-a4f7-46fb8972d1aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:50.605509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5800eb-efcb-4315-a4f7-46fb8972d1aa None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:50.610645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 296/599] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:50.619961 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef220eb-0132-4f63-b01a-c82afc0ee820 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2a5800eb-efcb-4315-a4f7-46fb8972d1aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:50.637329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:50.638533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:50.639720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:50.639720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:50.639720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:50.639720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 304/600] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:50.645346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5800eb-efcb-4315-a4f7-46fb8972d1aa None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:50.730489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:50.752412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef220eb-0132-4f63-b01a-c82afc0ee820 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:50.757762 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5800eb-efcb-4315-a4f7-46fb8972d1aa None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:50.787994 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288516e-c2f1-452f-ba14-6141cd3342a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:50.789003 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288516e-c2f1-452f-ba14-6141cd3342a7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:50.789486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288516e-c2f1-452f-ba14-6141cd3342a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:50.789977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e288516e-c2f1-452f-ba14-6141cd3342a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:50.796088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470a10f-4e72-4ac0-a2b2-c1e346955f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:50.796764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470a10f-4e72-4ac0-a2b2-c1e346955f5d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:50.797046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470a10f-4e72-4ac0-a2b2-c1e346955f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:50.797328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3470a10f-4e72-4ac0-a2b2-c1e346955f5d None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:50.798111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470a10f-4e72-4ac0-a2b2-c1e346955f5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:50.798309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470a10f-4e72-4ac0-a2b2-c1e346955f5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:50.799468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288516e-c2f1-452f-ba14-6141cd3342a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:50.799665 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3470a10f-4e72-4ac0-a2b2-c1e346955f5d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:50.801278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e288516e-c2f1-452f-ba14-6141cd3342a7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:50.813422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 305/601] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e288516e-c2f1-452f-ba14-6141cd3342a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:50:50.814413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:50.815311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:50.816229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:50:50.816229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:50:50.816229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:50:50.816229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:50:50.816229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:50:50.816229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:50:50.816229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:50.816229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:50.818784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470a10f-4e72-4ac0-a2b2-c1e346955f5d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:50.819032 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 297/602] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:50.828809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288516e-c2f1-452f-ba14-6141cd3342a7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:50.919140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:50.927209 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3470a10f-4e72-4ac0-a2b2-c1e346955f5d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:50.964945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd757b1b-993f-48dc-a38a-2e704b0985bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:50.966200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd757b1b-993f-48dc-a38a-2e704b0985bf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:50.966488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd757b1b-993f-48dc-a38a-2e704b0985bf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:50.966761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd757b1b-993f-48dc-a38a-2e704b0985bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:50.968753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:50.974856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd757b1b-993f-48dc-a38a-2e704b0985bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:50.976370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd757b1b-993f-48dc-a38a-2e704b0985bf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-dd757b1b-993f-48dc-a38a-2e704b0985bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:50:50.988865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:50.989801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:50.991116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:50:50.991116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:50:50.991116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:50:50.991116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:50:50.991116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:50:50.991116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:50:50.991116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:50.991116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:50.991116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 306/603] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:50.996129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd757b1b-993f-48dc-a38a-2e704b0985bf None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:51.065789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e288516e-c2f1-452f-ba14-6141cd3342a7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:51.102797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd757b1b-993f-48dc-a38a-2e704b0985bf None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:51.151277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af4770-e33f-41d6-879e-d61723a29bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:51.151909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af4770-e33f-41d6-879e-d61723a29bf0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:51.152195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af4770-e33f-41d6-879e-d61723a29bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:51.152465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af4770-e33f-41d6-879e-d61723a29bf0 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:51.153715 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af4770-e33f-41d6-879e-d61723a29bf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:51.154016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af4770-e33f-41d6-879e-d61723a29bf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:51.155589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af4770-e33f-41d6-879e-d61723a29bf0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:51.172640 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a41101-5a77-41cc-b8cc-5b4c706180f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:51.173176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a41101-5a77-41cc-b8cc-5b4c706180f1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:51.173451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a41101-5a77-41cc-b8cc-5b4c706180f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:51.173721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a41101-5a77-41cc-b8cc-5b4c706180f1 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:51.174418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a41101-5a77-41cc-b8cc-5b4c706180f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:51.174720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a41101-5a77-41cc-b8cc-5b4c706180f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:51.176142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a41101-5a77-41cc-b8cc-5b4c706180f1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:51.186680 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 298/604] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:51.192450 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af4770-e33f-41d6-879e-d61723a29bf0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:51.196345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 307/605] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:51.202995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a41101-5a77-41cc-b8cc-5b4c706180f1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:51.300242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:51.337759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a41101-5a77-41cc-b8cc-5b4c706180f1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:51.376489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77ad277-5441-4509-a3e6-0583d59c1531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:51.376489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ad277-5441-4509-a3e6-0583d59c1531 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:51.376489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ad277-5441-4509-a3e6-0583d59c1531 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:51.376489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77ad277-5441-4509-a3e6-0583d59c1531 None admin] PATH_INFO: `/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/c33f1237eb614223a062bafb7a49eac6/roles/bd638a70b0d5447ab1d78f20ef54200e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:51.395128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ad277-5441-4509-a3e6-0583d59c1531 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1074e261454981a85d02b4b0f75ec5, user_id=c33f1237eb614223a062bafb7a49eac6, role_id=bd638a70b0d5447ab1d78f20ef54200e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:51.396606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77ad277-5441-4509-a3e6-0583d59c1531 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:51.399274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af4770-e33f-41d6-879e-d61723a29bf0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:51.411152 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:51.436888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccde625-9e8a-4232-bdb0-6d304bac1776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:51.437483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccde625-9e8a-4232-bdb0-6d304bac1776 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:51.437885 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccde625-9e8a-4232-bdb0-6d304bac1776 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:51.438164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccde625-9e8a-4232-bdb0-6d304bac1776 None admin] PATH_INFO: `/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/f49116f202774e4da0c96875ffa08288/roles/bd638a70b0d5447ab1d78f20ef54200e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:51.454636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccde625-9e8a-4232-bdb0-6d304bac1776 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1074e261454981a85d02b4b0f75ec5, user_id=f49116f202774e4da0c96875ffa08288, role_id=bd638a70b0d5447ab1d78f20ef54200e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:51.456336 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccde625-9e8a-4232-bdb0-6d304bac1776 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:51.473148 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 308/606] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:50:51 2022] PUT /identity/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/c33f1237eb614223a062bafb7a49eac6/roles/bd638a70b0d5447ab1d78f20ef54200e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:51.473148 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbd965-f20b-4fd4-ba3a-190fb014bf68 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:51.473148 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbd965-f20b-4fd4-ba3a-190fb014bf68 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:51.473148 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbd965-f20b-4fd4-ba3a-190fb014bf68 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:51.473148 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 309/607] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:51.488721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdbe21-9025-49be-b682-a8a5101d7839 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:51.489031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdbe21-9025-49be-b682-a8a5101d7839 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:51.489281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdbe21-9025-49be-b682-a8a5101d7839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:51.510679 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4dcdbe21-9025-49be-b682-a8a5101d7839 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:51.512058 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4dcdbe21-9025-49be-b682-a8a5101d7839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:51.532569 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 299/608] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:50:51 2022] PUT /identity/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/f49116f202774e4da0c96875ffa08288/roles/bd638a70b0d5447ab1d78f20ef54200e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:50:51.634701 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 310/609] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:51.680425 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398918-b035-4d3a-a981-c859e2fcff9b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:51.680940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398918-b035-4d3a-a981-c859e2fcff9b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:51.680940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398918-b035-4d3a-a981-c859e2fcff9b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:51.682298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 300/610] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:51.688963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01d13d-cde2-41ac-8941-4995dc340731 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:51.689241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01d13d-cde2-41ac-8941-4995dc340731 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:51.689527 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e01d13d-cde2-41ac-8941-4995dc340731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:51.709519 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6e01d13d-cde2-41ac-8941-4995dc340731 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:51.710723 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6e01d13d-cde2-41ac-8941-4995dc340731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:51.744549 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:51.794078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 311/611] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:51.924901 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1398918-b035-4d3a-a981-c859e2fcff9b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:52.061520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1398918-b035-4d3a-a981-c859e2fcff9b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:52.097929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbeb98-f601-40ef-8f78-1d67bca05a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:52.098557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbeb98-f601-40ef-8f78-1d67bca05a63 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:52.098836 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbeb98-f601-40ef-8f78-1d67bca05a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:52.099110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bbeb98-f601-40ef-8f78-1d67bca05a63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:52.109999 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bbeb98-f601-40ef-8f78-1d67bca05a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-63bbeb98-f601-40ef-8f78-1d67bca05a63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:52.114930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:52.115935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:52.116835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:52.116835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:52.116835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:52.116835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:52.116835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:52.116835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:52.116835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:52.116835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:52.116835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:52.116835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:52.116835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:52.116835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:52.116835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 301/612] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:52.121777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01d13d-cde2-41ac-8941-4995dc340731 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:52.176002 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbeb98-f601-40ef-8f78-1d67bca05a63 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:52.204214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:52.296639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e01d13d-cde2-41ac-8941-4995dc340731 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:52.333461 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127801b-f138-49f7-8e6e-89f3a0a23075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:52.334001 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127801b-f138-49f7-8e6e-89f3a0a23075 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:52.334283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127801b-f138-49f7-8e6e-89f3a0a23075 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:52.334559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9127801b-f138-49f7-8e6e-89f3a0a23075 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:52.335234 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127801b-f138-49f7-8e6e-89f3a0a23075 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:52.335540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127801b-f138-49f7-8e6e-89f3a0a23075 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:52.336949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9127801b-f138-49f7-8e6e-89f3a0a23075 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:52.347060 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 312/613] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:52.352457 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127801b-f138-49f7-8e6e-89f3a0a23075 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:52.377834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bbeb98-f601-40ef-8f78-1d67bca05a63 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:52.381978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:52.460938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9127801b-f138-49f7-8e6e-89f3a0a23075 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:52.497059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59760263-f57b-434a-b9a5-db51ca0f71ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:52.497717 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760263-f57b-434a-b9a5-db51ca0f71ad None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:52.498096 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760263-f57b-434a-b9a5-db51ca0f71ad None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:52.498384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760263-f57b-434a-b9a5-db51ca0f71ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:52.498803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5b520-259f-476b-91cc-d39092b617e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:52.499440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b520-259f-476b-91cc-d39092b617e4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:52.499726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b520-259f-476b-91cc-d39092b617e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:52.500035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5b520-259f-476b-91cc-d39092b617e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:52.510593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5b520-259f-476b-91cc-d39092b617e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:52.512062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5b520-259f-476b-91cc-d39092b617e4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6bf5b520-259f-476b-91cc-d39092b617e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:52.528737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:52.529827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:52.531366 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:52.531366 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:52.531366 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:52.531366 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 313/614] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:52.535760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5b520-259f-476b-91cc-d39092b617e4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:52.536785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59760263-f57b-434a-b9a5-db51ca0f71ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-59760263-f57b-434a-b9a5-db51ca0f71ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:52.541578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:52.543792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:52.545801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:52.545801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:52.545801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:52.545801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:52.545801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:52.545801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:52.545801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:52.545801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:52.545801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:52.545801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:52.545801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:52.545801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:52.552251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 302/615] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:52.560810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59760263-f57b-434a-b9a5-db51ca0f71ad None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:52.627625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:52.656434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5b520-259f-476b-91cc-d39092b617e4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:52.701784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecb4dc-badb-46f7-8b92-e2dd587b08e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:52.703643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecb4dc-badb-46f7-8b92-e2dd587b08e5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:52.703643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecb4dc-badb-46f7-8b92-e2dd587b08e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:52.703643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecb4dc-badb-46f7-8b92-e2dd587b08e5 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:52.704152 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecb4dc-badb-46f7-8b92-e2dd587b08e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:52.704312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecb4dc-badb-46f7-8b92-e2dd587b08e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:52.706128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecb4dc-badb-46f7-8b92-e2dd587b08e5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:52.722200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 314/616] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:52.728013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecb4dc-badb-46f7-8b92-e2dd587b08e5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:52.793670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:52.850150 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59760263-f57b-434a-b9a5-db51ca0f71ad None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:52.853529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecb4dc-badb-46f7-8b92-e2dd587b08e5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:52.897146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98ebc1-16b0-4d10-90e1-11a7e91ca2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:52.898168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98ebc1-16b0-4d10-90e1-11a7e91ca2cb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:52.898576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98ebc1-16b0-4d10-90e1-11a7e91ca2cb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:52.898857 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98ebc1-16b0-4d10-90e1-11a7e91ca2cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:52.908924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98ebc1-16b0-4d10-90e1-11a7e91ca2cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:52.909839 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777c6233-cc4b-49a9-8a5c-be597f749f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:52.910371 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98ebc1-16b0-4d10-90e1-11a7e91ca2cb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:52.910574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c6233-cc4b-49a9-8a5c-be597f749f93 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:52.910922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c6233-cc4b-49a9-8a5c-be597f749f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:52.911262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777c6233-cc4b-49a9-8a5c-be597f749f93 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:52.912082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c6233-cc4b-49a9-8a5c-be597f749f93 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:52.912192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:52.912497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c6233-cc4b-49a9-8a5c-be597f749f93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:52.914589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777c6233-cc4b-49a9-8a5c-be597f749f93 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:52.923688 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 303/617] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:52.924988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d2e19-30be-4113-a280-802260789441 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:52.925522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d2e19-30be-4113-a280-802260789441 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:52.925702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d2e19-30be-4113-a280-802260789441 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-fa98ebc1-16b0-4d10-90e1-11a7e91ca2cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:52.929526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:52.930459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:52.932438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:52.932438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:52.932438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:52.932438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:52.932438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:52.932438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:52.932438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:52.932438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:52.932438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:50:52.932438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:52.932438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 315/618] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 24 07:50:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:52.933517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 304/619] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:52.936528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d2e19-30be-4113-a280-802260789441 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:52.936821 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99616150-232f-4edf-aedc-926296fed30e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:52.937212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99616150-232f-4edf-aedc-926296fed30e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:52.937513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99616150-232f-4edf-aedc-926296fed30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:52.960300 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-99616150-232f-4edf-aedc-926296fed30e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:52.961491 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-99616150-232f-4edf-aedc-926296fed30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:53.050322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 316/620] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:53.051453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99616150-232f-4edf-aedc-926296fed30e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:53.086948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d2e19-30be-4113-a280-802260789441 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:53.164332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99616150-232f-4edf-aedc-926296fed30e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:53.177211 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca2476-1ce6-4404-8696-67b28dd89e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:53.178186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca2476-1ce6-4404-8696-67b28dd89e1f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:53.178539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca2476-1ce6-4404-8696-67b28dd89e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:53.179006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca2476-1ce6-4404-8696-67b28dd89e1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:53.196381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:53.198207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:53.206002 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca2476-1ce6-4404-8696-67b28dd89e1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:53.212560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca2476-1ce6-4404-8696-67b28dd89e1f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:53.212676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe21073-8255-4b64-83c2-2a55655e7264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:53.212676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe21073-8255-4b64-83c2-2a55655e7264 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:53.212676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe21073-8255-4b64-83c2-2a55655e7264 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:53.212676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe21073-8255-4b64-83c2-2a55655e7264 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:53.213034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe21073-8255-4b64-83c2-2a55655e7264 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:53.213034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe21073-8255-4b64-83c2-2a55655e7264 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:53.216221 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe21073-8255-4b64-83c2-2a55655e7264 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-40ca2476-1ce6-4404-8696-67b28dd89e1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:53.245533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:53.248157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:53.249138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:53.249138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:53.249138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:53.249940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 305/621] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:53.253662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 317/622] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 24 07:50:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:53.260244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca2476-1ce6-4404-8696-67b28dd89e1f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:53.261726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe21073-8255-4b64-83c2-2a55655e7264 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:53.391510 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca2476-1ce6-4404-8696-67b28dd89e1f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:53.440510 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfec4b-1c0a-4f9e-a7ad-5ce9f65a8a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:53.441613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfec4b-1c0a-4f9e-a7ad-5ce9f65a8a6d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:53.442440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfec4b-1c0a-4f9e-a7ad-5ce9f65a8a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:53.442858 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfec4b-1c0a-4f9e-a7ad-5ce9f65a8a6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:53.452338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe21073-8255-4b64-83c2-2a55655e7264 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:53.495150 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28640e13-40cd-405d-af82-61fbb1ac741e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:53.496327 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28640e13-40cd-405d-af82-61fbb1ac741e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:53.497374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28640e13-40cd-405d-af82-61fbb1ac741e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:53.497795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28640e13-40cd-405d-af82-61fbb1ac741e None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:53.498832 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28640e13-40cd-405d-af82-61fbb1ac741e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:53.499282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28640e13-40cd-405d-af82-61fbb1ac741e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:53.501590 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28640e13-40cd-405d-af82-61fbb1ac741e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:53.513771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:53.518710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 318/623] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:53.519748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28640e13-40cd-405d-af82-61fbb1ac741e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:53.528690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfec4b-1c0a-4f9e-a7ad-5ce9f65a8a6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:53.530201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfec4b-1c0a-4f9e-a7ad-5ce9f65a8a6d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:53.573867 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:53.632780 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28640e13-40cd-405d-af82-61fbb1ac741e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:53.663145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 306/624] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:53.664291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfec4b-1c0a-4f9e-a7ad-5ce9f65a8a6d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:53.673338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631acfa6-4c7a-4d1a-845c-c15c4fb369be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:53.676039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631acfa6-4c7a-4d1a-845c-c15c4fb369be None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:53.676039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631acfa6-4c7a-4d1a-845c-c15c4fb369be None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:53.676039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631acfa6-4c7a-4d1a-845c-c15c4fb369be None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:53.687689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631acfa6-4c7a-4d1a-845c-c15c4fb369be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-631acfa6-4c7a-4d1a-845c-c15c4fb369be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:53.693556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:53.694503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:53.695766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:53.695766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:53.695766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:53.695766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:53.695766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:53.695766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:53.695766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:53.695766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:53.695766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:53.695766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:53.695766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:53.695766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:53.703079 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 319/625] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:53.704214 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631acfa6-4c7a-4d1a-845c-c15c4fb369be None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:53.767269 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:53.775625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfec4b-1c0a-4f9e-a7ad-5ce9f65a8a6d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:53.806032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631acfa6-4c7a-4d1a-845c-c15c4fb369be None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:53.810656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b4463-8d66-4a07-835d-5697aa7acb57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:53.811285 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b4463-8d66-4a07-835d-5697aa7acb57 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:53.811567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b4463-8d66-4a07-835d-5697aa7acb57 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:53.811854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718b4463-8d66-4a07-835d-5697aa7acb57 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:53.813492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:53.818972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b4463-8d66-4a07-835d-5697aa7acb57 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:53.820430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718b4463-8d66-4a07-835d-5697aa7acb57 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-718b4463-8d66-4a07-835d-5697aa7acb57 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:53.831768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:53.832914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:53.833864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:53.833864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:53.833864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:53.833864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:53.833864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:53.833864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:53.833864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:53.833864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:53.833864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:50:53.833864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:53.833864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 307/626] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:50:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:53.833864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b4463-8d66-4a07-835d-5697aa7acb57 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:53.845261 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8968e2-160e-4bf6-b0a4-87926dcecfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:53.845885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8968e2-160e-4bf6-b0a4-87926dcecfd0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:53.846161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8968e2-160e-4bf6-b0a4-87926dcecfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:53.846422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8968e2-160e-4bf6-b0a4-87926dcecfd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:53.857666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8968e2-160e-4bf6-b0a4-87926dcecfd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:53.859098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8968e2-160e-4bf6-b0a4-87926dcecfd0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5e8968e2-160e-4bf6-b0a4-87926dcecfd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:53.873843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:53.874789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:53.875664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:53.875664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:53.875664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:53.875664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 320/627] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:53.876429 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a6786-09b6-4bcc-8c4a-ec511310a2bd None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:53.876715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a6786-09b6-4bcc-8c4a-ec511310a2bd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:53.876990 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a6786-09b6-4bcc-8c4a-ec511310a2bd None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:53.878723 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 321/628] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:53.879262 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16d74e-78d1-47d9-8b9e-680d59966546 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:53.879771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16d74e-78d1-47d9-8b9e-680d59966546 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:53.880082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16d74e-78d1-47d9-8b9e-680d59966546 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:53.881369 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 322/629] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:53.884645 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16d74e-78d1-47d9-8b9e-680d59966546 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:53.937194 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718b4463-8d66-4a07-835d-5697aa7acb57 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:53.971261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b46288-1218-45f2-8e74-d3f09db60fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:53.971795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b46288-1218-45f2-8e74-d3f09db60fea None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:53.972101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b46288-1218-45f2-8e74-d3f09db60fea None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:53.972367 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b46288-1218-45f2-8e74-d3f09db60fea None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:53.973019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b46288-1218-45f2-8e74-d3f09db60fea None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:53.973320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b46288-1218-45f2-8e74-d3f09db60fea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:53.974676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b46288-1218-45f2-8e74-d3f09db60fea None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:53.982835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 308/630] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:53.983604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b46288-1218-45f2-8e74-d3f09db60fea None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:53.988799 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16d74e-78d1-47d9-8b9e-680d59966546 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:53.999165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:54.022458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41047234-90be-48ea-870e-bae13d74a3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:54.023056 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41047234-90be-48ea-870e-bae13d74a3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:54.023343 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41047234-90be-48ea-870e-bae13d74a3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:54.023618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41047234-90be-48ea-870e-bae13d74a3a2 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:54.024377 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41047234-90be-48ea-870e-bae13d74a3a2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:54.024681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41047234-90be-48ea-870e-bae13d74a3a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:54.026128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41047234-90be-48ea-870e-bae13d74a3a2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:54.044276 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 323/631] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Aug 24 07:50:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:54.045548 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2f905-8fb0-45d2-8556-d5024c315004 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:54.045855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2f905-8fb0-45d2-8556-d5024c315004 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:54.046111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2f905-8fb0-45d2-8556-d5024c315004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:54.062998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fdf2f905-8fb0-45d2-8556-d5024c315004 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:54.064216 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fdf2f905-8fb0-45d2-8556-d5024c315004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:54.074696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:54.081547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b46288-1218-45f2-8e74-d3f09db60fea None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:54.115751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2ed1c-4a0f-46ed-a9da-be7cf42d6dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:54.116379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2ed1c-4a0f-46ed-a9da-be7cf42d6dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:54.116659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2ed1c-4a0f-46ed-a9da-be7cf42d6dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:54.116931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2ed1c-4a0f-46ed-a9da-be7cf42d6dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:54.117567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2ed1c-4a0f-46ed-a9da-be7cf42d6dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:54.117871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2ed1c-4a0f-46ed-a9da-be7cf42d6dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:54.119258 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2ed1c-4a0f-46ed-a9da-be7cf42d6dc1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:54.130130 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 324/632] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:54.130763 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 309/633] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:54.131355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bf634-f153-45ab-8b35-8fd7ee25e7e7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:54.131482 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2ed1c-4a0f-46ed-a9da-be7cf42d6dc1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:54.131644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bf634-f153-45ab-8b35-8fd7ee25e7e7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:54.131934 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bf634-f153-45ab-8b35-8fd7ee25e7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:54.156144 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e12bf634-f153-45ab-8b35-8fd7ee25e7e7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:54.157482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e12bf634-f153-45ab-8b35-8fd7ee25e7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:54.218014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:54.239945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 325/634] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:54.239945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bf634-f153-45ab-8b35-8fd7ee25e7e7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:54.256901 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2ed1c-4a0f-46ed-a9da-be7cf42d6dc1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:54.295698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeeb94-7187-4da2-b48d-1f11039960d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:54.296452 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeeb94-7187-4da2-b48d-1f11039960d2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:54.296799 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeeb94-7187-4da2-b48d-1f11039960d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:54.297156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eeeb94-7187-4da2-b48d-1f11039960d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:54.308515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeeb94-7187-4da2-b48d-1f11039960d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:54.310309 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eeeb94-7187-4da2-b48d-1f11039960d2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-91eeeb94-7187-4da2-b48d-1f11039960d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:54.325593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:54.326582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:54.327511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:54.327511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:54.327511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:54.331428 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 310/635] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:54.332360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeeb94-7187-4da2-b48d-1f11039960d2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:54.335393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:54.369092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12bf634-f153-45ab-8b35-8fd7ee25e7e7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:54.418034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a56f93-f1ce-4c3e-a6fc-fb03e732be51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:54.419146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56f93-f1ce-4c3e-a6fc-fb03e732be51 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:54.419694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56f93-f1ce-4c3e-a6fc-fb03e732be51 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:54.420221 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a56f93-f1ce-4c3e-a6fc-fb03e732be51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:54.431222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a56f93-f1ce-4c3e-a6fc-fb03e732be51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:54.433117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a56f93-f1ce-4c3e-a6fc-fb03e732be51 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:54.443718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eeeb94-7187-4da2-b48d-1f11039960d2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-44a56f93-f1ce-4c3e-a6fc-fb03e732be51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:54.449451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:54.451046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:54.451991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:54.451991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:54.451991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:54.451991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 326/636] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:54.452599 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a56f93-f1ce-4c3e-a6fc-fb03e732be51 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:54.473926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:54.482603 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f602412-b135-433f-92cd-1c036aef2e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:54.483238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f602412-b135-433f-92cd-1c036aef2e4b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:54.483517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f602412-b135-433f-92cd-1c036aef2e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:54.483791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f602412-b135-433f-92cd-1c036aef2e4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:54.490460 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f602412-b135-433f-92cd-1c036aef2e4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:54.491838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f602412-b135-433f-92cd-1c036aef2e4b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-2f602412-b135-433f-92cd-1c036aef2e4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:50:54.503494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:54.504600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:54.505520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:50:54.505520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:50:54.505520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:50:54.505520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:50:54.505520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:50:54.505520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:50:54.505520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:54.505520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:54.505520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 311/637] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:54.505520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f602412-b135-433f-92cd-1c036aef2e4b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:54.562769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a56f93-f1ce-4c3e-a6fc-fb03e732be51 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:54.588655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:54.597384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592b589-e616-4417-b2e5-be850cef1be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:54.597996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592b589-e616-4417-b2e5-be850cef1be7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:54.598282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592b589-e616-4417-b2e5-be850cef1be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:54.602181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592b589-e616-4417-b2e5-be850cef1be7 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:54.602181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592b589-e616-4417-b2e5-be850cef1be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:54.602181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592b589-e616-4417-b2e5-be850cef1be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:54.602181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592b589-e616-4417-b2e5-be850cef1be7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:54.606805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f602412-b135-433f-92cd-1c036aef2e4b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:54.612598 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 327/638] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:54.613400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592b589-e616-4417-b2e5-be850cef1be7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:54.642053 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f160d6-ebaa-41c7-a229-4868e356cba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:54.642677 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f160d6-ebaa-41c7-a229-4868e356cba9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:54.642950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f160d6-ebaa-41c7-a229-4868e356cba9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:54.643226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f160d6-ebaa-41c7-a229-4868e356cba9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:54.653167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f160d6-ebaa-41c7-a229-4868e356cba9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-c8f160d6-ebaa-41c7-a229-4868e356cba9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:54.658292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:54.659518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:54.660620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:54.660620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:54.660620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:54.660620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:54.660620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:54.660620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:54.660620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:54.660620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:54.660620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:54.660620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:54.660620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:54.660620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:54.660620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 312/639] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:54.660620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f160d6-ebaa-41c7-a229-4868e356cba9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:54.709213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:54.717882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592b589-e616-4417-b2e5-be850cef1be7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:54.751412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03793e-70d6-40a0-a71f-517faca1fe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:54.751983 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03793e-70d6-40a0-a71f-517faca1fe4a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:54.752267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03793e-70d6-40a0-a71f-517faca1fe4a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:54.752544 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc03793e-70d6-40a0-a71f-517faca1fe4a None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:54.753186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03793e-70d6-40a0-a71f-517faca1fe4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:54.753492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03793e-70d6-40a0-a71f-517faca1fe4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:54.754847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc03793e-70d6-40a0-a71f-517faca1fe4a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:54.760756 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f160d6-ebaa-41c7-a229-4868e356cba9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:54.766493 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 328/640] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:54.767291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03793e-70d6-40a0-a71f-517faca1fe4a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:54.795134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec910d-73b0-4abe-ab25-267578e7ae26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:54.795734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec910d-73b0-4abe-ab25-267578e7ae26 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:54.796051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec910d-73b0-4abe-ab25-267578e7ae26 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:54.796322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec910d-73b0-4abe-ab25-267578e7ae26 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:54.797005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec910d-73b0-4abe-ab25-267578e7ae26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:54.797387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec910d-73b0-4abe-ab25-267578e7ae26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:54.798796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ec910d-73b0-4abe-ab25-267578e7ae26 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:54.810921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 313/641] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:50:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:54.811707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec910d-73b0-4abe-ab25-267578e7ae26 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:54.816578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:54.868040 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc03793e-70d6-40a0-a71f-517faca1fe4a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:54.903557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37403967-2e06-4358-86b9-e1884351fcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:54.904218 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37403967-2e06-4358-86b9-e1884351fcd8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:54.904499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37403967-2e06-4358-86b9-e1884351fcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:54.904775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37403967-2e06-4358-86b9-e1884351fcd8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:54.913120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec910d-73b0-4abe-ab25-267578e7ae26 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:54.914592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37403967-2e06-4358-86b9-e1884351fcd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-37403967-2e06-4358-86b9-e1884351fcd8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:54.919766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:54.920964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:54.921827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:54.921827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:54.921827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:54.921827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:54.921827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:54.921827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:54.921827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:54.921827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:54.921827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:54.921827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:54.921827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:54.921827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:54.922741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:54.922839 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 329/642] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:54.922839 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37403967-2e06-4358-86b9-e1884351fcd8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:54.950311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f780e15-8072-4908-8d72-76c2c9e6f239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:54.950939 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f780e15-8072-4908-8d72-76c2c9e6f239 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:54.951211 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f780e15-8072-4908-8d72-76c2c9e6f239 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:54.951476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f780e15-8072-4908-8d72-76c2c9e6f239 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:54.959081 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f780e15-8072-4908-8d72-76c2c9e6f239 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:54.960542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f780e15-8072-4908-8d72-76c2c9e6f239 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-1f780e15-8072-4908-8d72-76c2c9e6f239 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:54.972066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:54.973212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:54.974278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:54.974278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:54.974278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:54.974278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:54.974278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:54.974278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:54.974278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:54.974278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:54.974278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 07:50:54.974278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:54.974278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 314/643] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:54.974278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f780e15-8072-4908-8d72-76c2c9e6f239 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:55.026491 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37403967-2e06-4358-86b9-e1884351fcd8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:55.036653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:55.060435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b875da0-5b7e-42d6-b7ea-f8814dc583c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:55.061044 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b875da0-5b7e-42d6-b7ea-f8814dc583c8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:55.061320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b875da0-5b7e-42d6-b7ea-f8814dc583c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:55.061597 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b875da0-5b7e-42d6-b7ea-f8814dc583c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:55.062260 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b875da0-5b7e-42d6-b7ea-f8814dc583c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:55.062696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b875da0-5b7e-42d6-b7ea-f8814dc583c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:55.064107 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b875da0-5b7e-42d6-b7ea-f8814dc583c8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:55.073885 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f780e15-8072-4908-8d72-76c2c9e6f239 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:55.076029 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 330/644] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:55.077030 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b875da0-5b7e-42d6-b7ea-f8814dc583c8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:55.108347 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc2635-f8b1-4ad1-b46e-1bed907fcc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:55.108968 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2635-f8b1-4ad1-b46e-1bed907fcc97 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:55.109242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2635-f8b1-4ad1-b46e-1bed907fcc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:55.109509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2635-f8b1-4ad1-b46e-1bed907fcc97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:55.115989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc2635-f8b1-4ad1-b46e-1bed907fcc97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:55.117391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc2635-f8b1-4ad1-b46e-1bed907fcc97 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-02fc2635-f8b1-4ad1-b46e-1bed907fcc97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:50:55.128412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:55.129503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:55.130724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:50:55.130724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:50:55.130724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:50:55.130724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:50:55.130724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:50:55.130724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:50:55.130724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:55.130724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:55.130724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 315/645] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:55.130724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc2635-f8b1-4ad1-b46e-1bed907fcc97 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:55.158083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:55.186282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b875da0-5b7e-42d6-b7ea-f8814dc583c8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:55.220451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a175d79-9291-44f8-aa8b-3cc587cdb45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:55.221150 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175d79-9291-44f8-aa8b-3cc587cdb45f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:55.221332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175d79-9291-44f8-aa8b-3cc587cdb45f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:55.221609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a175d79-9291-44f8-aa8b-3cc587cdb45f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:55.222332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a175d79-9291-44f8-aa8b-3cc587cdb45f None admin] RBAC: Adding query filter params (role.id=bd638a70b0d5447ab1d78f20ef54200e, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=9b99cff7a5f549adadee002f8ab1f5d9) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:55.222645 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a175d79-9291-44f8-aa8b-3cc587cdb45f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:55.224078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a175d79-9291-44f8-aa8b-3cc587cdb45f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:55.229649 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 331/646] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:55 2022] GET /identity/v3/role_assignments?user.id=9b99cff7a5f549adadee002f8ab1f5d9&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=bd638a70b0d5447ab1d78f20ef54200e => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:55.229914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc2635-f8b1-4ad1-b46e-1bed907fcc97 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:55.230427 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a175d79-9291-44f8-aa8b-3cc587cdb45f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:55.270312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a867b2-a9ab-4e55-aceb-74ce64ce4f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:55.271251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a867b2-a9ab-4e55-aceb-74ce64ce4f7a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:55.271738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a867b2-a9ab-4e55-aceb-74ce64ce4f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:55.272057 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a867b2-a9ab-4e55-aceb-74ce64ce4f7a None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:55.272729 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a867b2-a9ab-4e55-aceb-74ce64ce4f7a None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:55.273031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a867b2-a9ab-4e55-aceb-74ce64ce4f7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:55.274430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a867b2-a9ab-4e55-aceb-74ce64ce4f7a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:55.274809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:55.285057 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 316/647] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:55.285871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a867b2-a9ab-4e55-aceb-74ce64ce4f7a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:55.352770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a175d79-9291-44f8-aa8b-3cc587cdb45f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:55.388664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:55.396143 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55255c-1e42-4d0a-af5e-68a1f7bf9e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:55.396759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55255c-1e42-4d0a-af5e-68a1f7bf9e58 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:55.397043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55255c-1e42-4d0a-af5e-68a1f7bf9e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:55.397318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55255c-1e42-4d0a-af5e-68a1f7bf9e58 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:55.398085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55255c-1e42-4d0a-af5e-68a1f7bf9e58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:55.398392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55255c-1e42-4d0a-af5e-68a1f7bf9e58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:55.399812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55255c-1e42-4d0a-af5e-68a1f7bf9e58 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:55.400698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a867b2-a9ab-4e55-aceb-74ce64ce4f7a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:55.422762 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 332/648] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Aug 24 07:50:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:55.422762 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55255c-1e42-4d0a-af5e-68a1f7bf9e58 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:55.452755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4101ce-22e1-4f78-b2e5-abfda04dae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:55.453562 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4101ce-22e1-4f78-b2e5-abfda04dae2a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:55.453784 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4101ce-22e1-4f78-b2e5-abfda04dae2a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:55.454065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4101ce-22e1-4f78-b2e5-abfda04dae2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:55.466331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4101ce-22e1-4f78-b2e5-abfda04dae2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:55.467790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4101ce-22e1-4f78-b2e5-abfda04dae2a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-0e4101ce-22e1-4f78-b2e5-abfda04dae2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:55.482584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:55.483630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:55.485247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:55.485247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:55.485247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:55.485247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 317/649] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:55.485247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4101ce-22e1-4f78-b2e5-abfda04dae2a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:55.526289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:55.541299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55255c-1e42-4d0a-af5e-68a1f7bf9e58 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:55.578495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958827f7-4dbb-4b5e-9a9d-06b1f4045774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:55.579118 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958827f7-4dbb-4b5e-9a9d-06b1f4045774 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:55.579422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958827f7-4dbb-4b5e-9a9d-06b1f4045774 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:55.579696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958827f7-4dbb-4b5e-9a9d-06b1f4045774 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:55.580438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958827f7-4dbb-4b5e-9a9d-06b1f4045774 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:55.580745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958827f7-4dbb-4b5e-9a9d-06b1f4045774 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:55.582158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958827f7-4dbb-4b5e-9a9d-06b1f4045774 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:55.593852 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4101ce-22e1-4f78-b2e5-abfda04dae2a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:55.594839 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 333/650] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:50:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:55.595710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958827f7-4dbb-4b5e-9a9d-06b1f4045774 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:55.637899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026298bb-91cc-45bd-99d7-0a99798aa706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:55.638689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026298bb-91cc-45bd-99d7-0a99798aa706 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:55.639060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026298bb-91cc-45bd-99d7-0a99798aa706 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:55.639433 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026298bb-91cc-45bd-99d7-0a99798aa706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:55.648440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:55.650663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026298bb-91cc-45bd-99d7-0a99798aa706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:55.652118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026298bb-91cc-45bd-99d7-0a99798aa706 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-026298bb-91cc-45bd-99d7-0a99798aa706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:55.666931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:55.673599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:55.674741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:55.674741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:55.674741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:55.674741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 318/651] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:55.674741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026298bb-91cc-45bd-99d7-0a99798aa706 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:55.710315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958827f7-4dbb-4b5e-9a9d-06b1f4045774 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:55.744726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec41702-bcf5-4c11-a225-d8cf90706e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:55.745342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec41702-bcf5-4c11-a225-d8cf90706e6d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:55.745621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec41702-bcf5-4c11-a225-d8cf90706e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:55.745896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec41702-bcf5-4c11-a225-d8cf90706e6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:55.769332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:55.780781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026298bb-91cc-45bd-99d7-0a99798aa706 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:55.816316 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f0116-0aae-4c5c-b38e-040accb89c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:55.816946 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f0116-0aae-4c5c-b38e-040accb89c7b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:55.817215 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f0116-0aae-4c5c-b38e-040accb89c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:55.817483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0f0116-0aae-4c5c-b38e-040accb89c7b None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:55.818120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f0116-0aae-4c5c-b38e-040accb89c7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:55.818421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f0116-0aae-4c5c-b38e-040accb89c7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:55.819765 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0f0116-0aae-4c5c-b38e-040accb89c7b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:55.820954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec41702-bcf5-4c11-a225-d8cf90706e6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:55.822392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec41702-bcf5-4c11-a225-d8cf90706e6d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:55.831887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 319/652] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:55.832668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f0116-0aae-4c5c-b38e-040accb89c7b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:55.885751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:55.933951 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 334/653] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:55.934893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec41702-bcf5-4c11-a225-d8cf90706e6d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:55.940836 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0f0116-0aae-4c5c-b38e-040accb89c7b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:55.977461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e9d9-12db-4f1d-b1e8-e1ced92296f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:55.978151 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e9d9-12db-4f1d-b1e8-e1ced92296f6 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:55.978438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e9d9-12db-4f1d-b1e8-e1ced92296f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:55.978709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e9d9-12db-4f1d-b1e8-e1ced92296f6 None admin] PATH_INFO: `/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/8255043f01fd46e4a8a5fde8e81c2bed/roles/bd638a70b0d5447ab1d78f20ef54200e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:55.990205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:55.995081 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5e9d9-12db-4f1d-b1e8-e1ced92296f6 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1074e261454981a85d02b4b0f75ec5, user_id=8255043f01fd46e4a8a5fde8e81c2bed, role_id=bd638a70b0d5447ab1d78f20ef54200e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:55.996650 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5e9d9-12db-4f1d-b1e8-e1ced92296f6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:56.038148 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec41702-bcf5-4c11-a225-d8cf90706e6d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:56.070187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e16390-a719-47c8-b3d9-beaf0d583ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:56.070774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e16390-a719-47c8-b3d9-beaf0d583ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:56.071093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e16390-a719-47c8-b3d9-beaf0d583ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:56.071367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e16390-a719-47c8-b3d9-beaf0d583ea6 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:56.072038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e16390-a719-47c8-b3d9-beaf0d583ea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:56.072345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e16390-a719-47c8-b3d9-beaf0d583ea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:56.073701 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e16390-a719-47c8-b3d9-beaf0d583ea6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:56.084254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 320/654] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:50:55 2022] PUT /identity/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/8255043f01fd46e4a8a5fde8e81c2bed/roles/bd638a70b0d5447ab1d78f20ef54200e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:50:56.085629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e9d9-12db-4f1d-b1e8-e1ced92296f6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:56.096192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 335/655] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:56.098387 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e16390-a719-47c8-b3d9-beaf0d583ea6 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:56.225822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e9d9-12db-4f1d-b1e8-e1ced92296f6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:56.228335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:56.244424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e16390-a719-47c8-b3d9-beaf0d583ea6 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:56.260610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:56.275567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094905a-7841-46e0-bd18-95333154b9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:56.276365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094905a-7841-46e0-bd18-95333154b9c9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:56.276547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094905a-7841-46e0-bd18-95333154b9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:56.276779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094905a-7841-46e0-bd18-95333154b9c9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:56.288962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d711e-d376-4005-93b9-baaf0a63f79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:56.290268 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d711e-d376-4005-93b9-baaf0a63f79b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:56.291026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d711e-d376-4005-93b9-baaf0a63f79b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:56.291524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d711e-d376-4005-93b9-baaf0a63f79b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:56.291629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094905a-7841-46e0-bd18-95333154b9c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:56.293106 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094905a-7841-46e0-bd18-95333154b9c9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:56.303613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d711e-d376-4005-93b9-baaf0a63f79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:56.305411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10d711e-d376-4005-93b9-baaf0a63f79b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-1094905a-7841-46e0-bd18-95333154b9c9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:56.307821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:56.308777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:56.310294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:56.310294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:56.310294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:56.310294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:56.310294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:56.310294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:56.310294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:56.310294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:56.310294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:50:56.310294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:56.311934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 321/656] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:56.312957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094905a-7841-46e0-bd18-95333154b9c9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d10d711e-d376-4005-93b9-baaf0a63f79b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:56.330736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:56.331730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:56.332681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:56.332681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:56.332681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:56.333555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 336/657] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:56.335106 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d711e-d376-4005-93b9-baaf0a63f79b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:56.438414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094905a-7841-46e0-bd18-95333154b9c9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:56.448811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d711e-d376-4005-93b9-baaf0a63f79b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:56.477034 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b677bb3-9357-44a3-a671-6e3c8c553c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:56.478002 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b677bb3-9357-44a3-a671-6e3c8c553c57 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:56.478583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b677bb3-9357-44a3-a671-6e3c8c553c57 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:56.479149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b677bb3-9357-44a3-a671-6e3c8c553c57 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:56.484849 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43a4cf-c6b4-414c-b825-4392817f90a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:56.485455 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43a4cf-c6b4-414c-b825-4392817f90a5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:56.485736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43a4cf-c6b4-414c-b825-4392817f90a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:56.486011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43a4cf-c6b4-414c-b825-4392817f90a5 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:56.486739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43a4cf-c6b4-414c-b825-4392817f90a5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:56.487046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43a4cf-c6b4-414c-b825-4392817f90a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:56.488510 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c43a4cf-c6b4-414c-b825-4392817f90a5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:56.489967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b677bb3-9357-44a3-a671-6e3c8c553c57 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:56.491678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b677bb3-9357-44a3-a671-6e3c8c553c57 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-3b677bb3-9357-44a3-a671-6e3c8c553c57 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:56.504327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:56.505305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:56.506288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:56.506288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:56.506288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:56.506288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:56.506288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:56.506288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:56.506288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:56.506288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:56.506288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 07:50:56.506288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:56.508786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 322/659] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:56.509780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b677bb3-9357-44a3-a671-6e3c8c553c57 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:56.511701 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 337/659] 10.222.0.62 () {56 vars in 1137 bytes} [Wed Aug 24 07:50:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:56.514614 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43a4cf-c6b4-414c-b825-4392817f90a5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:56.536867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:56.539186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:56.617855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43a4cf-c6b4-414c-b825-4392817f90a5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:56.633351 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b677bb3-9357-44a3-a671-6e3c8c553c57 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:56.654968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdd521-93b2-46ee-a663-967279af2e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:56.655576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdd521-93b2-46ee-a663-967279af2e3f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:56.655876 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdd521-93b2-46ee-a663-967279af2e3f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:56.656150 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdd521-93b2-46ee-a663-967279af2e3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:56.680639 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9383e96-4ffa-4a9e-845e-14790cccabd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:56.681882 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9383e96-4ffa-4a9e-845e-14790cccabd9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:56.682836 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9383e96-4ffa-4a9e-845e-14790cccabd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:56.683577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9383e96-4ffa-4a9e-845e-14790cccabd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:56.685075 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9383e96-4ffa-4a9e-845e-14790cccabd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:56.685942 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9383e96-4ffa-4a9e-845e-14790cccabd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:56.688056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9383e96-4ffa-4a9e-845e-14790cccabd9 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:56.704601 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 323/660] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:56.706408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9383e96-4ffa-4a9e-845e-14790cccabd9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:56.728915 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdd521-93b2-46ee-a663-967279af2e3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:56.730420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdd521-93b2-46ee-a663-967279af2e3f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:56.758423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:56.806402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:56.825517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9383e96-4ffa-4a9e-845e-14790cccabd9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:56.849866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 338/661] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:56.851165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdd521-93b2-46ee-a663-967279af2e3f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:56.863081 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19de21f-6d16-45d0-ab59-dcc05dabfb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:56.863695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19de21f-6d16-45d0-ab59-dcc05dabfb2b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:56.864001 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19de21f-6d16-45d0-ab59-dcc05dabfb2b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:56.864269 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19de21f-6d16-45d0-ab59-dcc05dabfb2b None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:56.865099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19de21f-6d16-45d0-ab59-dcc05dabfb2b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:56.865402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19de21f-6d16-45d0-ab59-dcc05dabfb2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:56.866860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19de21f-6d16-45d0-ab59-dcc05dabfb2b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:56.886172 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 324/662] 10.222.0.62 () {56 vars in 1139 bytes} [Wed Aug 24 07:50:56 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:56.886811 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19de21f-6d16-45d0-ab59-dcc05dabfb2b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:56.961872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdd521-93b2-46ee-a663-967279af2e3f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:56.986760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:56.993060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19de21f-6d16-45d0-ab59-dcc05dabfb2b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:57.000512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b7143-2ffc-42aa-85f2-90d23f16ee1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:57.001452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b7143-2ffc-42aa-85f2-90d23f16ee1d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.001907 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b7143-2ffc-42aa-85f2-90d23f16ee1d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.002391 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b7143-2ffc-42aa-85f2-90d23f16ee1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.010142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b7143-2ffc-42aa-85f2-90d23f16ee1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:57.011991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b7143-2ffc-42aa-85f2-90d23f16ee1d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-205b7143-2ffc-42aa-85f2-90d23f16ee1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:50:57.024928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:57.026229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:57.027353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:50:57.027353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:50:57.027353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:50:57.027353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:50:57.027353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:50:57.027353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:50:57.027353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:57.027353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:57.029931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 339/663] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:57.030993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b7143-2ffc-42aa-85f2-90d23f16ee1d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:57.031233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b3c10-59cb-4ad4-818a-c649fb8e231c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:57.031976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b3c10-59cb-4ad4-818a-c649fb8e231c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.032321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b3c10-59cb-4ad4-818a-c649fb8e231c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.032657 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5b3c10-59cb-4ad4-818a-c649fb8e231c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.041975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:57.044599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b3c10-59cb-4ad4-818a-c649fb8e231c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:57.046158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5b3c10-59cb-4ad4-818a-c649fb8e231c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-aa5b3c10-59cb-4ad4-818a-c649fb8e231c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:57.062387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:57.063602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:57.064766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:57.064766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:57.064766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:57.069914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 325/664] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:57.069914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b3c10-59cb-4ad4-818a-c649fb8e231c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:57.150829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b7143-2ffc-42aa-85f2-90d23f16ee1d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:57.174457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5b3c10-59cb-4ad4-818a-c649fb8e231c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:57.193151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754205e-2df0-4772-9932-f51507a7d3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:57.194030 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754205e-2df0-4772-9932-f51507a7d3d3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.194459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754205e-2df0-4772-9932-f51507a7d3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.194879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1754205e-2df0-4772-9932-f51507a7d3d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.211272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fb258-ca51-4427-8956-f17605e5beb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:57.212017 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fb258-ca51-4427-8956-f17605e5beb3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.212379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fb258-ca51-4427-8956-f17605e5beb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.212927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fb258-ca51-4427-8956-f17605e5beb3 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.213584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fb258-ca51-4427-8956-f17605e5beb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:57.214286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fb258-ca51-4427-8956-f17605e5beb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:57.216156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fb258-ca51-4427-8956-f17605e5beb3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:57.230225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 326/665] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:50:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:57.231532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fb258-ca51-4427-8956-f17605e5beb3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:57.253793 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:57.273710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754205e-2df0-4772-9932-f51507a7d3d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:57.275148 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1754205e-2df0-4772-9932-f51507a7d3d3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:57.291058 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:57.339657 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fb258-ca51-4427-8956-f17605e5beb3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:57.377499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef78bf5-3a3d-47bc-9ddd-6f95b3b7ef7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:57.378172 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef78bf5-3a3d-47bc-9ddd-6f95b3b7ef7a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.378455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef78bf5-3a3d-47bc-9ddd-6f95b3b7ef7a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.378725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef78bf5-3a3d-47bc-9ddd-6f95b3b7ef7a None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.381970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef78bf5-3a3d-47bc-9ddd-6f95b3b7ef7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:57.382573 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef78bf5-3a3d-47bc-9ddd-6f95b3b7ef7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:57.384133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef78bf5-3a3d-47bc-9ddd-6f95b3b7ef7a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:57.394817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 340/666] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:50:57.394817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754205e-2df0-4772-9932-f51507a7d3d3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:57.401925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 327/667] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:57.407634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab0a2-8b33-4232-a3f9-a3ff9f2145ff None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.407634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab0a2-8b33-4232-a3f9-a3ff9f2145ff None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.407634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888ab0a2-8b33-4232-a3f9-a3ff9f2145ff None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.407634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 328/668] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:57.407634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ab0a2-8b33-4232-a3f9-a3ff9f2145ff None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:57.472850 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:57.491989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1754205e-2df0-4772-9932-f51507a7d3d3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:57.522815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888ab0a2-8b33-4232-a3f9-a3ff9f2145ff None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:57.539159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:57.562587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edd920-ab3f-4a64-92c3-f73164243d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:57.563469 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd920-ab3f-4a64-92c3-f73164243d85 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.563790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd920-ab3f-4a64-92c3-f73164243d85 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.564455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edd920-ab3f-4a64-92c3-f73164243d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.577095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edd920-ab3f-4a64-92c3-f73164243d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:57.578576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edd920-ab3f-4a64-92c3-f73164243d85 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-57edd920-ab3f-4a64-92c3-f73164243d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:57.595660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:57.596703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:57.598279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:57.598279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:57.598279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:57.598279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 329/669] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:57.598279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edd920-ab3f-4a64-92c3-f73164243d85 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:57.647249 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df643c3-25d7-4087-a444-85cbbb81eda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:57.647872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df643c3-25d7-4087-a444-85cbbb81eda6 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.648157 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df643c3-25d7-4087-a444-85cbbb81eda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.648426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df643c3-25d7-4087-a444-85cbbb81eda6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.649140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df643c3-25d7-4087-a444-85cbbb81eda6 None admin] RBAC: Adding query filter params (role.id=bd638a70b0d5447ab1d78f20ef54200e, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=6c83e30a9fd04385b44ee3a3b72e5099) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:57.649446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df643c3-25d7-4087-a444-85cbbb81eda6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:57.650857 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df643c3-25d7-4087-a444-85cbbb81eda6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:57.664505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 341/670] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:57 2022] GET /identity/v3/role_assignments?user.id=6c83e30a9fd04385b44ee3a3b72e5099&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=bd638a70b0d5447ab1d78f20ef54200e => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:57.664505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49024fe6-f22a-412a-8733-9faa08fb4ff7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.664505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49024fe6-f22a-412a-8733-9faa08fb4ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.664505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49024fe6-f22a-412a-8733-9faa08fb4ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.678317 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-49024fe6-f22a-412a-8733-9faa08fb4ff7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:57.679644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-49024fe6-f22a-412a-8733-9faa08fb4ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:57.733781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edd920-ab3f-4a64-92c3-f73164243d85 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:57.776239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 342/671] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:57.776239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49024fe6-f22a-412a-8733-9faa08fb4ff7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:57.786081 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0ae32-d85a-48a0-a7e8-1ad40a83945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:57.786733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0ae32-d85a-48a0-a7e8-1ad40a83945d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.787009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0ae32-d85a-48a0-a7e8-1ad40a83945d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.787330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0ae32-d85a-48a0-a7e8-1ad40a83945d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.800862 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0ae32-d85a-48a0-a7e8-1ad40a83945d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:57.802556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0ae32-d85a-48a0-a7e8-1ad40a83945d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-0cc0ae32-d85a-48a0-a7e8-1ad40a83945d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:50:57.824541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:57.826461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:57.827348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:50:57.827348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:50:57.827348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:50:57.827348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:50:57.827348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:50:57.827348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:50:57.827348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:57.827348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:57.827348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 330/672] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:57.831869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0ae32-d85a-48a0-a7e8-1ad40a83945d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:57.861059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:57.900353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:57.925518 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49024fe6-f22a-412a-8733-9faa08fb4ff7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:57.957641 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0ae32-d85a-48a0-a7e8-1ad40a83945d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:57.969195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1bf03-72c2-4252-8b42-1b6635a53e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:57.970099 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1bf03-72c2-4252-8b42-1b6635a53e02 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:57.970612 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1bf03-72c2-4252-8b42-1b6635a53e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:57.971079 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b1bf03-72c2-4252-8b42-1b6635a53e02 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:57.971955 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1bf03-72c2-4252-8b42-1b6635a53e02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:57.972453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1bf03-72c2-4252-8b42-1b6635a53e02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:57.974018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b1bf03-72c2-4252-8b42-1b6635a53e02 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:57.988336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 343/673] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:57.994504 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1bf03-72c2-4252-8b42-1b6635a53e02 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:58.003082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93910a2-e208-4beb-ad8a-bcf47d39c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:58.003707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93910a2-e208-4beb-ad8a-bcf47d39c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.004018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93910a2-e208-4beb-ad8a-bcf47d39c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.004293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93910a2-e208-4beb-ad8a-bcf47d39c4a1 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.004993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93910a2-e208-4beb-ad8a-bcf47d39c4a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:58.005297 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93910a2-e208-4beb-ad8a-bcf47d39c4a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:58.006731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93910a2-e208-4beb-ad8a-bcf47d39c4a1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:58.026362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 331/674] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:50:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:58.030482 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93910a2-e208-4beb-ad8a-bcf47d39c4a1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:58.129922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:58.130758 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b1bf03-72c2-4252-8b42-1b6635a53e02 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:58.146782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93910a2-e208-4beb-ad8a-bcf47d39c4a1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:58.167166 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b08626-ea8b-4e2b-b810-18b3be3a68c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:58.168660 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b08626-ea8b-4e2b-b810-18b3be3a68c2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.169092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b08626-ea8b-4e2b-b810-18b3be3a68c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.169509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b08626-ea8b-4e2b-b810-18b3be3a68c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.173215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:58.178338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b08626-ea8b-4e2b-b810-18b3be3a68c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:58.180068 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b08626-ea8b-4e2b-b810-18b3be3a68c2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:58.182677 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f67e5-715d-4fd4-8a26-4893a2dc1693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:58.183288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f67e5-715d-4fd4-8a26-4893a2dc1693 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.183563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f67e5-715d-4fd4-8a26-4893a2dc1693 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.184434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f67e5-715d-4fd4-8a26-4893a2dc1693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.188377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f67e5-715d-4fd4-8a26-4893a2dc1693 None admin] RBAC: Adding query filter params (role.id=bd638a70b0d5447ab1d78f20ef54200e, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=c33f1237eb614223a062bafb7a49eac6) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:58.188377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f67e5-715d-4fd4-8a26-4893a2dc1693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:58.188377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f67e5-715d-4fd4-8a26-4893a2dc1693 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:58.192902 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 332/675] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:58 2022] GET /identity/v3/role_assignments?user.id=c33f1237eb614223a062bafb7a49eac6&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=bd638a70b0d5447ab1d78f20ef54200e => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-65b08626-ea8b-4e2b-b810-18b3be3a68c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:50:58.193312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:58.194186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:58.195165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:50:58.195165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:50:58.195165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:50:58.195165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:50:58.195165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:50:58.195165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:50:58.195165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:50:58.195165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:58.195614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f67e5-715d-4fd4-8a26-4893a2dc1693 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:58.196889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 344/676] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:50:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:58.198334 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac78560-7544-4ddc-8c3e-8f68cb63ec09 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.198772 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac78560-7544-4ddc-8c3e-8f68cb63ec09 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.199186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac78560-7544-4ddc-8c3e-8f68cb63ec09 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.200862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 345/677] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:50:58.202516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac78560-7544-4ddc-8c3e-8f68cb63ec09 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:58.336368 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f67e5-715d-4fd4-8a26-4893a2dc1693 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:58.346789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac78560-7544-4ddc-8c3e-8f68cb63ec09 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:58.383477 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b0604-9b49-4466-8982-20d0957e993e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:58.384808 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b0604-9b49-4466-8982-20d0957e993e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.385264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b0604-9b49-4466-8982-20d0957e993e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.386310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885b0604-9b49-4466-8982-20d0957e993e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.391458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f5807-e960-44c3-b8a9-cb4d937bcfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:58.392213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f5807-e960-44c3-b8a9-cb4d937bcfe2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.392491 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f5807-e960-44c3-b8a9-cb4d937bcfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.392772 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f5807-e960-44c3-b8a9-cb4d937bcfe2 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.394154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f5807-e960-44c3-b8a9-cb4d937bcfe2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:58.394154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f5807-e960-44c3-b8a9-cb4d937bcfe2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:58.395629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f5807-e960-44c3-b8a9-cb4d937bcfe2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:58.405071 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885b0604-9b49-4466-8982-20d0957e993e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:58.411665 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 346/678] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-885b0604-9b49-4466-8982-20d0957e993e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:58.412164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:58.413293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:58.414318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:58.414318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:58.414318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:58.414318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:58.414318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:58.414318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:58.414318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:58.414318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:58.414318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:58.414318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:58.414318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:50:58.414318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:58.415135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885fbaf-b0cd-4dc0-929d-c7a92a7d513d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.415135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885fbaf-b0cd-4dc0-929d-c7a92a7d513d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.415135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885fbaf-b0cd-4dc0-929d-c7a92a7d513d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.416974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 333/679] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:50:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:58.421204 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b0604-9b49-4466-8982-20d0957e993e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:58.433274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:58.440197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4885fbaf-b0cd-4dc0-929d-c7a92a7d513d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:50:58.442075 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4885fbaf-b0cd-4dc0-929d-c7a92a7d513d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:50:58.508724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:58.526832 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 347/680] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:50:58.528779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885fbaf-b0cd-4dc0-929d-c7a92a7d513d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:58.541930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885b0604-9b49-4466-8982-20d0957e993e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:58.577781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcb46c-4322-4abb-bb9e-2655daec67bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:58.578797 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb46c-4322-4abb-bb9e-2655daec67bd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.579180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb46c-4322-4abb-bb9e-2655daec67bd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.579637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcb46c-4322-4abb-bb9e-2655daec67bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.580406 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcb46c-4322-4abb-bb9e-2655daec67bd None admin] RBAC: Adding query filter params (role.id=bd638a70b0d5447ab1d78f20ef54200e, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=f49116f202774e4da0c96875ffa08288) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:58.581113 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcb46c-4322-4abb-bb9e-2655daec67bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:58.582374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcb46c-4322-4abb-bb9e-2655daec67bd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:58.593599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 334/681] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:50:58 2022] GET /identity/v3/role_assignments?user.id=f49116f202774e4da0c96875ffa08288&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=bd638a70b0d5447ab1d78f20ef54200e => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:58.642996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885fbaf-b0cd-4dc0-929d-c7a92a7d513d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:58.686764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483ee8e-c0d2-4f37-a513-2b8fa98acbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:58.687634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483ee8e-c0d2-4f37-a513-2b8fa98acbc9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.688100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483ee8e-c0d2-4f37-a513-2b8fa98acbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.688543 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483ee8e-c0d2-4f37-a513-2b8fa98acbc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.689381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483ee8e-c0d2-4f37-a513-2b8fa98acbc9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:58.689832 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483ee8e-c0d2-4f37-a513-2b8fa98acbc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:58.691356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483ee8e-c0d2-4f37-a513-2b8fa98acbc9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:58.706197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 348/682] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:50:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:58.712114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcb46c-4322-4abb-bb9e-2655daec67bd None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:58.803585 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:58.835327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcb46c-4322-4abb-bb9e-2655daec67bd None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:58.876149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49322c-ce3e-42e0-a04f-777ea6031902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:58.876356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483ee8e-c0d2-4f37-a513-2b8fa98acbc9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:58.876964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49322c-ce3e-42e0-a04f-777ea6031902 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:58.877290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49322c-ce3e-42e0-a04f-777ea6031902 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:58.877508 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49322c-ce3e-42e0-a04f-777ea6031902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:58.889802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49322c-ce3e-42e0-a04f-777ea6031902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:58.891253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49322c-ce3e-42e0-a04f-777ea6031902 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ba49322c-ce3e-42e0-a04f-777ea6031902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:58.906798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:58.907807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:58.908847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:58.908847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:58.908847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:58.908847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 335/683] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:58.916164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49322c-ce3e-42e0-a04f-777ea6031902 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:58.947526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:59.003770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483ee8e-c0d2-4f37-a513-2b8fa98acbc9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:59.036410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49322c-ce3e-42e0-a04f-777ea6031902 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:59.038709 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a5fab-cfaa-450d-97cd-f574224dc072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:59.039877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a5fab-cfaa-450d-97cd-f574224dc072 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:59.039877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a5fab-cfaa-450d-97cd-f574224dc072 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:59.040192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a5fab-cfaa-450d-97cd-f574224dc072 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:59.058237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a5fab-cfaa-450d-97cd-f574224dc072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:50:59.062308 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7c3a5fab-cfaa-450d-97cd-f574224dc072 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:50:59.065411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:59.066354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:59.067208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:59.067208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:59.067208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:59.067208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:59.067208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:50:59.067208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:50:59.067208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:50:59.067208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:50:59.067208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:50:59.067208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:50:59.067208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:50:59.067208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:59.067208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 349/684] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:50:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:50:59.078989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a5fab-cfaa-450d-97cd-f574224dc072 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:59.081628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b640c3-07b6-4d71-b5c3-1cf2b16926ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:59.082469 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b640c3-07b6-4d71-b5c3-1cf2b16926ec None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:59.082946 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b640c3-07b6-4d71-b5c3-1cf2b16926ec None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:59.083441 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b640c3-07b6-4d71-b5c3-1cf2b16926ec None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:59.084312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b640c3-07b6-4d71-b5c3-1cf2b16926ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:59.084813 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b640c3-07b6-4d71-b5c3-1cf2b16926ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:59.086360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b640c3-07b6-4d71-b5c3-1cf2b16926ec None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:59.100326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 336/685] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:59.106596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b640c3-07b6-4d71-b5c3-1cf2b16926ec None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:59.228182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b640c3-07b6-4d71-b5c3-1cf2b16926ec None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:59.291495 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5118-8cfb-40cd-8eba-d6477cf84e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:59.292912 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5118-8cfb-40cd-8eba-d6477cf84e88 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:59.292912 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5118-8cfb-40cd-8eba-d6477cf84e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:59.292912 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5118-8cfb-40cd-8eba-d6477cf84e88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:59.301994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a5fab-cfaa-450d-97cd-f574224dc072 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:59.316201 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:59.316661 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac5118-8cfb-40cd-8eba-d6477cf84e88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:59.318177 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac5118-8cfb-40cd-8eba-d6477cf84e88 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e6ac5118-8cfb-40cd-8eba-d6477cf84e88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:50:59.337949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:59.342048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:59.343467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:59.343467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:59.343467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:50:59.343467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:50:59.343467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:50:59.343467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:50:59.343467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:50:59.343467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:50:59.343467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:50:59.343467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:50:59.343467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 337/686] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 24 07:50:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:59.348579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5118-8cfb-40cd-8eba-d6477cf84e88 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:59.364161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be29b96-d407-4348-8d48-a525aba593fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:59.364771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be29b96-d407-4348-8d48-a525aba593fb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:59.365044 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be29b96-d407-4348-8d48-a525aba593fb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:59.365309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be29b96-d407-4348-8d48-a525aba593fb None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:59.365971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be29b96-d407-4348-8d48-a525aba593fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:59.366266 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be29b96-d407-4348-8d48-a525aba593fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:59.367614 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be29b96-d407-4348-8d48-a525aba593fb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:59.391486 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 350/687] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:50:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:59.401281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be29b96-d407-4348-8d48-a525aba593fb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:59.448210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:59.551962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be29b96-d407-4348-8d48-a525aba593fb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:59.564604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5118-8cfb-40cd-8eba-d6477cf84e88 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:59.624913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9397c9f-dbc8-4fe9-b136-ada802cd4ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:59.625566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9397c9f-dbc8-4fe9-b136-ada802cd4ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:59.625847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9397c9f-dbc8-4fe9-b136-ada802cd4ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:59.626122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9397c9f-dbc8-4fe9-b136-ada802cd4ab0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:59.628688 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7aaef4-5149-454a-bda8-263415c3bd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:59.629314 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7aaef4-5149-454a-bda8-263415c3bd06 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:59.629589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7aaef4-5149-454a-bda8-263415c3bd06 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:59.629857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7aaef4-5149-454a-bda8-263415c3bd06 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:59.630606 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7aaef4-5149-454a-bda8-263415c3bd06 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:59.630913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7aaef4-5149-454a-bda8-263415c3bd06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:59.632404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7aaef4-5149-454a-bda8-263415c3bd06 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:59.652191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9397c9f-dbc8-4fe9-b136-ada802cd4ab0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:59.653861 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9397c9f-dbc8-4fe9-b136-ada802cd4ab0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:59.669694 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 338/688] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 24 07:50:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:50:59.674927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7aaef4-5149-454a-bda8-263415c3bd06 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f9397c9f-dbc8-4fe9-b136-ada802cd4ab0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:50:59.679537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:50:59.680516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:50:59.681419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:50:59.681419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:50:59.681419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:50:59.681840 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 351/689] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:50:59.688112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9397c9f-dbc8-4fe9-b136-ada802cd4ab0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:59.732213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:59.813644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9397c9f-dbc8-4fe9-b136-ada802cd4ab0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:59.850654 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ccfe0-60d1-46e7-b77c-7fce9cd7c1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:59.851270 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ccfe0-60d1-46e7-b77c-7fce9cd7c1d1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:59.851548 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ccfe0-60d1-46e7-b77c-7fce9cd7c1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:59.851817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ccfe0-60d1-46e7-b77c-7fce9cd7c1d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:50:59.852507 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ccfe0-60d1-46e7-b77c-7fce9cd7c1d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:50:59.852806 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ccfe0-60d1-46e7-b77c-7fce9cd7c1d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:50:59.854163 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ccfe0-60d1-46e7-b77c-7fce9cd7c1d1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:50:59.871680 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 352/690] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:50:59.877296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ccfe0-60d1-46e7-b77c-7fce9cd7c1d1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:50:59.898639 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7aaef4-5149-454a-bda8-263415c3bd06 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:50:59.898639 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:50:59.936771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25afda74-51ba-4d27-8202-3cb96f967813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:50:59.937382 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afda74-51ba-4d27-8202-3cb96f967813 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:50:59.937653 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afda74-51ba-4d27-8202-3cb96f967813 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:50:59.938076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25afda74-51ba-4d27-8202-3cb96f967813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:00.030922 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:00.032869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afda74-51ba-4d27-8202-3cb96f967813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:00.034473 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25afda74-51ba-4d27-8202-3cb96f967813 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:00.052675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ccfe0-60d1-46e7-b77c-7fce9cd7c1d1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:00.098614 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662775a-96d4-46c8-87f9-27673b6a046a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:00.099441 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662775a-96d4-46c8-87f9-27673b6a046a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:00.100072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662775a-96d4-46c8-87f9-27673b6a046a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:00.100375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662775a-96d4-46c8-87f9-27673b6a046a None admin] PATH_INFO: `/v3/users/swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:00.113321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662775a-96d4-46c8-87f9-27673b6a046a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:00.115036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662775a-96d4-46c8-87f9-27673b6a046a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1662775a-96d4-46c8-87f9-27673b6a046a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:00.135089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:00.136199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:00.137352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:00.137352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:00.137352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:00.137352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:00.137352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:00.137352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:00.137352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:00.137352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:00.137352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:51:00.137352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:00.137352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 353/691] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:50:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:00.138425 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8412ad-42e7-44b7-a7d0-2f1bb18cdd4e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:00.143871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8412ad-42e7-44b7-a7d0-2f1bb18cdd4e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:00.143871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8412ad-42e7-44b7-a7d0-2f1bb18cdd4e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:00.143871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 354/692] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:00.145723 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8412ad-42e7-44b7-a7d0-2f1bb18cdd4e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:00.156687 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 339/693] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:50:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:51:00.158425 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3823bc-097c-4e0f-94f7-521ec2296eb2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:00.158708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3823bc-097c-4e0f-94f7-521ec2296eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:00.159375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3823bc-097c-4e0f-94f7-521ec2296eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:00.167363 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:00.183596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-aa3823bc-097c-4e0f-94f7-521ec2296eb2 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:00.185549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-aa3823bc-097c-4e0f-94f7-521ec2296eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:00.261017 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8412ad-42e7-44b7-a7d0-2f1bb18cdd4e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:00.276524 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 340/694] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:51:00.278386 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3823bc-097c-4e0f-94f7-521ec2296eb2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:00.318617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ebaa8-7e43-4abc-9a2d-4b8081bb39c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:00.319379 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ebaa8-7e43-4abc-9a2d-4b8081bb39c0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:00.319719 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ebaa8-7e43-4abc-9a2d-4b8081bb39c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:00.320076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ebaa8-7e43-4abc-9a2d-4b8081bb39c0 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:00.320806 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ebaa8-7e43-4abc-9a2d-4b8081bb39c0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:00.321165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ebaa8-7e43-4abc-9a2d-4b8081bb39c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:00.322588 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ebaa8-7e43-4abc-9a2d-4b8081bb39c0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:00.348046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:00.355784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 355/695] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Aug 24 07:51:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:00.361731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ebaa8-7e43-4abc-9a2d-4b8081bb39c0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:00.394802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3823bc-097c-4e0f-94f7-521ec2296eb2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:00.430065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:00.444808 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f85006-bcd4-4215-98df-28196e39b03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:00.445566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f85006-bcd4-4215-98df-28196e39b03f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:00.450999 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f85006-bcd4-4215-98df-28196e39b03f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:00.450999 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f85006-bcd4-4215-98df-28196e39b03f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:00.467405 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f85006-bcd4-4215-98df-28196e39b03f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:00.468995 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f85006-bcd4-4215-98df-28196e39b03f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-b5f85006-bcd4-4215-98df-28196e39b03f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:00.500321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:00.502565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:00.504689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:00.504689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:00.504689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:00.505080 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ebaa8-7e43-4abc-9a2d-4b8081bb39c0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:00.509748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 341/696] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:00.510868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f85006-bcd4-4215-98df-28196e39b03f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:00.539183 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9b56f-9659-4ad7-98ec-6eb01f338b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:00.539865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b56f-9659-4ad7-98ec-6eb01f338b67 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:00.540282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b56f-9659-4ad7-98ec-6eb01f338b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:00.540563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9b56f-9659-4ad7-98ec-6eb01f338b67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:00.612342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:00.616520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9b56f-9659-4ad7-98ec-6eb01f338b67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:00.617860 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9b56f-9659-4ad7-98ec-6eb01f338b67 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:00.675950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f85006-bcd4-4215-98df-28196e39b03f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:00.713090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ece57cc-6bbc-4481-b556-73978d95aba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:00.713991 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece57cc-6bbc-4481-b556-73978d95aba5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:00.714268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece57cc-6bbc-4481-b556-73978d95aba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:00.714537 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ece57cc-6bbc-4481-b556-73978d95aba5 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:00.715424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece57cc-6bbc-4481-b556-73978d95aba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:00.715773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece57cc-6bbc-4481-b556-73978d95aba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:00.717150 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ece57cc-6bbc-4481-b556-73978d95aba5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:00.728903 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 342/697] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:00.729918 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c91a7-4089-4ccf-89ad-42eb2a4b7b6e None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:00.730201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c91a7-4089-4ccf-89ad-42eb2a4b7b6e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:00.730479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c91a7-4089-4ccf-89ad-42eb2a4b7b6e None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:00.731831 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 343/698] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:00.732626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c91a7-4089-4ccf-89ad-42eb2a4b7b6e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:00.734757 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 356/699] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:51:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 07:51:00.735917 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9b56f-9659-4ad7-98ec-6eb01f338b67 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:00.787378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:00.842430 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:00.845405 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9b56f-9659-4ad7-98ec-6eb01f338b67 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:00.845932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c91a7-4089-4ccf-89ad-42eb2a4b7b6e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:00.881304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b15e68-ab93-45dd-ac2f-82c8ccf0c3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:00.881494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a94b7-2a6c-40fe-a444-24a1d3fae160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:00.881855 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a94b7-2a6c-40fe-a444-24a1d3fae160 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:00.881959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b15e68-ab93-45dd-ac2f-82c8ccf0c3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:00.882132 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b15e68-ab93-45dd-ac2f-82c8ccf0c3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:00.882230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a94b7-2a6c-40fe-a444-24a1d3fae160 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:00.882393 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a94b7-2a6c-40fe-a444-24a1d3fae160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:00.882497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b15e68-ab93-45dd-ac2f-82c8ccf0c3d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:00.889991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b15e68-ab93-45dd-ac2f-82c8ccf0c3d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:00.891418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b15e68-ab93-45dd-ac2f-82c8ccf0c3d1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:00.894242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a94b7-2a6c-40fe-a444-24a1d3fae160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:00.895981 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0a94b7-2a6c-40fe-a444-24a1d3fae160 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-84b15e68-ab93-45dd-ac2f-82c8ccf0c3d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:00.902600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:00.903517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:00.904536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:00.904536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:00.904536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:00.904536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:00.904536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:00.904536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:00.904536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:00.904536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:00.904536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 357/700] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:00.905021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2d75-bf16-459b-ac31-2edd4904a0a4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:00.905453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2d75-bf16-459b-ac31-2edd4904a0a4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:00.905562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65f2d75-bf16-459b-ac31-2edd4904a0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ee0a94b7-2a6c-40fe-a444-24a1d3fae160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:00.916986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:00.918516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:00.919600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:00.919600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:00.919600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:00.926017 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 344/701] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:00.926017 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a94b7-2a6c-40fe-a444-24a1d3fae160 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:00.926228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f65f2d75-bf16-459b-ac31-2edd4904a0a4 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:00.926228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f65f2d75-bf16-459b-ac31-2edd4904a0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:01.005525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 358/702] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:51:01.005525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f2d75-bf16-459b-ac31-2edd4904a0a4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:01.022969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:01.028892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0a94b7-2a6c-40fe-a444-24a1d3fae160 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:01.064379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b31516-c1f2-4864-8eba-a93608669eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:01.065118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b31516-c1f2-4864-8eba-a93608669eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.065402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b31516-c1f2-4864-8eba-a93608669eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.065672 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b31516-c1f2-4864-8eba-a93608669eb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.076439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b31516-c1f2-4864-8eba-a93608669eb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:01.077872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b31516-c1f2-4864-8eba-a93608669eb4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f6b31516-c1f2-4864-8eba-a93608669eb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:01.095097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:01.096165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:01.097080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:01.097080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:01.097080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:01.097080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 345/703] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:01.097080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b31516-c1f2-4864-8eba-a93608669eb4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:01.108382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:01.117796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65f2d75-bf16-459b-ac31-2edd4904a0a4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:01.153706 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07e5c6-f742-45be-bda3-3640a8279b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:01.154235 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07e5c6-f742-45be-bda3-3640a8279b4b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.154522 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07e5c6-f742-45be-bda3-3640a8279b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.154795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07e5c6-f742-45be-bda3-3640a8279b4b None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.155487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07e5c6-f742-45be-bda3-3640a8279b4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:01.155793 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07e5c6-f742-45be-bda3-3640a8279b4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:01.157240 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c07e5c6-f742-45be-bda3-3640a8279b4b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:01.169320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 359/704] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:01.170495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ff067-40f9-4eda-9717-91e59071c492 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.170783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ff067-40f9-4eda-9717-91e59071c492 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.171056 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ff067-40f9-4eda-9717-91e59071c492 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.175908 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 360/705] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:01.175908 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ff067-40f9-4eda-9717-91e59071c492 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:01.216407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b31516-c1f2-4864-8eba-a93608669eb4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:01.252278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b70ee-3798-4a5a-aba6-f08476a0f93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:01.252888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b70ee-3798-4a5a-aba6-f08476a0f93e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.253167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b70ee-3798-4a5a-aba6-f08476a0f93e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.253458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b70ee-3798-4a5a-aba6-f08476a0f93e None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.254126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b70ee-3798-4a5a-aba6-f08476a0f93e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:01.254427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b70ee-3798-4a5a-aba6-f08476a0f93e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:01.255910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b70ee-3798-4a5a-aba6-f08476a0f93e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:01.268572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 346/706] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:01.269505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b70ee-3798-4a5a-aba6-f08476a0f93e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:01.281656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:01.283722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ff067-40f9-4eda-9717-91e59071c492 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:01.319615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2233f53-8a06-4069-a750-397bea506681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:01.320238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2233f53-8a06-4069-a750-397bea506681 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.320513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2233f53-8a06-4069-a750-397bea506681 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.320781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2233f53-8a06-4069-a750-397bea506681 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.321422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2233f53-8a06-4069-a750-397bea506681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:01.321724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2233f53-8a06-4069-a750-397bea506681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:01.323067 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2233f53-8a06-4069-a750-397bea506681 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:01.334105 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 361/707] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:01.335269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8280571-75a6-424c-bb57-d8d573e36020 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.335546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8280571-75a6-424c-bb57-d8d573e36020 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.335817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8280571-75a6-424c-bb57-d8d573e36020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.353269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c8280571-75a6-424c-bb57-d8d573e36020 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:01.354439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c8280571-75a6-424c-bb57-d8d573e36020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:01.357760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:01.369274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b70ee-3798-4a5a-aba6-f08476a0f93e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:01.402941 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5e6a4-ac0a-4030-b911-05da18c5c09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:01.403612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5e6a4-ac0a-4030-b911-05da18c5c09a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.403984 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5e6a4-ac0a-4030-b911-05da18c5c09a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.404196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5e6a4-ac0a-4030-b911-05da18c5c09a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.404937 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5e6a4-ac0a-4030-b911-05da18c5c09a None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=9b99cff7a5f549adadee002f8ab1f5d9) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:01.405244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5e6a4-ac0a-4030-b911-05da18c5c09a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:01.406647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5e6a4-ac0a-4030-b911-05da18c5c09a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:01.411887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 347/708] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:51:01 2022] GET /identity/v3/role_assignments?user.id=9b99cff7a5f549adadee002f8ab1f5d9&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=68b1888f7bb644a39938b8d41006a813 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:01.412662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5e6a4-ac0a-4030-b911-05da18c5c09a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:01.423013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 362/709] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:51:01.424237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8280571-75a6-424c-bb57-d8d573e36020 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:01.536423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5e6a4-ac0a-4030-b911-05da18c5c09a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:01.542881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:01.587865 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74a0c3-478c-433e-8a11-cc0d7ab447f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:01.588924 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74a0c3-478c-433e-8a11-cc0d7ab447f4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.589265 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74a0c3-478c-433e-8a11-cc0d7ab447f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.589607 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc74a0c3-478c-433e-8a11-cc0d7ab447f4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.590876 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74a0c3-478c-433e-8a11-cc0d7ab447f4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:01.592344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc74a0c3-478c-433e-8a11-cc0d7ab447f4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:01.592468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8280571-75a6-424c-bb57-d8d573e36020 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-bc74a0c3-478c-433e-8a11-cc0d7ab447f4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:01.604434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:01.606182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:01.607312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 348/710] 10.222.0.62 () {56 vars in 1129 bytes} [Wed Aug 24 07:51:01 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:01.608487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74a0c3-478c-433e-8a11-cc0d7ab447f4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:01.632675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13161266-ac88-4b4b-b3e2-a675ec6dea91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:01.632675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13161266-ac88-4b4b-b3e2-a675ec6dea91 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.632992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13161266-ac88-4b4b-b3e2-a675ec6dea91 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.633540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13161266-ac88-4b4b-b3e2-a675ec6dea91 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.633820 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13161266-ac88-4b4b-b3e2-a675ec6dea91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:01.635248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13161266-ac88-4b4b-b3e2-a675ec6dea91 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:01.646909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:01.713131 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 363/711] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:51:01 2022] POST /identity/v3/users => generated 254 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:51:01.714136 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13161266-ac88-4b4b-b3e2-a675ec6dea91 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:01.723410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc74a0c3-478c-433e-8a11-cc0d7ab447f4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:01.779236 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75c327-4252-4ee1-b19f-c5c62220d69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:01.780496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c327-4252-4ee1-b19f-c5c62220d69b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.780947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c327-4252-4ee1-b19f-c5c62220d69b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.781660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d75c327-4252-4ee1-b19f-c5c62220d69b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.786526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:01.793893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75c327-4252-4ee1-b19f-c5c62220d69b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:01.800038 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d75c327-4252-4ee1-b19f-c5c62220d69b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-4d75c327-4252-4ee1-b19f-c5c62220d69b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:01.814072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:01.815263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:01.816432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:01.816432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:01.816432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:01.816432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:01.816432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:01.816432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:01.816432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:01.816432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:01.818917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 349/712] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:01.819964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75c327-4252-4ee1-b19f-c5c62220d69b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:01.835960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13161266-ac88-4b4b-b3e2-a675ec6dea91 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:01.881581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b00a6c-e74b-4f89-8f31-31120dcf73ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:01.882524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b00a6c-e74b-4f89-8f31-31120dcf73ca None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:01.887908 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b00a6c-e74b-4f89-8f31-31120dcf73ca None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:01.887908 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b00a6c-e74b-4f89-8f31-31120dcf73ca None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:01.887908 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b00a6c-e74b-4f89-8f31-31120dcf73ca None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:01.887908 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b00a6c-e74b-4f89-8f31-31120dcf73ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:01.887908 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b00a6c-e74b-4f89-8f31-31120dcf73ca None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:01.895117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 364/713] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Aug 24 07:51:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:01.896710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b00a6c-e74b-4f89-8f31-31120dcf73ca None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:01.973174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:02.018358 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b00a6c-e74b-4f89-8f31-31120dcf73ca None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:02.059762 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78a2e5-1a62-4b64-a8b7-36ca0deded0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:02.060412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78a2e5-1a62-4b64-a8b7-36ca0deded0d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:02.060889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78a2e5-1a62-4b64-a8b7-36ca0deded0d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:02.061140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78a2e5-1a62-4b64-a8b7-36ca0deded0d None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:02.061992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78a2e5-1a62-4b64-a8b7-36ca0deded0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:02.062298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78a2e5-1a62-4b64-a8b7-36ca0deded0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:02.063819 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78a2e5-1a62-4b64-a8b7-36ca0deded0d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:02.070949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d75c327-4252-4ee1-b19f-c5c62220d69b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:02.077608 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 365/714] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:02.078568 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78a2e5-1a62-4b64-a8b7-36ca0deded0d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:02.123066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633fd6c-f67d-4410-929f-d7645ae0f987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:02.123701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633fd6c-f67d-4410-929f-d7645ae0f987 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:02.124026 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633fd6c-f67d-4410-929f-d7645ae0f987 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:02.124297 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633fd6c-f67d-4410-929f-d7645ae0f987 None admin] PATH_INFO: `/v3/services/network` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:02.124883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633fd6c-f67d-4410-929f-d7645ae0f987 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:02.126830 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5633fd6c-f67d-4410-929f-d7645ae0f987 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-5633fd6c-f67d-4410-929f-d7645ae0f987 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:02.139676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:02.140748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:02.141583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 350/715] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:01 2022] GET /identity/v3/services/network => generated 88 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:02.142530 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633fd6c-f67d-4410-929f-d7645ae0f987 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:02.203418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78a2e5-1a62-4b64-a8b7-36ca0deded0d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:02.211678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:02.229595 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:02.246406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a837f3-19da-466b-8016-6f12ba6928fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:02.247257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a837f3-19da-466b-8016-6f12ba6928fb None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:02.247542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a837f3-19da-466b-8016-6f12ba6928fb None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:02.247813 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a837f3-19da-466b-8016-6f12ba6928fb None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:02.248472 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a837f3-19da-466b-8016-6f12ba6928fb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:02.248866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a837f3-19da-466b-8016-6f12ba6928fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:02.250291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a837f3-19da-466b-8016-6f12ba6928fb None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:02.261070 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 366/716] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Aug 24 07:51:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:02.262530 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a837f3-19da-466b-8016-6f12ba6928fb None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:02.266380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633fd6c-f67d-4410-929f-d7645ae0f987 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:02.321260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2b078-9e28-4e48-bbe9-ba3a77a099a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:02.324092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2b078-9e28-4e48-bbe9-ba3a77a099a0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:02.324434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2b078-9e28-4e48-bbe9-ba3a77a099a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:02.324835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2b078-9e28-4e48-bbe9-ba3a77a099a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:02.327130 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2b078-9e28-4e48-bbe9-ba3a77a099a0 None admin] RBAC: Adding query filter params (role.id=bd638a70b0d5447ab1d78f20ef54200e, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=8255043f01fd46e4a8a5fde8e81c2bed) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:02.328515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2b078-9e28-4e48-bbe9-ba3a77a099a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:02.331610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2b078-9e28-4e48-bbe9-ba3a77a099a0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:02.346108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 351/717] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:51:02 2022] GET /identity/v3/role_assignments?user.id=8255043f01fd46e4a8a5fde8e81c2bed&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=bd638a70b0d5447ab1d78f20ef54200e => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:02.425605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a837f3-19da-466b-8016-6f12ba6928fb None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:02.471818 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6dd719-7faa-438e-8ab1-7cf753276f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:02.472481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dd719-7faa-438e-8ab1-7cf753276f21 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:02.472763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dd719-7faa-438e-8ab1-7cf753276f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:02.473038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6dd719-7faa-438e-8ab1-7cf753276f21 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:02.473699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dd719-7faa-438e-8ab1-7cf753276f21 None admin] RBAC: Adding query filter params (name=network) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:02.474008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dd719-7faa-438e-8ab1-7cf753276f21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:02.475419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6dd719-7faa-438e-8ab1-7cf753276f21 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:02.481593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 367/718] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 24 07:51:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:02.487221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2b078-9e28-4e48-bbe9-ba3a77a099a0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:02.614210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2b078-9e28-4e48-bbe9-ba3a77a099a0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:02.640400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:02.651742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eae488c-14a6-4890-ae62-e0ca3e041e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:02.653015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae488c-14a6-4890-ae62-e0ca3e041e01 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:02.653369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae488c-14a6-4890-ae62-e0ca3e041e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:02.653644 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae488c-14a6-4890-ae62-e0ca3e041e01 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:02.654278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae488c-14a6-4890-ae62-e0ca3e041e01 None admin] RBAC: Adding query filter params (type=network) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:02.654579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae488c-14a6-4890-ae62-e0ca3e041e01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:02.655955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eae488c-14a6-4890-ae62-e0ca3e041e01 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:02.662017 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 352/719] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 24 07:51:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:03.585892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915f899-f1ed-4149-ba3d-092ca3bb72d1 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:03.586432 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915f899-f1ed-4149-ba3d-092ca3bb72d1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:03.586432 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915f899-f1ed-4149-ba3d-092ca3bb72d1 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:03.588029 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 368/720] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:03.601213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849b586-d898-4f43-b131-3fc2c84c39d9 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:03.601671 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849b586-d898-4f43-b131-3fc2c84c39d9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:03.601761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849b586-d898-4f43-b131-3fc2c84c39d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:03.624107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0849b586-d898-4f43-b131-3fc2c84c39d9 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:03.625356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0849b586-d898-4f43-b131-3fc2c84c39d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:03.717164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 353/721] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:51:03.956032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e5482-6033-498d-8d9e-5635fec062e3 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:03.956318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e5482-6033-498d-8d9e-5635fec062e3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:03.956591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e5482-6033-498d-8d9e-5635fec062e3 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:03.958175 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 369/722] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:03.963233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59178-8bdb-4f4a-965f-823c1b54d05e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:03.963785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59178-8bdb-4f4a-965f-823c1b54d05e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:03.964093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f59178-8bdb-4f4a-965f-823c1b54d05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:03.993143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-39f59178-8bdb-4f4a-965f-823c1b54d05e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:03.994312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-39f59178-8bdb-4f4a-965f-823c1b54d05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:04.086412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 354/723] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 07:51:04.122121 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e5482-6033-498d-8d9e-5635fec062e3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:04.193588 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:04.264611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e5482-6033-498d-8d9e-5635fec062e3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:04.306859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9149d-878c-4fce-8927-e4202be94161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:04.307492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9149d-878c-4fce-8927-e4202be94161 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:04.307769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9149d-878c-4fce-8927-e4202be94161 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:04.308065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b9149d-878c-4fce-8927-e4202be94161 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:04.321369 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b9149d-878c-4fce-8927-e4202be94161 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b1b9149d-878c-4fce-8927-e4202be94161 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:04.326292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:04.328431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:04.330402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:04.330402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:04.330402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:04.330402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:04.330402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:04.330402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:04.330402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:04.330402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:04.330402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:04.330402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:04.330402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:04.330402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:04.330402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 370/724] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:51:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:04.337669 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f59178-8bdb-4f4a-965f-823c1b54d05e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:04.408866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:04.410675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9149d-878c-4fce-8927-e4202be94161 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:04.509766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f59178-8bdb-4f4a-965f-823c1b54d05e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:04.553977 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b9149d-878c-4fce-8927-e4202be94161 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:04.568221 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:04.585645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73a627-fbc8-4b07-bb51-eac33a041a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:04.586287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73a627-fbc8-4b07-bb51-eac33a041a87 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:04.586564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73a627-fbc8-4b07-bb51-eac33a041a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:04.586833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73a627-fbc8-4b07-bb51-eac33a041a87 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:04.587506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73a627-fbc8-4b07-bb51-eac33a041a87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:04.587800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73a627-fbc8-4b07-bb51-eac33a041a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:04.589507 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73a627-fbc8-4b07-bb51-eac33a041a87 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:04.599430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 355/725] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:51:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:04.610554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73a627-fbc8-4b07-bb51-eac33a041a87 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:04.615883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3a3e1-601e-42a2-899c-74245ee72e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:04.616521 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a3e1-601e-42a2-899c-74245ee72e06 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:04.616797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a3e1-601e-42a2-899c-74245ee72e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:04.617066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3a3e1-601e-42a2-899c-74245ee72e06 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:04.637372 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3a3e1-601e-42a2-899c-74245ee72e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-32b3a3e1-601e-42a2-899c-74245ee72e06 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:04.642406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:04.643360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:04.644565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:04.644565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:04.644565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:04.644565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:04.644565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:04.644565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:04.644565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:04.644565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:04.644565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:04.644565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:04.644565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:51:04.644565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:04.649023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 371/726] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:51:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:04.651746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3a3e1-601e-42a2-899c-74245ee72e06 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:04.796292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3a3e1-601e-42a2-899c-74245ee72e06 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:04.822676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73a627-fbc8-4b07-bb51-eac33a041a87 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:04.832491 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df94b43-cb73-4c12-bb63-af6541677bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:04.833100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df94b43-cb73-4c12-bb63-af6541677bef None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:04.833374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df94b43-cb73-4c12-bb63-af6541677bef None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:04.833643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df94b43-cb73-4c12-bb63-af6541677bef None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:04.834426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df94b43-cb73-4c12-bb63-af6541677bef None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:04.834730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df94b43-cb73-4c12-bb63-af6541677bef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:04.836102 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df94b43-cb73-4c12-bb63-af6541677bef None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:04.845372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:04.847103 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 372/727] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:51:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:04.852602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df94b43-cb73-4c12-bb63-af6541677bef None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:04.884127 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:04.905558 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52c32e-9014-4f3b-bef1-b9e8547e31c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:04.906201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52c32e-9014-4f3b-bef1-b9e8547e31c3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:04.906474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52c32e-9014-4f3b-bef1-b9e8547e31c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:04.906740 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52c32e-9014-4f3b-bef1-b9e8547e31c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:04.925232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52c32e-9014-4f3b-bef1-b9e8547e31c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:04.926674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52c32e-9014-4f3b-bef1-b9e8547e31c3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-de52c32e-9014-4f3b-bef1-b9e8547e31c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:04.945275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:04.947577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:04.950380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:04.950380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:04.950380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:04.950380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 356/728] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:04.950380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873a56d-58b1-469e-beda-ca624bb7a7af None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:04.950380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873a56d-58b1-469e-beda-ca624bb7a7af None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:04.950380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d873a56d-58b1-469e-beda-ca624bb7a7af None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:04.955457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 357/729] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:04.956254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873a56d-58b1-469e-beda-ca624bb7a7af None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:04.971406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df94b43-cb73-4c12-bb63-af6541677bef None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:05.008940 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebdde13-6fd0-4cde-9152-f0c4665fe028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:05.009571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdde13-6fd0-4cde-9152-f0c4665fe028 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.009847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdde13-6fd0-4cde-9152-f0c4665fe028 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.010114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebdde13-6fd0-4cde-9152-f0c4665fe028 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.021734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdde13-6fd0-4cde-9152-f0c4665fe028 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:05.023177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebdde13-6fd0-4cde-9152-f0c4665fe028 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5ebdde13-6fd0-4cde-9152-f0c4665fe028 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:05.039233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:05.040271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:05.041154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:05.041154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:05.041154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:05.041154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 373/730] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:05.041804 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e207a84-b12d-4a91-9b49-89573ac4c605 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.041907 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e207a84-b12d-4a91-9b49-89573ac4c605 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.042124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e207a84-b12d-4a91-9b49-89573ac4c605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.059504 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5e207a84-b12d-4a91-9b49-89573ac4c605 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:05.060719 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5e207a84-b12d-4a91-9b49-89573ac4c605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:05.069018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d873a56d-58b1-469e-beda-ca624bb7a7af None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:05.102848 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d9d236-04fc-481b-ae9b-b0a912086d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:05.103377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d236-04fc-481b-ae9b-b0a912086d51 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.103657 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d236-04fc-481b-ae9b-b0a912086d51 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.103976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d9d236-04fc-481b-ae9b-b0a912086d51 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.104611 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9d236-04fc-481b-ae9b-b0a912086d51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:05.104910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9d236-04fc-481b-ae9b-b0a912086d51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:05.106471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d9d236-04fc-481b-ae9b-b0a912086d51 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:05.117346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 358/731] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:05.118665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab9b7b-5927-40c4-acfa-b9ebefda6bde None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.118953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab9b7b-5927-40c4-acfa-b9ebefda6bde None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.119229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab9b7b-5927-40c4-acfa-b9ebefda6bde None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.120441 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 359/732] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:05.122650 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c3b1-2484-41ee-a02e-840e79f4e52c None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.122939 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c3b1-2484-41ee-a02e-840e79f4e52c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.123207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0c3b1-2484-41ee-a02e-840e79f4e52c None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.124496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 360/733] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:05.125338 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c3b1-2484-41ee-a02e-840e79f4e52c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:05.133637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 374/734] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:51:05.134650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e207a84-b12d-4a91-9b49-89573ac4c605 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:05.149901 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:05.157730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:05.229127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0c3b1-2484-41ee-a02e-840e79f4e52c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:05.245745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e207a84-b12d-4a91-9b49-89573ac4c605 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:05.265312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76adeb0-848e-4d3c-b06d-f7d0a3929849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:05.265919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76adeb0-848e-4d3c-b06d-f7d0a3929849 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.266198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76adeb0-848e-4d3c-b06d-f7d0a3929849 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.266468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76adeb0-848e-4d3c-b06d-f7d0a3929849 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.267106 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76adeb0-848e-4d3c-b06d-f7d0a3929849 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:05.267409 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76adeb0-848e-4d3c-b06d-f7d0a3929849 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:05.268789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76adeb0-848e-4d3c-b06d-f7d0a3929849 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:05.284561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 361/735] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:05.284561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e1a2-09a9-4926-8962-5f8f20594524 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.284561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e1a2-09a9-4926-8962-5f8f20594524 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.284561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f76e1a2-09a9-4926-8962-5f8f20594524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.286387 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06cb445-804f-4b5c-b3fd-18eaac421564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:05.287019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cb445-804f-4b5c-b3fd-18eaac421564 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.287299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cb445-804f-4b5c-b3fd-18eaac421564 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.287571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06cb445-804f-4b5c-b3fd-18eaac421564 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.295837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cb445-804f-4b5c-b3fd-18eaac421564 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:05.297276 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06cb445-804f-4b5c-b3fd-18eaac421564 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:05.299996 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6f76e1a2-09a9-4926-8962-5f8f20594524 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:05.301177 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6f76e1a2-09a9-4926-8962-5f8f20594524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e06cb445-804f-4b5c-b3fd-18eaac421564 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:05.309877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:05.310874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:05.311964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:05.311964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:05.311964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:05.311964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:05.311964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:05.311964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:05.311964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:05.311964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:05.311964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:51:05.311964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:05.311964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 375/736] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 24 07:51:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:05.312583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68a32-4313-4f7d-9834-e0d0968dc2af None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.312583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68a32-4313-4f7d-9834-e0d0968dc2af None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.312716 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a68a32-4313-4f7d-9834-e0d0968dc2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.330715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b3a68a32-4313-4f7d-9834-e0d0968dc2af None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:05.331904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b3a68a32-4313-4f7d-9834-e0d0968dc2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:05.384888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 362/737] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:51:05.385747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76e1a2-09a9-4926-8962-5f8f20594524 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:05.408308 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:05.414723 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 376/738] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 07:51:05.415803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a68a32-4313-4f7d-9834-e0d0968dc2af None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:05.426407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:05.496943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f76e1a2-09a9-4926-8962-5f8f20594524 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:05.522443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a68a32-4313-4f7d-9834-e0d0968dc2af None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:05.531016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581851ad-8417-4ee6-b821-21dcc6ab47dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:05.531647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581851ad-8417-4ee6-b821-21dcc6ab47dd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.531953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581851ad-8417-4ee6-b821-21dcc6ab47dd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.532222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581851ad-8417-4ee6-b821-21dcc6ab47dd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.539335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581851ad-8417-4ee6-b821-21dcc6ab47dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:05.540781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581851ad-8417-4ee6-b821-21dcc6ab47dd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-581851ad-8417-4ee6-b821-21dcc6ab47dd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:05.552751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:05.553892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:05.554842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:05.554842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:05.554842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:05.554842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:05.554842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:05.554842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:05.554842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:05.554842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:05.554842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:51:05.554842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:05.554842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 363/739] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 24 07:51:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:05.555445 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581851ad-8417-4ee6-b821-21dcc6ab47dd None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:05.563314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70a52f-c0ac-4160-ada2-f9990c38dc4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:05.564379 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70a52f-c0ac-4160-ada2-f9990c38dc4c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.564857 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70a52f-c0ac-4160-ada2-f9990c38dc4c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.565334 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf70a52f-c0ac-4160-ada2-f9990c38dc4c None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.566410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70a52f-c0ac-4160-ada2-f9990c38dc4c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:05.566906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70a52f-c0ac-4160-ada2-f9990c38dc4c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:05.568934 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf70a52f-c0ac-4160-ada2-f9990c38dc4c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:05.589310 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 377/740] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 24 07:51:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:05.591017 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70a52f-c0ac-4160-ada2-f9990c38dc4c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:05.636112 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:05.668606 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581851ad-8417-4ee6-b821-21dcc6ab47dd None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:05.668804 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:05.705487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c52c25-277f-443d-a4ec-65ed32b9d877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:05.706098 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c52c25-277f-443d-a4ec-65ed32b9d877 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.706380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c52c25-277f-443d-a4ec-65ed32b9d877 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.706649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c52c25-277f-443d-a4ec-65ed32b9d877 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.707296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c52c25-277f-443d-a4ec-65ed32b9d877 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:05.708778 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c52c25-277f-443d-a4ec-65ed32b9d877 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:05.716288 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf70a52f-c0ac-4160-ada2-f9990c38dc4c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:05.748779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1b55b-e9b8-43cf-a9ba-803d404e0f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:05.749373 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1b55b-e9b8-43cf-a9ba-803d404e0f6c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.749649 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1b55b-e9b8-43cf-a9ba-803d404e0f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.749917 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1b55b-e9b8-43cf-a9ba-803d404e0f6c None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.750623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1b55b-e9b8-43cf-a9ba-803d404e0f6c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:05.750921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1b55b-e9b8-43cf-a9ba-803d404e0f6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:05.752349 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1b55b-e9b8-43cf-a9ba-803d404e0f6c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:05.769343 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 378/741] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Aug 24 07:51:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:05.770120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1b55b-e9b8-43cf-a9ba-803d404e0f6c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:05.786636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 364/742] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 24 07:51:05 2022] POST /identity/v3/services => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:51:05.787459 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c52c25-277f-443d-a4ec-65ed32b9d877 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:05.892458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1b55b-e9b8-43cf-a9ba-803d404e0f6c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:05.905075 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c52c25-277f-443d-a4ec-65ed32b9d877 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:05.913623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:05.934243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:05.934588 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f9028-cdd8-4b5c-a881-0cc323883368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:05.935333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f9028-cdd8-4b5c-a881-0cc323883368 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.935618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f9028-cdd8-4b5c-a881-0cc323883368 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.935918 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708f9028-cdd8-4b5c-a881-0cc323883368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.942926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03430141-b170-47b6-9c02-8a1c361a458b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:05.943569 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430141-b170-47b6-9c02-8a1c361a458b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:05.943869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430141-b170-47b6-9c02-8a1c361a458b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:05.944171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03430141-b170-47b6-9c02-8a1c361a458b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:05.948821 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f9028-cdd8-4b5c-a881-0cc323883368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:05.950909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708f9028-cdd8-4b5c-a881-0cc323883368 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:05.955452 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03430141-b170-47b6-9c02-8a1c361a458b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-03430141-b170-47b6-9c02-8a1c361a458b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:05.960250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:05.961287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:05.962249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:05.962249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:05.962249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:05.962249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:05.962249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:05.962249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:05.962249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:05.962249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:05.962249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:05.962249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:05.962249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:05.962249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:05.962249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 365/743] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:51:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:05.963158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03430141-b170-47b6-9c02-8a1c361a458b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-708f9028-cdd8-4b5c-a881-0cc323883368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:05.971618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:05.972856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:05.973796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:05.973796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:05.973796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:05.973984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 379/744] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:05.974814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f9028-cdd8-4b5c-a881-0cc323883368 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:06.079303 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03430141-b170-47b6-9c02-8a1c361a458b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:06.085741 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708f9028-cdd8-4b5c-a881-0cc323883368 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:06.116553 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8bc2-b614-4b24-8300-7baf8b753cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:06.117177 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8bc2-b614-4b24-8300-7baf8b753cd3 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:06.117432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8bc2-b614-4b24-8300-7baf8b753cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:06.117707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e8bc2-b614-4b24-8300-7baf8b753cd3 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:06.118343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e8bc2-b614-4b24-8300-7baf8b753cd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:06.119686 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e8bc2-b614-4b24-8300-7baf8b753cd3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:06.122742 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d29cfb-9b8b-4c2f-8943-5edcf9e677ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:06.123355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d29cfb-9b8b-4c2f-8943-5edcf9e677ce None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:06.123642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d29cfb-9b8b-4c2f-8943-5edcf9e677ce None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:06.123947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d29cfb-9b8b-4c2f-8943-5edcf9e677ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:06.165100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:06.188371 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 366/745] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 24 07:51:05 2022] POST /identity/v3/services => generated 240 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:51:06.189525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8bc2-b614-4b24-8300-7baf8b753cd3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:06.200514 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d29cfb-9b8b-4c2f-8943-5edcf9e677ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:06.202170 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d29cfb-9b8b-4c2f-8943-5edcf9e677ce None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:06.262079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:06.320219 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 380/746] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:51:05 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 07:51:06.321229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d29cfb-9b8b-4c2f-8943-5edcf9e677ce None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:06.344003 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e8bc2-b614-4b24-8300-7baf8b753cd3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:06.389401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d80e7-7953-48ec-84db-9b765dffc8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:06.390029 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d80e7-7953-48ec-84db-9b765dffc8ae None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:06.390307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d80e7-7953-48ec-84db-9b765dffc8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:06.390570 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75d80e7-7953-48ec-84db-9b765dffc8ae None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:06.391691 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d80e7-7953-48ec-84db-9b765dffc8ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:06.392044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d80e7-7953-48ec-84db-9b765dffc8ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:06.393542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75d80e7-7953-48ec-84db-9b765dffc8ae None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:06.403478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 367/747] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:51:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:06.404296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d80e7-7953-48ec-84db-9b765dffc8ae None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:06.419625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:06.452074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d29cfb-9b8b-4c2f-8943-5edcf9e677ce None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:06.491049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87bc79-5fca-4c3a-bd6c-7687616b2f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:06.492060 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87bc79-5fca-4c3a-bd6c-7687616b2f76 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:06.492570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87bc79-5fca-4c3a-bd6c-7687616b2f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:06.493061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f87bc79-5fca-4c3a-bd6c-7687616b2f76 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:06.493900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87bc79-5fca-4c3a-bd6c-7687616b2f76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:06.494401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87bc79-5fca-4c3a-bd6c-7687616b2f76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:06.496583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f87bc79-5fca-4c3a-bd6c-7687616b2f76 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:06.514239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 381/748] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:06.515525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87bc79-5fca-4c3a-bd6c-7687616b2f76 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:06.534638 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75d80e7-7953-48ec-84db-9b765dffc8ae None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:06.544165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:06.577602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b00c1-76e0-450e-b88c-d2ee25411e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:06.579302 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b00c1-76e0-450e-b88c-d2ee25411e27 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:06.579984 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b00c1-76e0-450e-b88c-d2ee25411e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:06.580462 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470b00c1-76e0-450e-b88c-d2ee25411e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:06.592238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b00c1-76e0-450e-b88c-d2ee25411e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:06.594042 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470b00c1-76e0-450e-b88c-d2ee25411e27 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-470b00c1-76e0-450e-b88c-d2ee25411e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:06.610359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:06.611365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:06.612329 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:06.612329 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:06.612329 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:06.618573 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 368/749] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:06.619633 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b00c1-76e0-450e-b88c-d2ee25411e27 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:06.628564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f87bc79-5fca-4c3a-bd6c-7687616b2f76 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:06.665243 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:06.678526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e120ec3-f5d2-4e4a-b3b5-8b98b1902a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:06.678526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e120ec3-f5d2-4e4a-b3b5-8b98b1902a46 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:06.678526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e120ec3-f5d2-4e4a-b3b5-8b98b1902a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:06.678526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e120ec3-f5d2-4e4a-b3b5-8b98b1902a46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:06.686726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e120ec3-f5d2-4e4a-b3b5-8b98b1902a46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:06.688558 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e120ec3-f5d2-4e4a-b3b5-8b98b1902a46 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-6e120ec3-f5d2-4e4a-b3b5-8b98b1902a46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:06.706353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:06.712378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:06.713906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:06.713906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:06.713906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:06.713906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 382/750] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:06.713906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e120ec3-f5d2-4e4a-b3b5-8b98b1902a46 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:06.761697 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470b00c1-76e0-450e-b88c-d2ee25411e27 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:06.799093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3834f-9b20-438f-95c7-d123a60741aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:06.799833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3834f-9b20-438f-95c7-d123a60741aa None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:06.799833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3834f-9b20-438f-95c7-d123a60741aa None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:06.799833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3834f-9b20-438f-95c7-d123a60741aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:06.807675 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3834f-9b20-438f-95c7-d123a60741aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:06.809787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3834f-9b20-438f-95c7-d123a60741aa None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-2ea3834f-9b20-438f-95c7-d123a60741aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:06.822103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:06.823036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:06.824036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:06.824036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:06.824036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:06.824036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:06.824036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:06.824036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:06.824036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:06.824036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:06.828421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 369/751] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:06.829569 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3834f-9b20-438f-95c7-d123a60741aa None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:06.835467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e120ec3-f5d2-4e4a-b3b5-8b98b1902a46 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:06.851786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:06.872101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429a0fa-8ee9-48ec-9802-866012604887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:06.873053 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429a0fa-8ee9-48ec-9802-866012604887 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:06.873564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429a0fa-8ee9-48ec-9802-866012604887 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:06.874034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3429a0fa-8ee9-48ec-9802-866012604887 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:06.874894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429a0fa-8ee9-48ec-9802-866012604887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:06.875396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429a0fa-8ee9-48ec-9802-866012604887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:06.877056 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3429a0fa-8ee9-48ec-9802-866012604887 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:06.890053 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 383/752] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:06.891270 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429a0fa-8ee9-48ec-9802-866012604887 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:06.938259 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:06.948587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3834f-9b20-438f-95c7-d123a60741aa None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:06.984944 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f8528-db64-4ed8-81c2-c815c42d5a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:06.986299 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f8528-db64-4ed8-81c2-c815c42d5a4a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:06.986992 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f8528-db64-4ed8-81c2-c815c42d5a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:06.987255 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f8528-db64-4ed8-81c2-c815c42d5a4a None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:06.987914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f8528-db64-4ed8-81c2-c815c42d5a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:06.988215 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f8528-db64-4ed8-81c2-c815c42d5a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:06.989618 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f8528-db64-4ed8-81c2-c815c42d5a4a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:06.999637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3429a0fa-8ee9-48ec-9802-866012604887 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:07.006592 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 370/753] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:07.007718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f8528-db64-4ed8-81c2-c815c42d5a4a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:07.035492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40cbfc-dc60-4920-9eb6-b7739c63871b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:07.036461 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40cbfc-dc60-4920-9eb6-b7739c63871b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:07.036964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40cbfc-dc60-4920-9eb6-b7739c63871b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:07.037475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db40cbfc-dc60-4920-9eb6-b7739c63871b None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:07.038409 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40cbfc-dc60-4920-9eb6-b7739c63871b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:07.038911 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40cbfc-dc60-4920-9eb6-b7739c63871b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:07.040575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db40cbfc-dc60-4920-9eb6-b7739c63871b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:07.057589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 384/754] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:07.058986 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40cbfc-dc60-4920-9eb6-b7739c63871b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:07.093177 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:07.116485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f8528-db64-4ed8-81c2-c815c42d5a4a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:07.156706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d760730-6044-495f-95aa-3ee9009665d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:07.157343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d760730-6044-495f-95aa-3ee9009665d1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:07.157921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d760730-6044-495f-95aa-3ee9009665d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:07.158042 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d760730-6044-495f-95aa-3ee9009665d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:07.164059 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db40cbfc-dc60-4920-9eb6-b7739c63871b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:07.165244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d760730-6044-495f-95aa-3ee9009665d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:07.166060 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:07.168100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d760730-6044-495f-95aa-3ee9009665d1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-5d760730-6044-495f-95aa-3ee9009665d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:07.179787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:07.180739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:07.181950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:07.181950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:07.181950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:07.181950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:07.181950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:07.181950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:07.181950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:07.181950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:07.181950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 371/755] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:07.186545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d760730-6044-495f-95aa-3ee9009665d1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:07.205569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4867a-8dff-408e-969b-15d3665f8a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:07.206480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4867a-8dff-408e-969b-15d3665f8a8e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:07.206957 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4867a-8dff-408e-969b-15d3665f8a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:07.207407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e4867a-8dff-408e-969b-15d3665f8a8e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:07.215913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4867a-8dff-408e-969b-15d3665f8a8e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:07.217651 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e4867a-8dff-408e-969b-15d3665f8a8e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-23e4867a-8dff-408e-969b-15d3665f8a8e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:07.235187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:07.236241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:07.237177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:07.237177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:07.237177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:07.237177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:07.237177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:07.237177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:07.237177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:07.237177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:07.237177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:51:07.237177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:07.240142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 385/756] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:51:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:07.241197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4867a-8dff-408e-969b-15d3665f8a8e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:07.303229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d760730-6044-495f-95aa-3ee9009665d1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:07.342240 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aca4e4-5847-456b-8a67-a3184bee85d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:07.342981 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca4e4-5847-456b-8a67-a3184bee85d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:07.343419 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca4e4-5847-456b-8a67-a3184bee85d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:07.343673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aca4e4-5847-456b-8a67-a3184bee85d0 None admin] PATH_INFO: `/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/9b99cff7a5f549adadee002f8ab1f5d9/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:07.346006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aca4e4-5847-456b-8a67-a3184bee85d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1074e261454981a85d02b4b0f75ec5, user_id=9b99cff7a5f549adadee002f8ab1f5d9, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:07.347376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aca4e4-5847-456b-8a67-a3184bee85d0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:07.351725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e4867a-8dff-408e-969b-15d3665f8a8e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:07.388494 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9f09e-7a1a-4d52-b8b2-c7b2e905f6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:07.389944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9f09e-7a1a-4d52-b8b2-c7b2e905f6dd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:07.390232 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9f09e-7a1a-4d52-b8b2-c7b2e905f6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:07.390505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9f09e-7a1a-4d52-b8b2-c7b2e905f6dd None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:07.391194 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9f09e-7a1a-4d52-b8b2-c7b2e905f6dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:07.391504 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9f09e-7a1a-4d52-b8b2-c7b2e905f6dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:07.392948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9f09e-7a1a-4d52-b8b2-c7b2e905f6dd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:07.410391 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 386/757] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:07.410391 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9f09e-7a1a-4d52-b8b2-c7b2e905f6dd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:07.420325 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:07.428373 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 372/758] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:51:07 2022] PUT /identity/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/9b99cff7a5f549adadee002f8ab1f5d9/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:51:07.435973 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aca4e4-5847-456b-8a67-a3184bee85d0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:07.463049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:07.604539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9f09e-7a1a-4d52-b8b2-c7b2e905f6dd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:07.635112 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aca4e4-5847-456b-8a67-a3184bee85d0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:07.647757 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cac1c-6b60-47bb-b60a-a12bcab641d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:07.648724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cac1c-6b60-47bb-b60a-a12bcab641d7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:07.649279 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cac1c-6b60-47bb-b60a-a12bcab641d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:07.649768 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395cac1c-6b60-47bb-b60a-a12bcab641d7 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:07.650697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cac1c-6b60-47bb-b60a-a12bcab641d7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:07.651293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cac1c-6b60-47bb-b60a-a12bcab641d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:07.653671 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395cac1c-6b60-47bb-b60a-a12bcab641d7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:07.674491 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 387/759] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Aug 24 07:51:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:07.680935 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cac1c-6b60-47bb-b60a-a12bcab641d7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:07.683724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef45f0-989b-4be4-8657-df35752ac648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:07.684377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef45f0-989b-4be4-8657-df35752ac648 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:07.684713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef45f0-989b-4be4-8657-df35752ac648 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:07.684988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef45f0-989b-4be4-8657-df35752ac648 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:07.685771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef45f0-989b-4be4-8657-df35752ac648 None admin] RBAC: Adding query filter params (role.id=bd638a70b0d5447ab1d78f20ef54200e, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=2627d6e89afa4774b0897bb0c619cd01) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:07.686085 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef45f0-989b-4be4-8657-df35752ac648 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:07.687572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef45f0-989b-4be4-8657-df35752ac648 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:07.699594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 373/760] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:51:07 2022] GET /identity/v3/role_assignments?user.id=2627d6e89afa4774b0897bb0c619cd01&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=bd638a70b0d5447ab1d78f20ef54200e => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:07.784838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8f6e8-e4d9-4a5e-820b-a7596577d08f None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:07.785498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8f6e8-e4d9-4a5e-820b-a7596577d08f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:07.785498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8f6e8-e4d9-4a5e-820b-a7596577d08f None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:07.787116 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 374/761] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:07.793208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f0e1a-d7c6-4dcd-9c3e-70282a4ca4af None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:07.793732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f0e1a-d7c6-4dcd-9c3e-70282a4ca4af None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:07.794188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f0e1a-d7c6-4dcd-9c3e-70282a4ca4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:07.822636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-185f0e1a-d7c6-4dcd-9c3e-70282a4ca4af None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:07.824460 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-185f0e1a-d7c6-4dcd-9c3e-70282a4ca4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:07.851774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:07.863004 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395cac1c-6b60-47bb-b60a-a12bcab641d7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:07.905821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:07.913661 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 375/762] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:51:07.941226 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79f4c0-8255-4f3e-bf0f-4108634c86b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:07.941978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79f4c0-8255-4f3e-bf0f-4108634c86b9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:07.942348 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79f4c0-8255-4f3e-bf0f-4108634c86b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:07.942631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79f4c0-8255-4f3e-bf0f-4108634c86b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:08.032112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79f4c0-8255-4f3e-bf0f-4108634c86b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:08.033922 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79f4c0-8255-4f3e-bf0f-4108634c86b9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:08.135997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:08.162611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 388/763] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:51:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:51:08.168248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f0e1a-d7c6-4dcd-9c3e-70282a4ca4af None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:08.192861 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79f4c0-8255-4f3e-bf0f-4108634c86b9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:08.327705 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f0e1a-d7c6-4dcd-9c3e-70282a4ca4af None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:08.353693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79f4c0-8255-4f3e-bf0f-4108634c86b9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:08.363580 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fec6de8-bc31-412c-acdd-a8ca21868969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:08.364245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6de8-bc31-412c-acdd-a8ca21868969 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:08.364526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6de8-bc31-412c-acdd-a8ca21868969 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:08.364797 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fec6de8-bc31-412c-acdd-a8ca21868969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:08.381257 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec6de8-bc31-412c-acdd-a8ca21868969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:08.382960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fec6de8-bc31-412c-acdd-a8ca21868969 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:08.402322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45498e4a-194a-48e4-bd94-5f8b95a07b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:08.403431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45498e4a-194a-48e4-bd94-5f8b95a07b26 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:08.403890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45498e4a-194a-48e4-bd94-5f8b95a07b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:08.404320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45498e4a-194a-48e4-bd94-5f8b95a07b26 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-3fec6de8-bc31-412c-acdd-a8ca21868969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:08.404438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:08.405559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:08.406717 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:08.406717 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:08.406717 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:08.407531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45498e4a-194a-48e4-bd94-5f8b95a07b26 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:08.409128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45498e4a-194a-48e4-bd94-5f8b95a07b26 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:08.410156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 376/764] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:08.411402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cbd57-aaaf-4413-8fe3-19d22b49454d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:08.411690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cbd57-aaaf-4413-8fe3-19d22b49454d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:08.412180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cbd57-aaaf-4413-8fe3-19d22b49454d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:08.413667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 377/765] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:08.414718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cbd57-aaaf-4413-8fe3-19d22b49454d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-45498e4a-194a-48e4-bd94-5f8b95a07b26 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:08.426906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:08.428176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:08.429066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:08.429066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:08.429066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:08.429066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:08.429066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:08.429066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:08.429066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:08.429066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:08.429066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:08.429066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:08.429066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:08.429066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:08.429066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:51:08.429066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:08.430723 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 389/766] 10.222.0.62 () {56 vars in 1129 bytes} [Wed Aug 24 07:51:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:08.432550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2db2b8-fe86-4d81-b687-2ab7f115dc8d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:08.433995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2db2b8-fe86-4d81-b687-2ab7f115dc8d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:08.434888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2db2b8-fe86-4d81-b687-2ab7f115dc8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:08.458470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fe2db2b8-fe86-4d81-b687-2ab7f115dc8d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:08.459657 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fe2db2b8-fe86-4d81-b687-2ab7f115dc8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:08.482863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:08.508115 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:08.544411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 390/767] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:08.546140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2db2b8-fe86-4d81-b687-2ab7f115dc8d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:08.552794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cbd57-aaaf-4413-8fe3-19d22b49454d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:08.594430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d94cd-36f5-4a3d-8f06-26fbdaeb2952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:08.595126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d94cd-36f5-4a3d-8f06-26fbdaeb2952 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:08.595477 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d94cd-36f5-4a3d-8f06-26fbdaeb2952 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:08.595826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427d94cd-36f5-4a3d-8f06-26fbdaeb2952 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:08.596580 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d94cd-36f5-4a3d-8f06-26fbdaeb2952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:08.596998 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d94cd-36f5-4a3d-8f06-26fbdaeb2952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:08.598958 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427d94cd-36f5-4a3d-8f06-26fbdaeb2952 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:08.615054 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 378/768] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:08.620018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d94cd-36f5-4a3d-8f06-26fbdaeb2952 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:08.665373 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2db2b8-fe86-4d81-b687-2ab7f115dc8d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:08.703004 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab45e3-6354-40c1-bc83-fd009b4a2801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:08.703682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab45e3-6354-40c1-bc83-fd009b4a2801 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:08.704005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab45e3-6354-40c1-bc83-fd009b4a2801 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:08.704619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efab45e3-6354-40c1-bc83-fd009b4a2801 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:08.705054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab45e3-6354-40c1-bc83-fd009b4a2801 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:08.705470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab45e3-6354-40c1-bc83-fd009b4a2801 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:08.707053 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efab45e3-6354-40c1-bc83-fd009b4a2801 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:08.729627 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427d94cd-36f5-4a3d-8f06-26fbdaeb2952 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:08.733188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:08.766493 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f0df0-8197-49ae-9000-7665f2730a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:08.767132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f0df0-8197-49ae-9000-7665f2730a62 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:08.767413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f0df0-8197-49ae-9000-7665f2730a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:08.767766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f0df0-8197-49ae-9000-7665f2730a62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:08.771482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 391/769] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Aug 24 07:51:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:08.774902 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f0df0-8197-49ae-9000-7665f2730a62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:08.776412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f0df0-8197-49ae-9000-7665f2730a62 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:08.779468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab45e3-6354-40c1-bc83-fd009b4a2801 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-5e6f0df0-8197-49ae-9000-7665f2730a62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:08.791893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:08.793755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:08.794702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:08.794702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:08.794702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:08.794702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:08.794702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:08.794702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:08.794702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:08.794702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:08.794702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 379/770] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:08.796591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f0df0-8197-49ae-9000-7665f2730a62 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:08.858325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:08.913638 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f0df0-8197-49ae-9000-7665f2730a62 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:08.951588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409dcf1-6f9a-492d-a804-7201497184bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:08.952489 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409dcf1-6f9a-492d-a804-7201497184bd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:08.952938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409dcf1-6f9a-492d-a804-7201497184bd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:08.953455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409dcf1-6f9a-492d-a804-7201497184bd None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:08.954404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409dcf1-6f9a-492d-a804-7201497184bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:08.954864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409dcf1-6f9a-492d-a804-7201497184bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:08.956714 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409dcf1-6f9a-492d-a804-7201497184bd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:08.960066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efab45e3-6354-40c1-bc83-fd009b4a2801 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:08.970916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 380/771] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:08.972220 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409dcf1-6f9a-492d-a804-7201497184bd None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:09.004783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0c01-86d9-4077-bd8d-6d335421ef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:09.005393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0c01-86d9-4077-bd8d-6d335421ef31 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:09.005713 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0c01-86d9-4077-bd8d-6d335421ef31 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:09.005993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691c0c01-86d9-4077-bd8d-6d335421ef31 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:09.006620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c0c01-86d9-4077-bd8d-6d335421ef31 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:09.006921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c0c01-86d9-4077-bd8d-6d335421ef31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:09.008310 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691c0c01-86d9-4077-bd8d-6d335421ef31 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:09.012333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:09.014020 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 392/772] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Aug 24 07:51:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:09.014892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0c01-86d9-4077-bd8d-6d335421ef31 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:09.087301 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409dcf1-6f9a-492d-a804-7201497184bd None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:09.124963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691c0c01-86d9-4077-bd8d-6d335421ef31 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:09.126156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f19ad-e5b5-4980-aad2-ee94bbdeaf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:09.126780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f19ad-e5b5-4980-aad2-ee94bbdeaf21 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:09.127061 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f19ad-e5b5-4980-aad2-ee94bbdeaf21 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:09.127277 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:09.127389 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f19ad-e5b5-4980-aad2-ee94bbdeaf21 None admin] PATH_INFO: `/v3/services/network` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:09.128083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f19ad-e5b5-4980-aad2-ee94bbdeaf21 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:09.130220 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f19ad-e5b5-4980-aad2-ee94bbdeaf21 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-853f19ad-e5b5-4980-aad2-ee94bbdeaf21 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:09.140505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:09.147103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:09.148173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 381/773] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:08 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:09.149197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f19ad-e5b5-4980-aad2-ee94bbdeaf21 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:09.170756 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91731a73-22ef-42f3-b8a8-dff37417bbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:09.172065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91731a73-22ef-42f3-b8a8-dff37417bbfd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:09.172599 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91731a73-22ef-42f3-b8a8-dff37417bbfd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:09.173027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91731a73-22ef-42f3-b8a8-dff37417bbfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:09.174385 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91731a73-22ef-42f3-b8a8-dff37417bbfd None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=8255043f01fd46e4a8a5fde8e81c2bed) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:09.174852 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91731a73-22ef-42f3-b8a8-dff37417bbfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:09.176886 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91731a73-22ef-42f3-b8a8-dff37417bbfd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:09.184788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 393/774] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:51:09 2022] GET /identity/v3/role_assignments?user.id=8255043f01fd46e4a8a5fde8e81c2bed&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=68b1888f7bb644a39938b8d41006a813 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:09.185888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91731a73-22ef-42f3-b8a8-dff37417bbfd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:09.311881 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91731a73-22ef-42f3-b8a8-dff37417bbfd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:09.336257 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:09.353477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfd672-9380-4e32-a024-6dbf9a65fc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:09.354101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfd672-9380-4e32-a024-6dbf9a65fc9c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:09.354386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfd672-9380-4e32-a024-6dbf9a65fc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:09.363863 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccfd672-9380-4e32-a024-6dbf9a65fc9c None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:09.363863 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfd672-9380-4e32-a024-6dbf9a65fc9c None admin] RBAC: Adding query filter params (name=network) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:09.363863 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfd672-9380-4e32-a024-6dbf9a65fc9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:09.363863 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccfd672-9380-4e32-a024-6dbf9a65fc9c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:09.364316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 394/775] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 24 07:51:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:09.366879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f19ad-e5b5-4980-aad2-ee94bbdeaf21 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:09.377119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfd672-9380-4e32-a024-6dbf9a65fc9c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:09.413952 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:09.450253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2dcbc-af89-4cfa-b426-b5d35cb5afac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:09.450862 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2dcbc-af89-4cfa-b426-b5d35cb5afac None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:09.451143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2dcbc-af89-4cfa-b426-b5d35cb5afac None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:09.451675 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd2dcbc-af89-4cfa-b426-b5d35cb5afac None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:09.452203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2dcbc-af89-4cfa-b426-b5d35cb5afac None admin] RBAC: Adding query filter params (interface=public, service_id=8997ccbf5ef141f291133c6c537d6be5, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:09.452567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2dcbc-af89-4cfa-b426-b5d35cb5afac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:09.453931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd2dcbc-af89-4cfa-b426-b5d35cb5afac None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:09.463460 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 382/776] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 24 07:51:09 2022] GET /identity/v3/endpoints?service_id=8997ccbf5ef141f291133c6c537d6be5&interface=public®ion_id=RegionOne => generated 194 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:09.469489 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2dcbc-af89-4cfa-b426-b5d35cb5afac None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:09.509834 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccfd672-9380-4e32-a024-6dbf9a65fc9c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:09.588878 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968e72b-0ded-4ca1-9cee-9ed8c0f1561e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:09.590429 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968e72b-0ded-4ca1-9cee-9ed8c0f1561e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:09.590916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968e72b-0ded-4ca1-9cee-9ed8c0f1561e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:09.591388 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968e72b-0ded-4ca1-9cee-9ed8c0f1561e None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:09.593833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968e72b-0ded-4ca1-9cee-9ed8c0f1561e None admin] RBAC: Adding query filter params (type=network) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:09.594351 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968e72b-0ded-4ca1-9cee-9ed8c0f1561e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:09.595956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968e72b-0ded-4ca1-9cee-9ed8c0f1561e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:09.614539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 395/777] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 24 07:51:09 2022] GET /identity/v3/services?type=network => generated 350 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:09.621744 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968e72b-0ded-4ca1-9cee-9ed8c0f1561e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:09.636353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd2dcbc-af89-4cfa-b426-b5d35cb5afac None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:09.674703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd11976-6f51-460a-a778-f74e97ff8ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:09.678486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd11976-6f51-460a-a778-f74e97ff8ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:09.678486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd11976-6f51-460a-a778-f74e97ff8ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:09.678486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd11976-6f51-460a-a778-f74e97ff8ec6 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:09.678486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd11976-6f51-460a-a778-f74e97ff8ec6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:09.678486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd11976-6f51-460a-a778-f74e97ff8ec6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:09.683597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 383/778] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 24 07:51:09 2022] GET /identity/v3/services => generated 772 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:09.815208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:09.827410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968e72b-0ded-4ca1-9cee-9ed8c0f1561e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:09.846131 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9bd30-5b78-4142-9eb7-8517623bf2d3 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:09.846645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9bd30-5b78-4142-9eb7-8517623bf2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:09.846645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9bd30-5b78-4142-9eb7-8517623bf2d3 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:09.852733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 384/779] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:09.853966 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f106c92-1a49-43c4-995a-e0d9e602acc8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:09.854252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f106c92-1a49-43c4-995a-e0d9e602acc8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:09.854521 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f106c92-1a49-43c4-995a-e0d9e602acc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:09.875067 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c693d-c000-4523-8d14-ea6a556e3cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:09.875698 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c693d-c000-4523-8d14-ea6a556e3cec None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:09.876029 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c693d-c000-4523-8d14-ea6a556e3cec None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:09.876309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c693d-c000-4523-8d14-ea6a556e3cec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:09.877123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c693d-c000-4523-8d14-ea6a556e3cec None admin] RBAC: Adding query filter params (interface=public, service_id=387a5a084a41409c9a2942d74af30636, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:09.877438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c693d-c000-4523-8d14-ea6a556e3cec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:09.878376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5f106c92-1a49-43c4-995a-e0d9e602acc8 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:09.879007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67c693d-c000-4523-8d14-ea6a556e3cec None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:09.880032 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5f106c92-1a49-43c4-995a-e0d9e602acc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:09.889272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 396/780] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 24 07:51:09 2022] GET /identity/v3/endpoints?service_id=387a5a084a41409c9a2942d74af30636&interface=public®ion_id=RegionOne => generated 194 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:09.894857 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c693d-c000-4523-8d14-ea6a556e3cec None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:09.895036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:09.967264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 385/781] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:51:10.000237 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa10211-85f3-4848-aced-3fc0adccd5ee None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:10.000667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa10211-85f3-4848-aced-3fc0adccd5ee None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:10.001041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa10211-85f3-4848-aced-3fc0adccd5ee None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:10.002823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 386/782] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:10.008296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2d180-12ee-4cb2-84e5-c4ba5f92097a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:10.008675 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2d180-12ee-4cb2-84e5-c4ba5f92097a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:10.009411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2d180-12ee-4cb2-84e5-c4ba5f92097a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:10.032611 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f5b2d180-12ee-4cb2-84e5-c4ba5f92097a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:10.033806 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f5b2d180-12ee-4cb2-84e5-c4ba5f92097a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:10.034084 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c693d-c000-4523-8d14-ea6a556e3cec None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:10.113537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8f301-0165-4e7c-8995-286fad5f3e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:10.113734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 387/783] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:10.114122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8f301-0165-4e7c-8995-286fad5f3e7f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:10.114406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8f301-0165-4e7c-8995-286fad5f3e7f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:10.114781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8f301-0165-4e7c-8995-286fad5f3e7f None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:10.115394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8f301-0165-4e7c-8995-286fad5f3e7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:10.116786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8f301-0165-4e7c-8995-286fad5f3e7f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:10.128133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 397/784] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 24 07:51:09 2022] GET /identity/v3/services => generated 772 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:10.318226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2d180-12ee-4cb2-84e5-c4ba5f92097a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:10.424206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:10.448388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2d180-12ee-4cb2-84e5-c4ba5f92097a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:10.483484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d37c4-1576-428d-ab94-0e8be475c661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:10.484148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d37c4-1576-428d-ab94-0e8be475c661 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:10.484432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d37c4-1576-428d-ab94-0e8be475c661 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:10.484705 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d37c4-1576-428d-ab94-0e8be475c661 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:10.495353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d37c4-1576-428d-ab94-0e8be475c661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-621d37c4-1576-428d-ab94-0e8be475c661 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:10.500801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:10.501768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:10.502613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:10.502613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:10.502613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:10.502613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:10.502613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:10.502613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:10.502613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:10.502613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:10.502613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:10.502613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:10.502613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:10.502613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:10.502613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 388/785] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:51:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:10.508070 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8f301-0165-4e7c-8995-286fad5f3e7f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:10.510474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d37c4-1576-428d-ab94-0e8be475c661 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:10.540292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:10.624331 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8f301-0165-4e7c-8995-286fad5f3e7f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:10.644142 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d37c4-1576-428d-ab94-0e8be475c661 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:10.673284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68203a3-b533-45f8-87fb-69ef00d0e561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:10.673921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68203a3-b533-45f8-87fb-69ef00d0e561 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:10.674204 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68203a3-b533-45f8-87fb-69ef00d0e561 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:10.674480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68203a3-b533-45f8-87fb-69ef00d0e561 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:10.695119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68203a3-b533-45f8-87fb-69ef00d0e561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c68203a3-b533-45f8-87fb-69ef00d0e561 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:10.704037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:10.705200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:10.706077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:10.706077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:10.706077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:10.706077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:10.706077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:10.706077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:10.706077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:10.706077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:10.706077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:10.706077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:10.706077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:51:10.706077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:10.706077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 398/786] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:51:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:10.709495 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659edba-4ca5-4e70-89f6-d1cbb4b5f3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:10.710117 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659edba-4ca5-4e70-89f6-d1cbb4b5f3cb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:10.710402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659edba-4ca5-4e70-89f6-d1cbb4b5f3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:10.710673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659edba-4ca5-4e70-89f6-d1cbb4b5f3cb None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:10.711349 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659edba-4ca5-4e70-89f6-d1cbb4b5f3cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:10.711656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659edba-4ca5-4e70-89f6-d1cbb4b5f3cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:10.714151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68203a3-b533-45f8-87fb-69ef00d0e561 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:10.715041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659edba-4ca5-4e70-89f6-d1cbb4b5f3cb None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:10.721271 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:10.733863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 389/787] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:51:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:10.739435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659edba-4ca5-4e70-89f6-d1cbb4b5f3cb None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:10.854919 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:10.905937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68203a3-b533-45f8-87fb-69ef00d0e561 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:10.913482 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659edba-4ca5-4e70-89f6-d1cbb4b5f3cb None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:10.953269 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c686d26-808f-4b66-843c-e4af72713d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:10.953917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c686d26-808f-4b66-843c-e4af72713d25 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:10.954201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c686d26-808f-4b66-843c-e4af72713d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:10.954470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c686d26-808f-4b66-843c-e4af72713d25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:10.965783 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c686d26-808f-4b66-843c-e4af72713d25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:10.967216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c686d26-808f-4b66-843c-e4af72713d25 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:10.978328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b0531-def9-470c-b976-3f51f5b3b189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:10.979286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b0531-def9-470c-b976-3f51f5b3b189 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:10.979779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b0531-def9-470c-b976-3f51f5b3b189 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:10.980849 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433b0531-def9-470c-b976-3f51f5b3b189 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:10.981968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b0531-def9-470c-b976-3f51f5b3b189 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:10.982468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b0531-def9-470c-b976-3f51f5b3b189 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-0c686d26-808f-4b66-843c-e4af72713d25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:10.983388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:10.984334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:10.985235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:10.985235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:10.985235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:10.985235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 390/788] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:10.986533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433b0531-def9-470c-b976-3f51f5b3b189 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:10.992833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c686d26-808f-4b66-843c-e4af72713d25 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:10.997046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 399/789] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:51:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:11.005077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b0531-def9-470c-b976-3f51f5b3b189 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:11.066873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:11.149391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c686d26-808f-4b66-843c-e4af72713d25 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:11.217063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90363adf-0e64-4f7a-bc3a-afca313aa073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:11.220621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433b0531-def9-470c-b976-3f51f5b3b189 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:11.222020 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90363adf-0e64-4f7a-bc3a-afca313aa073 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:11.222318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90363adf-0e64-4f7a-bc3a-afca313aa073 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:11.222586 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90363adf-0e64-4f7a-bc3a-afca313aa073 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:11.223237 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90363adf-0e64-4f7a-bc3a-afca313aa073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:11.223536 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90363adf-0e64-4f7a-bc3a-afca313aa073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:11.224928 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90363adf-0e64-4f7a-bc3a-afca313aa073 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:11.246347 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 391/790] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:11.252292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90363adf-0e64-4f7a-bc3a-afca313aa073 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:11.268948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1429d35-18fa-4b63-af67-a84de53cfc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:11.269585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429d35-18fa-4b63-af67-a84de53cfc53 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:11.269862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429d35-18fa-4b63-af67-a84de53cfc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:11.270133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1429d35-18fa-4b63-af67-a84de53cfc53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:11.293281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1429d35-18fa-4b63-af67-a84de53cfc53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:11.294727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1429d35-18fa-4b63-af67-a84de53cfc53 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:11.302351 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-a1429d35-18fa-4b63-af67-a84de53cfc53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:11.322309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:11.323304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:11.325316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:11.325316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:11.325316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:11.327775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 400/791] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:11.330441 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1429d35-18fa-4b63-af67-a84de53cfc53 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:11.374855 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90363adf-0e64-4f7a-bc3a-afca313aa073 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:11.391989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:11.431796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d1488-1f12-4240-a20c-b5d32132dbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:11.432464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1488-1f12-4240-a20c-b5d32132dbba None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:11.432748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1488-1f12-4240-a20c-b5d32132dbba None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:11.433023 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d1488-1f12-4240-a20c-b5d32132dbba None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:11.446614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d1488-1f12-4240-a20c-b5d32132dbba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:11.448078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d1488-1f12-4240-a20c-b5d32132dbba None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-6d2d1488-1f12-4240-a20c-b5d32132dbba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:11.474923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:11.476126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:11.477108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:11.477108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:11.477108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:11.477108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:11.477108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:11.477108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:11.477108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:11.477108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:11.477108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:51:11.477108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:11.477108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 392/792] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 24 07:51:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:11.477108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee22aa3-ee8a-4cd1-9749-cbca50ca18cc None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:11.477108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee22aa3-ee8a-4cd1-9749-cbca50ca18cc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:11.477842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee22aa3-ee8a-4cd1-9749-cbca50ca18cc None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:11.481696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 393/793] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:11.488531 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee22aa3-ee8a-4cd1-9749-cbca50ca18cc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:11.526803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1429d35-18fa-4b63-af67-a84de53cfc53 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:11.563956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb0c6e-54c7-4cbb-8c4f-f87cb4a1da01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:11.564931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb0c6e-54c7-4cbb-8c4f-f87cb4a1da01 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:11.565441 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb0c6e-54c7-4cbb-8c4f-f87cb4a1da01 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:11.565920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb0c6e-54c7-4cbb-8c4f-f87cb4a1da01 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:11.566768 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb0c6e-54c7-4cbb-8c4f-f87cb4a1da01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:11.567286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb0c6e-54c7-4cbb-8c4f-f87cb4a1da01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:11.568893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cb0c6e-54c7-4cbb-8c4f-f87cb4a1da01 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:11.586537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 401/794] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:11.588472 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab080066-bddc-49b1-9289-e099a3826d94 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:11.588971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab080066-bddc-49b1-9289-e099a3826d94 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:11.589523 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab080066-bddc-49b1-9289-e099a3826d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:11.608855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ab080066-bddc-49b1-9289-e099a3826d94 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:11.610416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ab080066-bddc-49b1-9289-e099a3826d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:11.614494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee22aa3-ee8a-4cd1-9749-cbca50ca18cc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:11.654246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070cd71-163c-48a7-be52-afb395fac987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:11.654910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070cd71-163c-48a7-be52-afb395fac987 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:11.655191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070cd71-163c-48a7-be52-afb395fac987 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:11.655470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070cd71-163c-48a7-be52-afb395fac987 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:11.656283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070cd71-163c-48a7-be52-afb395fac987 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:11.656588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070cd71-163c-48a7-be52-afb395fac987 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:11.658220 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070cd71-163c-48a7-be52-afb395fac987 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:11.668586 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:11.680129 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 394/795] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 24 07:51:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:11.684567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070cd71-163c-48a7-be52-afb395fac987 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:11.691279 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 402/796] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:11.699902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab080066-bddc-49b1-9289-e099a3826d94 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:11.729242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:11.803893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab080066-bddc-49b1-9289-e099a3826d94 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:11.835758 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c06f87-0a83-4e25-ae5a-799294bd008e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:11.836538 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c06f87-0a83-4e25-ae5a-799294bd008e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:11.836890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c06f87-0a83-4e25-ae5a-799294bd008e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:11.837238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c06f87-0a83-4e25-ae5a-799294bd008e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:11.860201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070cd71-163c-48a7-be52-afb395fac987 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:11.896392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:11.910891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456a128c-6b24-4d21-b727-0033e5b6ab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:11.911529 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a128c-6b24-4d21-b727-0033e5b6ab39 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:11.911809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a128c-6b24-4d21-b727-0033e5b6ab39 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:11.912132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456a128c-6b24-4d21-b727-0033e5b6ab39 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:11.912579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c06f87-0a83-4e25-ae5a-799294bd008e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:11.914244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c06f87-0a83-4e25-ae5a-799294bd008e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:11.919818 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a128c-6b24-4d21-b727-0033e5b6ab39 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:11.921267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456a128c-6b24-4d21-b727-0033e5b6ab39 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-456a128c-6b24-4d21-b727-0033e5b6ab39 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:11.933800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:11.940535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:11.941535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:11.941535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:11.941535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:11.941535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:11.941535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:11.941535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:11.941535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:11.941535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:11.941535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:51:11.941535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:11.941535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 395/797] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 24 07:51:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:11.953935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb945c-c83e-4d21-a2ae-b262014dbc69 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:11.954253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb945c-c83e-4d21-a2ae-b262014dbc69 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:11.954527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb945c-c83e-4d21-a2ae-b262014dbc69 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:11.956619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 396/798] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:11.957332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb945c-c83e-4d21-a2ae-b262014dbc69 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:12.057635 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 403/799] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:51:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:51:12.057635 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ec009-57be-4eff-aa72-e195471a380b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:12.057635 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ec009-57be-4eff-aa72-e195471a380b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:12.057984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80ec009-57be-4eff-aa72-e195471a380b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:12.077232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:12.088468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d80ec009-57be-4eff-aa72-e195471a380b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:12.090143 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d80ec009-57be-4eff-aa72-e195471a380b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:12.092679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb945c-c83e-4d21-a2ae-b262014dbc69 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:12.135815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f640f-6165-454b-9680-edfbf08233dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:12.137401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f640f-6165-454b-9680-edfbf08233dd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:12.137900 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f640f-6165-454b-9680-edfbf08233dd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:12.138246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616f640f-6165-454b-9680-edfbf08233dd None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:12.139055 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f640f-6165-454b-9680-edfbf08233dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:12.139369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f640f-6165-454b-9680-edfbf08233dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:12.140824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616f640f-6165-454b-9680-edfbf08233dd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:12.163646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 397/800] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Aug 24 07:51:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:12.163646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f640f-6165-454b-9680-edfbf08233dd None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:12.171814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 404/801] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:12.175880 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ec009-57be-4eff-aa72-e195471a380b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:12.192092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:12.276446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80ec009-57be-4eff-aa72-e195471a380b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:12.281145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616f640f-6165-454b-9680-edfbf08233dd None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:12.312468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be86bd-45b8-4ff4-b065-2bf38fc65885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:12.313031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be86bd-45b8-4ff4-b065-2bf38fc65885 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:12.313526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be86bd-45b8-4ff4-b065-2bf38fc65885 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:12.313747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be86bd-45b8-4ff4-b065-2bf38fc65885 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:12.322253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc0d9b-172f-4fc8-9bad-559b49f95c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:12.323161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc0d9b-172f-4fc8-9bad-559b49f95c03 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:12.323591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc0d9b-172f-4fc8-9bad-559b49f95c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:12.324339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be86bd-45b8-4ff4-b065-2bf38fc65885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:12.324578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccc0d9b-172f-4fc8-9bad-559b49f95c03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-57be86bd-45b8-4ff4-b065-2bf38fc65885 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:12.329236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:12.330412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:12.331571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:12.331571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:12.331571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:12.331571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:12.331571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:12.331571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:12.331571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:12.331571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:12.331571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:12.331571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:12.331571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:12.331571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:12.335218 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 405/802] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:51:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:12.336078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be86bd-45b8-4ff4-b065-2bf38fc65885 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:12.341013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc0d9b-172f-4fc8-9bad-559b49f95c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:12.342708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccc0d9b-172f-4fc8-9bad-559b49f95c03 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:12.350629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-fccc0d9b-172f-4fc8-9bad-559b49f95c03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:12.361065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:12.366210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:12.367335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:12.367335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:12.367335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:12.367335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 398/803] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:12.367335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc0d9b-172f-4fc8-9bad-559b49f95c03 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:12.424223 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:12.444436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be86bd-45b8-4ff4-b065-2bf38fc65885 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:12.481885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6ce27-e412-4bff-bc54-ebc9387a5a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:12.482518 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ce27-e412-4bff-bc54-ebc9387a5a21 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:12.482800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ce27-e412-4bff-bc54-ebc9387a5a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:12.483077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6ce27-e412-4bff-bc54-ebc9387a5a21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:12.483305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccc0d9b-172f-4fc8-9bad-559b49f95c03 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:12.494616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6ce27-e412-4bff-bc54-ebc9387a5a21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:12.497054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec6ce27-e412-4bff-bc54-ebc9387a5a21 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-3ec6ce27-e412-4bff-bc54-ebc9387a5a21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:12.514146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:12.515125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:12.516064 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:12.516064 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:12.516064 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:12.516064 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 406/804] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:12.516064 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6ce27-e412-4bff-bc54-ebc9387a5a21 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:12.523269 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0479759-595e-4f83-84c4-3010668f8c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:12.523887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479759-595e-4f83-84c4-3010668f8c9d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:12.524172 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479759-595e-4f83-84c4-3010668f8c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:12.524443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0479759-595e-4f83-84c4-3010668f8c9d None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:12.525105 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0479759-595e-4f83-84c4-3010668f8c9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:12.525403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0479759-595e-4f83-84c4-3010668f8c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:12.526825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0479759-595e-4f83-84c4-3010668f8c9d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:12.535556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 399/805] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:51:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:12.536400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0479759-595e-4f83-84c4-3010668f8c9d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:12.599302 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:12.623686 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec6ce27-e412-4bff-bc54-ebc9387a5a21 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:12.640167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0479759-595e-4f83-84c4-3010668f8c9d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:12.648475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:12.656781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f04060-1d01-40ef-8074-5c7b3db44d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:12.657382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f04060-1d01-40ef-8074-5c7b3db44d93 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:12.657658 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f04060-1d01-40ef-8074-5c7b3db44d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:12.657930 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f04060-1d01-40ef-8074-5c7b3db44d93 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:12.658562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f04060-1d01-40ef-8074-5c7b3db44d93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:12.658861 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f04060-1d01-40ef-8074-5c7b3db44d93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:12.660326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f04060-1d01-40ef-8074-5c7b3db44d93 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:12.677503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 407/806] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:12.677674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649deb7-4d39-4a5a-8fd5-8c719c870f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:12.677780 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f04060-1d01-40ef-8074-5c7b3db44d93 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:12.677857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649deb7-4d39-4a5a-8fd5-8c719c870f9a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:12.677857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649deb7-4d39-4a5a-8fd5-8c719c870f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:12.677857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649deb7-4d39-4a5a-8fd5-8c719c870f9a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:12.677857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649deb7-4d39-4a5a-8fd5-8c719c870f9a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:12.677857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649deb7-4d39-4a5a-8fd5-8c719c870f9a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e649deb7-4d39-4a5a-8fd5-8c719c870f9a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:12.686776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:12.693877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:12.694934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 400/807] 10.222.0.62 () {56 vars in 1129 bytes} [Wed Aug 24 07:51:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:12.695956 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649deb7-4d39-4a5a-8fd5-8c719c870f9a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:12.776266 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f04060-1d01-40ef-8074-5c7b3db44d93 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:12.795628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649deb7-4d39-4a5a-8fd5-8c719c870f9a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:12.811136 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b248f3de-0235-4604-aef0-8b54557826f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:12.811734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248f3de-0235-4604-aef0-8b54557826f5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:12.812034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248f3de-0235-4604-aef0-8b54557826f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:12.812304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b248f3de-0235-4604-aef0-8b54557826f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:12.812933 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248f3de-0235-4604-aef0-8b54557826f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:12.813232 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248f3de-0235-4604-aef0-8b54557826f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:12.814567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b248f3de-0235-4604-aef0-8b54557826f5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:12.818388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:12.825542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 408/808] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:12.826749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d2715-d8a4-4c18-a40d-96b07a7f5a52 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:12.826992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d2715-d8a4-4c18-a40d-96b07a7f5a52 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:12.827257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9d2715-d8a4-4c18-a40d-96b07a7f5a52 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:12.829175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602053e-18a0-48ae-b44a-d750b70d6df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:12.829809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602053e-18a0-48ae-b44a-d750b70d6df3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:12.830239 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602053e-18a0-48ae-b44a-d750b70d6df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:12.830341 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9602053e-18a0-48ae-b44a-d750b70d6df3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:12.832591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 409/809] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:12.833344 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d2715-d8a4-4c18-a40d-96b07a7f5a52 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:12.842106 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602053e-18a0-48ae-b44a-d750b70d6df3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:12.843557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9602053e-18a0-48ae-b44a-d750b70d6df3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-9602053e-18a0-48ae-b44a-d750b70d6df3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:12.858750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:12.864849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:12.865803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:12.865803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:12.865803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:12.865803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 401/810] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:12.865803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602053e-18a0-48ae-b44a-d750b70d6df3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:12.882804 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:12.934563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9d2715-d8a4-4c18-a40d-96b07a7f5a52 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:12.961524 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9602053e-18a0-48ae-b44a-d750b70d6df3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:12.969315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797037d-2ea4-4be5-b979-5a82efdfef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:12.969945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797037d-2ea4-4be5-b979-5a82efdfef72 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:12.970222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797037d-2ea4-4be5-b979-5a82efdfef72 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:12.970492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3797037d-2ea4-4be5-b979-5a82efdfef72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:12.976938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797037d-2ea4-4be5-b979-5a82efdfef72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:12.978345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3797037d-2ea4-4be5-b979-5a82efdfef72 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-3797037d-2ea4-4be5-b979-5a82efdfef72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:12.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:12.990589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:12.991497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:12.991497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:12.991497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:12.991497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:12.991497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:12.991497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:12.991497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:12.991497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:12.991497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 410/811] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:12.992015 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797037d-2ea4-4be5-b979-5a82efdfef72 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:12.999821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d901e3-44c3-4d73-a9c9-efe8f6cd3d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:13.000452 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d901e3-44c3-4d73-a9c9-efe8f6cd3d2f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:13.000733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d901e3-44c3-4d73-a9c9-efe8f6cd3d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:13.001003 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d901e3-44c3-4d73-a9c9-efe8f6cd3d2f None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:13.001625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d901e3-44c3-4d73-a9c9-efe8f6cd3d2f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:13.001926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d901e3-44c3-4d73-a9c9-efe8f6cd3d2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:13.003270 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d901e3-44c3-4d73-a9c9-efe8f6cd3d2f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:13.008153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 402/812] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Aug 24 07:51:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:13.009437 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c319-a8de-445e-b3f0-e58f267219b5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:13.009722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c319-a8de-445e-b3f0-e58f267219b5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:13.009998 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c9c319-a8de-445e-b3f0-e58f267219b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:13.028342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-87c9c319-a8de-445e-b3f0-e58f267219b5 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:13.029530 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-87c9c319-a8de-445e-b3f0-e58f267219b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:13.063009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:13.095914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 403/813] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:13.096397 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3797037d-2ea4-4be5-b979-5a82efdfef72 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:13.096734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9c319-a8de-445e-b3f0-e58f267219b5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:13.112452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:13.137960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a970cbf-d191-4d59-9212-9a195d321bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:13.138605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a970cbf-d191-4d59-9212-9a195d321bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:13.138872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a970cbf-d191-4d59-9212-9a195d321bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:13.139147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a970cbf-d191-4d59-9212-9a195d321bb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:13.148155 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a970cbf-d191-4d59-9212-9a195d321bb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:13.150049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a970cbf-d191-4d59-9212-9a195d321bb5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5a970cbf-d191-4d59-9212-9a195d321bb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:13.164520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:13.165406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:13.166334 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:13.166334 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:13.166334 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:13.166334 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:13.166334 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:13.166334 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:13.166334 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:13.166334 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:13.166792 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 411/814] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:13.167933 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a970cbf-d191-4d59-9212-9a195d321bb5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:13.206328 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c9c319-a8de-445e-b3f0-e58f267219b5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:13.242584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b550bf-7296-457e-9fb5-4943fa42805b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:13.243188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b550bf-7296-457e-9fb5-4943fa42805b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:13.243466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b550bf-7296-457e-9fb5-4943fa42805b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:13.243739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b550bf-7296-457e-9fb5-4943fa42805b None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:13.244726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b550bf-7296-457e-9fb5-4943fa42805b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:13.245031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b550bf-7296-457e-9fb5-4943fa42805b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:13.246721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b550bf-7296-457e-9fb5-4943fa42805b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:13.263061 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 404/815] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:13.263061 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b550bf-7296-457e-9fb5-4943fa42805b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:13.280556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a970cbf-d191-4d59-9212-9a195d321bb5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:13.292595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:13.317982 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c27f9-e75d-45e4-9ac4-094fbdb3ce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:13.318584 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c27f9-e75d-45e4-9ac4-094fbdb3ce2a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:13.318862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c27f9-e75d-45e4-9ac4-094fbdb3ce2a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:13.319134 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c27f9-e75d-45e4-9ac4-094fbdb3ce2a None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:13.319821 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c27f9-e75d-45e4-9ac4-094fbdb3ce2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:13.320158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c27f9-e75d-45e4-9ac4-094fbdb3ce2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:13.321568 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c27f9-e75d-45e4-9ac4-094fbdb3ce2a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:13.339981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 412/816] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:13.339981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c27f9-e75d-45e4-9ac4-094fbdb3ce2a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:13.367331 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:13.372442 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b550bf-7296-457e-9fb5-4943fa42805b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:13.408886 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516341b-b3dc-4cf8-bcae-b0a3e780a2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:13.409490 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516341b-b3dc-4cf8-bcae-b0a3e780a2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:13.409775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516341b-b3dc-4cf8-bcae-b0a3e780a2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:13.410041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7516341b-b3dc-4cf8-bcae-b0a3e780a2d2 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:13.410661 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516341b-b3dc-4cf8-bcae-b0a3e780a2d2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:13.410961 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516341b-b3dc-4cf8-bcae-b0a3e780a2d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:13.412343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7516341b-b3dc-4cf8-bcae-b0a3e780a2d2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:13.417051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 405/817] 10.222.0.62 () {56 vars in 1124 bytes} [Wed Aug 24 07:51:13 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:13.417856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516341b-b3dc-4cf8-bcae-b0a3e780a2d2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:13.440138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c27f9-e75d-45e4-9ac4-094fbdb3ce2a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:13.474773 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088980e-f90d-4d85-ba3e-456981836764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:13.475374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088980e-f90d-4d85-ba3e-456981836764 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:13.475647 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088980e-f90d-4d85-ba3e-456981836764 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:13.475951 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088980e-f90d-4d85-ba3e-456981836764 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:13.476626 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088980e-f90d-4d85-ba3e-456981836764 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:13.476920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088980e-f90d-4d85-ba3e-456981836764 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:13.478312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088980e-f90d-4d85-ba3e-456981836764 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:13.489593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 413/818] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:13.490373 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088980e-f90d-4d85-ba3e-456981836764 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:13.512224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:13.518814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7516341b-b3dc-4cf8-bcae-b0a3e780a2d2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:13.552667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5159b-f938-4e5e-8226-2903d18cbdde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:13.553312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5159b-f938-4e5e-8226-2903d18cbdde None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:13.553594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5159b-f938-4e5e-8226-2903d18cbdde None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:13.553864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5159b-f938-4e5e-8226-2903d18cbdde None admin] PATH_INFO: `/v3/users/swift` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:13.561577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5159b-f938-4e5e-8226-2903d18cbdde None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:13.562993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f5159b-f938-4e5e-8226-2903d18cbdde None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f6f5159b-f938-4e5e-8226-2903d18cbdde None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:13.574896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:13.576097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:13.577076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:13.577076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:13.577076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:13.577076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:13.577076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:13.577076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:13.577076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:13.577076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:13.577076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:51:13.577076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:13.577076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 406/819] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:51:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:13.577076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5159b-f938-4e5e-8226-2903d18cbdde None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:13.578761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:13.591161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088980e-f90d-4d85-ba3e-456981836764 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:13.625067 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636c16e-6d80-4db5-8124-c7394b518467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:13.625592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636c16e-6d80-4db5-8124-c7394b518467 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:13.625869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636c16e-6d80-4db5-8124-c7394b518467 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:13.626137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8636c16e-6d80-4db5-8124-c7394b518467 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:13.626847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636c16e-6d80-4db5-8124-c7394b518467 None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=9b99cff7a5f549adadee002f8ab1f5d9) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:13.627150 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636c16e-6d80-4db5-8124-c7394b518467 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:13.628582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8636c16e-6d80-4db5-8124-c7394b518467 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:13.634089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 414/820] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:51:13 2022] GET /identity/v3/role_assignments?user.id=9b99cff7a5f549adadee002f8ab1f5d9&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=68b1888f7bb644a39938b8d41006a813 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:13.634837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636c16e-6d80-4db5-8124-c7394b518467 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:13.696577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5159b-f938-4e5e-8226-2903d18cbdde None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:13.736425 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d07687-e4ef-4caf-9b97-296d8ba623e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:13.737067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d07687-e4ef-4caf-9b97-296d8ba623e3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:13.737345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d07687-e4ef-4caf-9b97-296d8ba623e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:13.737613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d07687-e4ef-4caf-9b97-296d8ba623e3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:13.738204 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d07687-e4ef-4caf-9b97-296d8ba623e3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:13.739587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d07687-e4ef-4caf-9b97-296d8ba623e3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-75d07687-e4ef-4caf-9b97-296d8ba623e3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:13.750027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:13.751300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:13.752331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 407/821] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:13 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:13.753311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d07687-e4ef-4caf-9b97-296d8ba623e3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:13.772350 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:13.773909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8636c16e-6d80-4db5-8124-c7394b518467 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:13.819250 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43f9b1-e571-486c-b7b5-019e6f4d0fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:13.819897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f9b1-e571-486c-b7b5-019e6f4d0fca None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:13.820162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f9b1-e571-486c-b7b5-019e6f4d0fca None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:13.820434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f9b1-e571-486c-b7b5-019e6f4d0fca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:13.821090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43f9b1-e571-486c-b7b5-019e6f4d0fca None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:13.822423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43f9b1-e571-486c-b7b5-019e6f4d0fca None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:13.862682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d07687-e4ef-4caf-9b97-296d8ba623e3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:13.896670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe02146-7d00-4679-8c1e-c2d6ec6ffa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:13.897261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe02146-7d00-4679-8c1e-c2d6ec6ffa00 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:13.897539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe02146-7d00-4679-8c1e-c2d6ec6ffa00 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:13.897809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe02146-7d00-4679-8c1e-c2d6ec6ffa00 None admin] PATH_INFO: `/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/2627d6e89afa4774b0897bb0c619cd01/roles/bd638a70b0d5447ab1d78f20ef54200e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:13.915878 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 415/822] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 07:51:13 2022] POST /identity/v3/endpoints => generated 346 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:51:13.915878 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43f9b1-e571-486c-b7b5-019e6f4d0fca None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:13.923408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe02146-7d00-4679-8c1e-c2d6ec6ffa00 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1074e261454981a85d02b4b0f75ec5, user_id=2627d6e89afa4774b0897bb0c619cd01, role_id=bd638a70b0d5447ab1d78f20ef54200e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:13.924926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe02146-7d00-4679-8c1e-c2d6ec6ffa00 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:13.928425 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:13.972698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 408/823] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:51:13 2022] PUT /identity/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/2627d6e89afa4774b0897bb0c619cd01/roles/bd638a70b0d5447ab1d78f20ef54200e => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:51:13.973735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe02146-7d00-4679-8c1e-c2d6ec6ffa00 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:14.072013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:14.122443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43f9b1-e571-486c-b7b5-019e6f4d0fca None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:14.144057 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe02146-7d00-4679-8c1e-c2d6ec6ffa00 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:14.163345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beb9db-63cf-4b96-a1d0-bab6c227883b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:14.164387 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beb9db-63cf-4b96-a1d0-bab6c227883b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:14.164722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beb9db-63cf-4b96-a1d0-bab6c227883b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:14.165008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beb9db-63cf-4b96-a1d0-bab6c227883b None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:14.165759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beb9db-63cf-4b96-a1d0-bab6c227883b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:14.166071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beb9db-63cf-4b96-a1d0-bab6c227883b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:14.168791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beb9db-63cf-4b96-a1d0-bab6c227883b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:14.185762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a104-6c6f-4b19-99de-11409610b030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:14.186386 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a104-6c6f-4b19-99de-11409610b030 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:14.186661 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a104-6c6f-4b19-99de-11409610b030 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:14.186930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32a104-6c6f-4b19-99de-11409610b030 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:14.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32a104-6c6f-4b19-99de-11409610b030 None admin] RBAC: Adding query filter params (name=network) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:14.187875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32a104-6c6f-4b19-99de-11409610b030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:14.189409 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32a104-6c6f-4b19-99de-11409610b030 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:14.193036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 416/824] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Aug 24 07:51:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:14.194503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 409/825] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 24 07:51:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:14.198639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beb9db-63cf-4b96-a1d0-bab6c227883b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:14.200607 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a104-6c6f-4b19-99de-11409610b030 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:14.272145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:14.328329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beb9db-63cf-4b96-a1d0-bab6c227883b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:14.342183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32a104-6c6f-4b19-99de-11409610b030 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:14.369684 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9fda9-0b8e-4686-8373-a757079e270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:14.370996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9fda9-0b8e-4686-8373-a757079e270f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:14.371461 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9fda9-0b8e-4686-8373-a757079e270f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:14.371809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9fda9-0b8e-4686-8373-a757079e270f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:14.387871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9fda9-0b8e-4686-8373-a757079e270f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:14.387871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9fda9-0b8e-4686-8373-a757079e270f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-55e9fda9-0b8e-4686-8373-a757079e270f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:14.402408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:14.403583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:14.404759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:14.404759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:14.404759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:14.407746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 417/826] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:14.410338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9fda9-0b8e-4686-8373-a757079e270f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:14.437304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:14.452566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502d270-7676-4c37-88d4-b3f1f647f2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:14.453181 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502d270-7676-4c37-88d4-b3f1f647f2f6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:14.453456 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502d270-7676-4c37-88d4-b3f1f647f2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:14.453831 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9502d270-7676-4c37-88d4-b3f1f647f2f6 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:14.454411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502d270-7676-4c37-88d4-b3f1f647f2f6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:14.460266 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502d270-7676-4c37-88d4-b3f1f647f2f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:14.461649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9502d270-7676-4c37-88d4-b3f1f647f2f6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:14.475177 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 410/827] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 24 07:51:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:14.485324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502d270-7676-4c37-88d4-b3f1f647f2f6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:14.531032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9fda9-0b8e-4686-8373-a757079e270f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:14.547964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:14.571753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f198f-0764-4bca-80bb-1e1d9ad16049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:14.572631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f198f-0764-4bca-80bb-1e1d9ad16049 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:14.573110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f198f-0764-4bca-80bb-1e1d9ad16049 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:14.573565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f198f-0764-4bca-80bb-1e1d9ad16049 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:14.574445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f198f-0764-4bca-80bb-1e1d9ad16049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:14.574896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f198f-0764-4bca-80bb-1e1d9ad16049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:14.576607 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f198f-0764-4bca-80bb-1e1d9ad16049 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:14.593587 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 418/828] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:14.599289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f198f-0764-4bca-80bb-1e1d9ad16049 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:14.725638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f198f-0764-4bca-80bb-1e1d9ad16049 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:14.766194 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8af0f-1960-4b06-a33e-2a0859026989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:14.767082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8af0f-1960-4b06-a33e-2a0859026989 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:14.767513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8af0f-1960-4b06-a33e-2a0859026989 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:14.768171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8af0f-1960-4b06-a33e-2a0859026989 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:14.773790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9502d270-7676-4c37-88d4-b3f1f647f2f6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:14.776078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8af0f-1960-4b06-a33e-2a0859026989 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:14.778952 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8af0f-1960-4b06-a33e-2a0859026989 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-cba8af0f-1960-4b06-a33e-2a0859026989 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:14.793392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:14.794500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:14.795722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:14.795722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:14.795722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:14.795722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:14.795722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:14.795722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:14.795722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:14.795722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:14.802359 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 419/829] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:14.802744 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8af0f-1960-4b06-a33e-2a0859026989 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:14.847698 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:14.861552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad84eaf-cf0f-4f9d-bee0-9fb3659dd164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:14.862075 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad84eaf-cf0f-4f9d-bee0-9fb3659dd164 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:14.862353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad84eaf-cf0f-4f9d-bee0-9fb3659dd164 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:14.862619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad84eaf-cf0f-4f9d-bee0-9fb3659dd164 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:14.863291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad84eaf-cf0f-4f9d-bee0-9fb3659dd164 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:14.864658 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad84eaf-cf0f-4f9d-bee0-9fb3659dd164 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:14.925862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8af0f-1960-4b06-a33e-2a0859026989 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:14.964904 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 411/830] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 07:51:14 2022] POST /identity/v3/endpoints => generated 337 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:51:14.970968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef3f0e-9883-4323-8c76-300c798a2cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:14.972083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3f0e-9883-4323-8c76-300c798a2cda None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:14.972575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3f0e-9883-4323-8c76-300c798a2cda None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:14.973054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef3f0e-9883-4323-8c76-300c798a2cda None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:14.974205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef3f0e-9883-4323-8c76-300c798a2cda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:14.974739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef3f0e-9883-4323-8c76-300c798a2cda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:14.976536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef3f0e-9883-4323-8c76-300c798a2cda None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:14.990997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 420/831] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:14.997876 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad84eaf-cf0f-4f9d-bee0-9fb3659dd164 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:15.067614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:15.137844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad84eaf-cf0f-4f9d-bee0-9fb3659dd164 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:15.177230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b15634-5b8b-489b-a5a6-62400422940b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:15.177898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b15634-5b8b-489b-a5a6-62400422940b None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:15.178220 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b15634-5b8b-489b-a5a6-62400422940b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:15.178514 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b15634-5b8b-489b-a5a6-62400422940b None admin] PATH_INFO: `/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/8255043f01fd46e4a8a5fde8e81c2bed/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:15.180541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b15634-5b8b-489b-a5a6-62400422940b None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1074e261454981a85d02b4b0f75ec5, user_id=8255043f01fd46e4a8a5fde8e81c2bed, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:15.181971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b15634-5b8b-489b-a5a6-62400422940b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:15.256786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 412/832] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:51:14 2022] PUT /identity/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/8255043f01fd46e4a8a5fde8e81c2bed/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:51:15.774364 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999e88d-0a0b-4101-8be9-31c03a424434 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:15.774887 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999e88d-0a0b-4101-8be9-31c03a424434 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:15.774887 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999e88d-0a0b-4101-8be9-31c03a424434 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:15.777177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 421/833] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:15.788144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e082-d894-4aaa-b69d-ab179ee31990 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:15.788431 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e082-d894-4aaa-b69d-ab179ee31990 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:15.788707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51e082-d894-4aaa-b69d-ab179ee31990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:15.816875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9c51e082-d894-4aaa-b69d-ab179ee31990 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:15.818088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9c51e082-d894-4aaa-b69d-ab179ee31990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:15.908070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 413/834] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:15 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:16.205557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202f8df-9099-4249-8cca-e8cabc9b06a0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:16.205779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202f8df-9099-4249-8cca-e8cabc9b06a0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:16.206088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8202f8df-9099-4249-8cca-e8cabc9b06a0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:16.207633 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 422/835] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:16.213578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0706-943e-43cb-9737-619e2da1dcc9 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:16.214096 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0706-943e-43cb-9737-619e2da1dcc9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:16.214179 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3d0706-943e-43cb-9737-619e2da1dcc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:16.235246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8e3d0706-943e-43cb-9737-619e2da1dcc9 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:16.236495 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8e3d0706-943e-43cb-9737-619e2da1dcc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:16.246900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202f8df-9099-4249-8cca-e8cabc9b06a0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:16.278693 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:16.329273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 414/836] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:16.392505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:16.399912 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8202f8df-9099-4249-8cca-e8cabc9b06a0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:16.437121 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c702ac-4e5a-4fbc-990a-983c849d6005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:16.437754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c702ac-4e5a-4fbc-990a-983c849d6005 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:16.438036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c702ac-4e5a-4fbc-990a-983c849d6005 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:16.438313 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c702ac-4e5a-4fbc-990a-983c849d6005 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:16.438903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c702ac-4e5a-4fbc-990a-983c849d6005 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:16.440304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c702ac-4e5a-4fbc-990a-983c849d6005 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-53c702ac-4e5a-4fbc-990a-983c849d6005 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:16.449662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:16.450605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:16.451482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 423/837] 10.222.0.62 () {56 vars in 1132 bytes} [Wed Aug 24 07:51:16 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:16.458747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d0706-943e-43cb-9737-619e2da1dcc9 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:16.504476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291e34b-afb0-4926-9035-2f032545791e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:16.504672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291e34b-afb0-4926-9035-2f032545791e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:16.504914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e291e34b-afb0-4926-9035-2f032545791e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:16.506482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 424/838] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:16.513290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f9c2c-8999-4d1a-aef5-ef9dbf702af1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:16.513707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f9c2c-8999-4d1a-aef5-ef9dbf702af1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:16.514078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f9c2c-8999-4d1a-aef5-ef9dbf702af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:16.535594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3b3f9c2c-8999-4d1a-aef5-ef9dbf702af1 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:16.537650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3b3f9c2c-8999-4d1a-aef5-ef9dbf702af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:16.579124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3d0706-943e-43cb-9737-619e2da1dcc9 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:16.614740 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721665f-ad5d-4522-93ac-ba53e887b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:16.615643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721665f-ad5d-4522-93ac-ba53e887b67b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:16.616178 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721665f-ad5d-4522-93ac-ba53e887b67b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:16.616646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4721665f-ad5d-4522-93ac-ba53e887b67b None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:16.617487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721665f-ad5d-4522-93ac-ba53e887b67b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:16.617983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721665f-ad5d-4522-93ac-ba53e887b67b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:16.619550 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4721665f-ad5d-4522-93ac-ba53e887b67b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:16.624013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 425/839] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:51:16.625038 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 415/840] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 24 07:51:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:16.630443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721665f-ad5d-4522-93ac-ba53e887b67b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:16.630569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f9c2c-8999-4d1a-aef5-ef9dbf702af1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:16.668286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:16.736105 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:16.749430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4721665f-ad5d-4522-93ac-ba53e887b67b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:16.751816 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f9c2c-8999-4d1a-aef5-ef9dbf702af1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:16.791902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27177438-96d1-4982-bd67-5ceebbc3910c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:16.792578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177438-96d1-4982-bd67-5ceebbc3910c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:16.792820 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177438-96d1-4982-bd67-5ceebbc3910c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:16.793094 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27177438-96d1-4982-bd67-5ceebbc3910c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:16.800031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fb343-df04-48ae-8add-b83ed721f91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:16.801190 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fb343-df04-48ae-8add-b83ed721f91a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:16.802056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fb343-df04-48ae-8add-b83ed721f91a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:16.802552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fb343-df04-48ae-8add-b83ed721f91a None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:16.803454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fb343-df04-48ae-8add-b83ed721f91a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:16.804233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fb343-df04-48ae-8add-b83ed721f91a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:16.804430 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27177438-96d1-4982-bd67-5ceebbc3910c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:16.806059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fb343-df04-48ae-8add-b83ed721f91a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-27177438-96d1-4982-bd67-5ceebbc3910c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:16.809271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:16.810213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:16.816252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:16.816252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:16.816252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:16.816252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:16.816252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:16.816252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:16.816252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:16.816252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:16.816252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:16.816252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:16.816252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:51:16.816252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:16.816252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 426/841] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:51:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:16.816252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27177438-96d1-4982-bd67-5ceebbc3910c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:16.828121 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 416/842] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 24 07:51:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:16.905826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fb343-df04-48ae-8add-b83ed721f91a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:16.938993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27177438-96d1-4982-bd67-5ceebbc3910c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:16.990036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755e916-f561-43f3-baed-923a5915084c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:16.990036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755e916-f561-43f3-baed-923a5915084c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:16.990594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755e916-f561-43f3-baed-923a5915084c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:16.990594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755e916-f561-43f3-baed-923a5915084c None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:16.991263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755e916-f561-43f3-baed-923a5915084c None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:16.991574 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755e916-f561-43f3-baed-923a5915084c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:16.992988 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755e916-f561-43f3-baed-923a5915084c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:17.002623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 427/843] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:51:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:17.009052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755e916-f561-43f3-baed-923a5915084c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:17.030204 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:17.038378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fb343-df04-48ae-8add-b83ed721f91a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:17.052186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:17.079691 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2717f2-ade8-4813-8b19-17a4e9ab40b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:17.080791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2717f2-ade8-4813-8b19-17a4e9ab40b6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:17.081342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2717f2-ade8-4813-8b19-17a4e9ab40b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:17.081832 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2717f2-ade8-4813-8b19-17a4e9ab40b6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:17.082617 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2717f2-ade8-4813-8b19-17a4e9ab40b6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:17.084189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2717f2-ade8-4813-8b19-17a4e9ab40b6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ab2717f2-ade8-4813-8b19-17a4e9ab40b6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:17.095599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:17.096708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:17.097593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:17.097593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:17.097593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:17.097593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:17.097593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:17.097593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:17.097593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:17.097593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:17.097593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:17.097593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:17.097593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:17.097593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:17.097593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:51:17.097593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:17.105256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 417/844] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:51:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:17.106822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2717f2-ade8-4813-8b19-17a4e9ab40b6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:17.123515 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755e916-f561-43f3-baed-923a5915084c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:17.164805 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc856c-956a-42e9-b6cf-24a96e102323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:17.165856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc856c-956a-42e9-b6cf-24a96e102323 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:17.166142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc856c-956a-42e9-b6cf-24a96e102323 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:17.166415 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc856c-956a-42e9-b6cf-24a96e102323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:17.180480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc856c-956a-42e9-b6cf-24a96e102323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:17.182174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bc856c-956a-42e9-b6cf-24a96e102323 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b7bc856c-956a-42e9-b6cf-24a96e102323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:17.203124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:17.204182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:17.205408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:17.205408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:17.205408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:17.205408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 428/845] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:17.210700 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc856c-956a-42e9-b6cf-24a96e102323 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:17.218849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2717f2-ade8-4813-8b19-17a4e9ab40b6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:17.256160 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e088a6-a215-418f-8e3f-dbbf27707638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:17.257175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e088a6-a215-418f-8e3f-dbbf27707638 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:17.257637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e088a6-a215-418f-8e3f-dbbf27707638 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:17.258094 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e088a6-a215-418f-8e3f-dbbf27707638 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:17.258904 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e088a6-a215-418f-8e3f-dbbf27707638 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:17.259383 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e088a6-a215-418f-8e3f-dbbf27707638 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:17.261714 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e088a6-a215-418f-8e3f-dbbf27707638 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:17.271527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 418/846] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:51:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:17.273085 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e088a6-a215-418f-8e3f-dbbf27707638 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:17.273990 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:17.318705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc856c-956a-42e9-b6cf-24a96e102323 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:17.330875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:17.353410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c758f94a-02f5-46f2-85f2-3511bcb2d543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:17.354019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758f94a-02f5-46f2-85f2-3511bcb2d543 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:17.354437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758f94a-02f5-46f2-85f2-3511bcb2d543 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:17.354742 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758f94a-02f5-46f2-85f2-3511bcb2d543 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:17.355419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758f94a-02f5-46f2-85f2-3511bcb2d543 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:17.355693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758f94a-02f5-46f2-85f2-3511bcb2d543 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:17.357082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c758f94a-02f5-46f2-85f2-3511bcb2d543 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:17.372042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 429/847] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:17.372042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f5dd-2499-4d89-92ac-a30187c2aaa0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:17.372042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f5dd-2499-4d89-92ac-a30187c2aaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:17.372042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f5dd-2499-4d89-92ac-a30187c2aaa0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:17.372622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 430/848] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:17.382621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81f5dd-2499-4d89-92ac-a30187c2aaa0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:17.393599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e088a6-a215-418f-8e3f-dbbf27707638 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:17.430486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6ec10-b137-4388-8e45-e3597ef80d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:17.431323 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6ec10-b137-4388-8e45-e3597ef80d0a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:17.431789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6ec10-b137-4388-8e45-e3597ef80d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:17.432105 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6ec10-b137-4388-8e45-e3597ef80d0a None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:17.432733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6ec10-b137-4388-8e45-e3597ef80d0a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:17.433591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6ec10-b137-4388-8e45-e3597ef80d0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:17.434908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6ec10-b137-4388-8e45-e3597ef80d0a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:17.439652 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 419/849] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:51:17 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:17.442004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40967-34b5-42dd-90c6-5afa7df86f0b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:17.442300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40967-34b5-42dd-90c6-5afa7df86f0b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:17.442573 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e40967-34b5-42dd-90c6-5afa7df86f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:17.474591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f2e40967-34b5-42dd-90c6-5afa7df86f0b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:17.476631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f2e40967-34b5-42dd-90c6-5afa7df86f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:17.516863 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81f5dd-2499-4d89-92ac-a30187c2aaa0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:17.542816 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:17.573693 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 420/850] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:17.573932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc273088-bcb2-4ead-8702-8a9f4f615b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:17.573932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc273088-bcb2-4ead-8702-8a9f4f615b06 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:17.573932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc273088-bcb2-4ead-8702-8a9f4f615b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:17.573932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc273088-bcb2-4ead-8702-8a9f4f615b06 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:17.583375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc273088-bcb2-4ead-8702-8a9f4f615b06 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:17.584943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc273088-bcb2-4ead-8702-8a9f4f615b06 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-bc273088-bcb2-4ead-8702-8a9f4f615b06 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:17.598653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:17.599749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:17.600811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:17.600811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:17.600811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:17.600811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:17.600811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:17.600811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:17.600811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:17.600811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:17.600811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:51:17.600811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:17.600811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 431/851] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 24 07:51:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:17.606978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e40967-34b5-42dd-90c6-5afa7df86f0b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:17.634554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:17.711883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e40967-34b5-42dd-90c6-5afa7df86f0b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:17.749400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccc0e3-6b62-4852-b71a-214224bbdbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:17.750022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccc0e3-6b62-4852-b71a-214224bbdbe4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:17.750308 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccc0e3-6b62-4852-b71a-214224bbdbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:17.750581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ccc0e3-6b62-4852-b71a-214224bbdbe4 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:17.751395 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccc0e3-6b62-4852-b71a-214224bbdbe4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:17.751707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccc0e3-6b62-4852-b71a-214224bbdbe4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:17.753159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ccc0e3-6b62-4852-b71a-214224bbdbe4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:17.771550 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 421/852] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Aug 24 07:51:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:17.777212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc273088-bcb2-4ead-8702-8a9f4f615b06 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:17.881917 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc273088-bcb2-4ead-8702-8a9f4f615b06 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:17.906763 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccc0e3-6b62-4852-b71a-214224bbdbe4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:17.927961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade3fa4-67d7-4c5b-9168-66345776d719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:17.928575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade3fa4-67d7-4c5b-9168-66345776d719 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:17.928862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade3fa4-67d7-4c5b-9168-66345776d719 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:17.929135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade3fa4-67d7-4c5b-9168-66345776d719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:17.984851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:18.000048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:18.010073 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade3fa4-67d7-4c5b-9168-66345776d719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:18.012386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade3fa4-67d7-4c5b-9168-66345776d719 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:18.020705 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ccc0e3-6b62-4852-b71a-214224bbdbe4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:18.055466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367d6f-43b0-4781-a288-b02c06511776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:18.056527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367d6f-43b0-4781-a288-b02c06511776 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:18.057019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367d6f-43b0-4781-a288-b02c06511776 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:18.057484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367d6f-43b0-4781-a288-b02c06511776 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:18.068816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49367d6f-43b0-4781-a288-b02c06511776 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-49367d6f-43b0-4781-a288-b02c06511776 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:18.074333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:18.075267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:18.076163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:18.076163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:18.076163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:18.076163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:18.076163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:18.076163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:18.076163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:18.076163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:18.076163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:18.076163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:18.076163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:18.076163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:18.083293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 422/853] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:51:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:18.084365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367d6f-43b0-4781-a288-b02c06511776 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:18.126357 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 432/854] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:51:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:51:18.131588 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade3fa4-67d7-4c5b-9168-66345776d719 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:18.201352 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367d6f-43b0-4781-a288-b02c06511776 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:18.227891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:18.238155 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3980213-f6e8-465a-9bea-a28fdfee2953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:18.239306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3980213-f6e8-465a-9bea-a28fdfee2953 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:18.239731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3980213-f6e8-465a-9bea-a28fdfee2953 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:18.240190 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3980213-f6e8-465a-9bea-a28fdfee2953 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:18.241009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3980213-f6e8-465a-9bea-a28fdfee2953 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:18.241449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3980213-f6e8-465a-9bea-a28fdfee2953 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:18.243067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3980213-f6e8-465a-9bea-a28fdfee2953 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:18.257660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 423/855] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:51:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:18.258059 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade3fa4-67d7-4c5b-9168-66345776d719 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:18.258934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3980213-f6e8-465a-9bea-a28fdfee2953 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:18.261910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:18.303638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb7d48-7432-4704-8bf8-79ea8d5d6d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:18.304795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb7d48-7432-4704-8bf8-79ea8d5d6d96 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:18.305185 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb7d48-7432-4704-8bf8-79ea8d5d6d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:18.305633 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb7d48-7432-4704-8bf8-79ea8d5d6d96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:18.320372 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb7d48-7432-4704-8bf8-79ea8d5d6d96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:18.322226 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb7d48-7432-4704-8bf8-79ea8d5d6d96 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-64bb7d48-7432-4704-8bf8-79ea8d5d6d96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:18.343485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:18.344581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:18.345463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:18.345463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:18.345463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:18.345463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 433/856] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:18.351141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb7d48-7432-4704-8bf8-79ea8d5d6d96 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:18.371090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3980213-f6e8-465a-9bea-a28fdfee2953 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:18.408719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968c66e-0b23-4d18-8050-02e5de4d77e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:18.409742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c66e-0b23-4d18-8050-02e5de4d77e7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:18.410212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c66e-0b23-4d18-8050-02e5de4d77e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:18.410655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3968c66e-0b23-4d18-8050-02e5de4d77e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:18.422364 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968c66e-0b23-4d18-8050-02e5de4d77e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:18.424095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3968c66e-0b23-4d18-8050-02e5de4d77e7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-3968c66e-0b23-4d18-8050-02e5de4d77e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:18.439103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:18.440231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:18.441140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:18.441140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:18.441140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:18.443193 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 424/857] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:18.449544 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968c66e-0b23-4d18-8050-02e5de4d77e7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:18.503777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb7d48-7432-4704-8bf8-79ea8d5d6d96 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:18.521316 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:18.544016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:18.554315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307b9ae-3608-4048-97ac-aefeb5c0b69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:18.554991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307b9ae-3608-4048-97ac-aefeb5c0b69f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:18.555271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307b9ae-3608-4048-97ac-aefeb5c0b69f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:18.555542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307b9ae-3608-4048-97ac-aefeb5c0b69f None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:18.556293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307b9ae-3608-4048-97ac-aefeb5c0b69f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:18.556811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307b9ae-3608-4048-97ac-aefeb5c0b69f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:18.558484 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307b9ae-3608-4048-97ac-aefeb5c0b69f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:18.576864 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 434/858] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:18.578335 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307b9ae-3608-4048-97ac-aefeb5c0b69f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:18.581048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3968c66e-0b23-4d18-8050-02e5de4d77e7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:18.632257 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fc4de-e62a-4d70-aa55-07c2d3667642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:18.633983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fc4de-e62a-4d70-aa55-07c2d3667642 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:18.634502 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fc4de-e62a-4d70-aa55-07c2d3667642 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:18.635234 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44fc4de-e62a-4d70-aa55-07c2d3667642 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:18.636990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fc4de-e62a-4d70-aa55-07c2d3667642 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:18.637296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fc4de-e62a-4d70-aa55-07c2d3667642 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:18.638665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44fc4de-e62a-4d70-aa55-07c2d3667642 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:18.655533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 425/859] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:18.656829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fc4de-e62a-4d70-aa55-07c2d3667642 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:18.705291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307b9ae-3608-4048-97ac-aefeb5c0b69f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:18.748765 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d60721-1294-4a74-aea1-561568395ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:18.749352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d60721-1294-4a74-aea1-561568395ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:18.749615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d60721-1294-4a74-aea1-561568395ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:18.749889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d60721-1294-4a74-aea1-561568395ad1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:18.756862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d60721-1294-4a74-aea1-561568395ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:18.758332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d60721-1294-4a74-aea1-561568395ad1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:18.770660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44fc4de-e62a-4d70-aa55-07c2d3667642 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e0d60721-1294-4a74-aea1-561568395ad1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:18.770984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:18.771833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:18.773021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:18.773021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:18.773021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:18.773021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:18.773021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:18.773021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:18.773021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:18.773021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:18.776982 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 435/860] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:18.778236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d60721-1294-4a74-aea1-561568395ad1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:18.792331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:18.820580 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294305a-84cd-4586-8425-f9bb4af55c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:18.821165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294305a-84cd-4586-8425-f9bb4af55c2b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:18.821448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294305a-84cd-4586-8425-f9bb4af55c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:18.821721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294305a-84cd-4586-8425-f9bb4af55c2b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:18.830986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294305a-84cd-4586-8425-f9bb4af55c2b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:18.832458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294305a-84cd-4586-8425-f9bb4af55c2b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:18.835982 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f294305a-84cd-4586-8425-f9bb4af55c2b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:18.845357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:18.854842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:18.856065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:18.856065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:18.856065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:18.856065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:18.856065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:18.856065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:18.856065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:18.856065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:18.856065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 07:51:18.856065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:18.856065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 426/861] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:51:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:18.856065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248c9e6-26ea-4e70-a054-d31aef759ac5 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:18.856065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248c9e6-26ea-4e70-a054-d31aef759ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:18.856801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248c9e6-26ea-4e70-a054-d31aef759ac5 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:18.856801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 427/862] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:18.856801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248c9e6-26ea-4e70-a054-d31aef759ac5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:18.901368 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d60721-1294-4a74-aea1-561568395ad1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:18.945338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a551dd87-5f24-4db4-8ee8-097416e281dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:18.945954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551dd87-5f24-4db4-8ee8-097416e281dc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:18.946238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551dd87-5f24-4db4-8ee8-097416e281dc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:18.946512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551dd87-5f24-4db4-8ee8-097416e281dc None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:18.947210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551dd87-5f24-4db4-8ee8-097416e281dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:18.947516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551dd87-5f24-4db4-8ee8-097416e281dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:18.949923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a551dd87-5f24-4db4-8ee8-097416e281dc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:18.963024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 436/863] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:18.964364 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010e5ce-1620-48a3-9670-2c3d606eb9a9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:18.964653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010e5ce-1620-48a3-9670-2c3d606eb9a9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:18.964927 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010e5ce-1620-48a3-9670-2c3d606eb9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:18.969640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248c9e6-26ea-4e70-a054-d31aef759ac5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:18.984894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d010e5ce-1620-48a3-9670-2c3d606eb9a9 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:18.986174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d010e5ce-1620-48a3-9670-2c3d606eb9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:19.007532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8215d88-a959-40cd-bea5-3826f271494d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:19.008172 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8215d88-a959-40cd-bea5-3826f271494d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:19.008444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8215d88-a959-40cd-bea5-3826f271494d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:19.008708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8215d88-a959-40cd-bea5-3826f271494d None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:19.009425 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8215d88-a959-40cd-bea5-3826f271494d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:19.009769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8215d88-a959-40cd-bea5-3826f271494d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:19.011174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8215d88-a959-40cd-bea5-3826f271494d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:19.028308 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 428/864] 10.222.0.62 () {56 vars in 1135 bytes} [Wed Aug 24 07:51:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:19.029130 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8215d88-a959-40cd-bea5-3826f271494d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:19.067810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 437/865] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:19.067810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010e5ce-1620-48a3-9670-2c3d606eb9a9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:19.074315 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:19.124854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:19.151223 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8215d88-a959-40cd-bea5-3826f271494d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:19.191119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc041fb-7d97-4dc7-a187-9883b208ee0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:19.192293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc041fb-7d97-4dc7-a187-9883b208ee0d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:19.192777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc041fb-7d97-4dc7-a187-9883b208ee0d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:19.193250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc041fb-7d97-4dc7-a187-9883b208ee0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:19.194173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc041fb-7d97-4dc7-a187-9883b208ee0d None admin] RBAC: Adding query filter params (role.id=bd638a70b0d5447ab1d78f20ef54200e, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=2627d6e89afa4774b0897bb0c619cd01) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:19.194728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc041fb-7d97-4dc7-a187-9883b208ee0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:19.195029 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010e5ce-1620-48a3-9670-2c3d606eb9a9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:19.196675 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc041fb-7d97-4dc7-a187-9883b208ee0d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:19.207988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 429/866] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:51:19 2022] GET /identity/v3/role_assignments?user.id=2627d6e89afa4774b0897bb0c619cd01&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=bd638a70b0d5447ab1d78f20ef54200e => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:19.240815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384b9591-0de0-453a-a986-6cca28eda002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:19.241847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b9591-0de0-453a-a986-6cca28eda002 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:19.242327 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b9591-0de0-453a-a986-6cca28eda002 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:19.242912 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b9591-0de0-453a-a986-6cca28eda002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:19.325644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b9591-0de0-453a-a986-6cca28eda002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:19.327030 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384b9591-0de0-453a-a986-6cca28eda002 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:19.340268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc041fb-7d97-4dc7-a187-9883b208ee0d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:19.379021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:19.458260 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 438/867] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:51:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:51:19.459602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56733da-b202-458e-9697-119bd4f21c38 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:19.459941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56733da-b202-458e-9697-119bd4f21c38 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:19.460216 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56733da-b202-458e-9697-119bd4f21c38 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:19.461707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 439/868] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:19.462171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:19.463401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56733da-b202-458e-9697-119bd4f21c38 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:19.472044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc041fb-7d97-4dc7-a187-9883b208ee0d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:19.515614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968020fe-6e72-4c8a-aed1-b58b3d78e846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:19.516349 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968020fe-6e72-4c8a-aed1-b58b3d78e846 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:19.516625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968020fe-6e72-4c8a-aed1-b58b3d78e846 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:19.516892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968020fe-6e72-4c8a-aed1-b58b3d78e846 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:19.517587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968020fe-6e72-4c8a-aed1-b58b3d78e846 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:19.518873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968020fe-6e72-4c8a-aed1-b58b3d78e846 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:19.573423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56733da-b202-458e-9697-119bd4f21c38 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:19.588074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 430/869] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 24 07:51:19 2022] POST /identity/v3/services => generated 269 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:51:19.588074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eaeff-7d81-441f-b3b7-34c5a2e0020f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:19.588074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eaeff-7d81-441f-b3b7-34c5a2e0020f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:19.588074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796eaeff-7d81-441f-b3b7-34c5a2e0020f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:19.605634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-796eaeff-7d81-441f-b3b7-34c5a2e0020f None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:19.607802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-796eaeff-7d81-441f-b3b7-34c5a2e0020f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:19.626830 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f125b-5dc0-42b1-ae74-c14cd4712a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:19.627611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f125b-5dc0-42b1-ae74-c14cd4712a1e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:19.627930 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f125b-5dc0-42b1-ae74-c14cd4712a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:19.628208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f125b-5dc0-42b1-ae74-c14cd4712a1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:19.631928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:19.641627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f125b-5dc0-42b1-ae74-c14cd4712a1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:19.643200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445f125b-5dc0-42b1-ae74-c14cd4712a1e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-445f125b-5dc0-42b1-ae74-c14cd4712a1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:19.662049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:19.663074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:19.664475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:19.664475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:19.664475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:19.669045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 440/870] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:19.670160 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f125b-5dc0-42b1-ae74-c14cd4712a1e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:19.717533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 431/871] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:19 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:19.795000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f125b-5dc0-42b1-ae74-c14cd4712a1e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:19.829622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dfd27-cc2b-4382-a534-9c0034d980d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:19.830238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dfd27-cc2b-4382-a534-9c0034d980d2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:19.830522 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dfd27-cc2b-4382-a534-9c0034d980d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:19.830800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841dfd27-cc2b-4382-a534-9c0034d980d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:19.831649 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841dfd27-cc2b-4382-a534-9c0034d980d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:19.831996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841dfd27-cc2b-4382-a534-9c0034d980d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:19.833368 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841dfd27-cc2b-4382-a534-9c0034d980d2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:19.846270 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 441/872] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:19.851788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eaeff-7d81-441f-b3b7-34c5a2e0020f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:19.939154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:19.955898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796eaeff-7d81-441f-b3b7-34c5a2e0020f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:19.992957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57822a-2f7d-4399-8704-f8936c458a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:19.993602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57822a-2f7d-4399-8704-f8936c458a49 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:19.993884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57822a-2f7d-4399-8704-f8936c458a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:19.994159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57822a-2f7d-4399-8704-f8936c458a49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:19.996746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dfd27-cc2b-4382-a534-9c0034d980d2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:20.007601 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57822a-2f7d-4399-8704-f8936c458a49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:20.007601 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57822a-2f7d-4399-8704-f8936c458a49 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-5b57822a-2f7d-4399-8704-f8936c458a49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:20.022466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:20.023610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:20.024779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:20.024779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:20.024779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:20.024779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:20.024779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:20.024779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:20.024779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:20.024779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:20.027873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 432/873] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:20.032448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57822a-2f7d-4399-8704-f8936c458a49 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:20.062622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:20.121117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841dfd27-cc2b-4382-a534-9c0034d980d2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:20.149153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57822a-2f7d-4399-8704-f8936c458a49 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:20.158393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f120a8-9ad3-4646-9821-ab2f7ace331a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:20.159446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f120a8-9ad3-4646-9821-ab2f7ace331a None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:20.159958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f120a8-9ad3-4646-9821-ab2f7ace331a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:20.160428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f120a8-9ad3-4646-9821-ab2f7ace331a None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:20.161369 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f120a8-9ad3-4646-9821-ab2f7ace331a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:20.162929 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f120a8-9ad3-4646-9821-ab2f7ace331a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:20.185348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed73929-277f-41fc-a1fd-eeb35018aa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:20.185955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73929-277f-41fc-a1fd-eeb35018aa40 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:20.186232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73929-277f-41fc-a1fd-eeb35018aa40 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:20.186495 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed73929-277f-41fc-a1fd-eeb35018aa40 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:20.187173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed73929-277f-41fc-a1fd-eeb35018aa40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:20.187471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed73929-277f-41fc-a1fd-eeb35018aa40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:20.188959 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed73929-277f-41fc-a1fd-eeb35018aa40 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:20.206256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 433/874] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:20.207436 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed73929-277f-41fc-a1fd-eeb35018aa40 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:20.217951 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:20.263471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 442/875] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 24 07:51:19 2022] POST /identity/v3/services => generated 251 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:51:20.324451 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed73929-277f-41fc-a1fd-eeb35018aa40 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:20.369472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081d79a6-be5c-4471-a753-d4256c91cfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:20.371529 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d79a6-be5c-4471-a753-d4256c91cfad None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:20.372044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d79a6-be5c-4471-a753-d4256c91cfad None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:20.372528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081d79a6-be5c-4471-a753-d4256c91cfad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:20.373478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d79a6-be5c-4471-a753-d4256c91cfad None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=8255043f01fd46e4a8a5fde8e81c2bed) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:20.373990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d79a6-be5c-4471-a753-d4256c91cfad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:20.375701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081d79a6-be5c-4471-a753-d4256c91cfad None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:20.383153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 434/876] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:51:20 2022] GET /identity/v3/role_assignments?user.id=8255043f01fd46e4a8a5fde8e81c2bed&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=68b1888f7bb644a39938b8d41006a813 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:21.294953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be69c7b-833d-4762-9b00-5669d32936f1 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:21.295497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be69c7b-833d-4762-9b00-5669d32936f1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:21.295576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be69c7b-833d-4762-9b00-5669d32936f1 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:21.297227 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 443/877] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:21.302756 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4ea4-f3e9-4613-adfe-9c1454d69e49 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:21.303048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4ea4-f3e9-4613-adfe-9c1454d69e49 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:21.303318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f4ea4-f3e9-4613-adfe-9c1454d69e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:21.321592 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-eb9f4ea4-f3e9-4613-adfe-9c1454d69e49 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:21.322776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-eb9f4ea4-f3e9-4613-adfe-9c1454d69e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:21.389563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:21.398439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 435/878] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:21.629468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87384325-f315-4e91-adb7-66807f04484b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:21.629711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87384325-f315-4e91-adb7-66807f04484b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:21.630159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87384325-f315-4e91-adb7-66807f04484b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:21.631810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 444/879] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:21.637871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecc073-1b4a-4c24-b7fa-7605595d55cd None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:21.638237 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecc073-1b4a-4c24-b7fa-7605595d55cd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:21.638585 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ecc073-1b4a-4c24-b7fa-7605595d55cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:21.656826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-79ecc073-1b4a-4c24-b7fa-7605595d55cd None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:21.658023 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79ecc073-1b4a-4c24-b7fa-7605595d55cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:21.668039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87384325-f315-4e91-adb7-66807f04484b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:21.750760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 436/880] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:21.781731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87384325-f315-4e91-adb7-66807f04484b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:21.791697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:21.817458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e35adb-a866-4321-9d23-d8e3f82882c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:21.818142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e35adb-a866-4321-9d23-d8e3f82882c1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:21.818419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e35adb-a866-4321-9d23-d8e3f82882c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:21.818687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e35adb-a866-4321-9d23-d8e3f82882c1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:21.830795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e35adb-a866-4321-9d23-d8e3f82882c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-65e35adb-a866-4321-9d23-d8e3f82882c1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:21.835601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:21.836576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:21.837426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:21.837426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:21.837426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:21.837426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:21.837426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:21.837426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:21.837426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:21.837426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:21.837426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:21.837426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:21.837426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:51:21.837426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:21.842098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 445/881] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Aug 24 07:51:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:21.844954 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecc073-1b4a-4c24-b7fa-7605595d55cd None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:21.953759 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ecc073-1b4a-4c24-b7fa-7605595d55cd None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:21.981083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:21.989550 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98301e3-79d7-4383-ba67-af6438bb33eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:21.990155 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98301e3-79d7-4383-ba67-af6438bb33eb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:21.990433 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98301e3-79d7-4383-ba67-af6438bb33eb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:21.990709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98301e3-79d7-4383-ba67-af6438bb33eb None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:21.991363 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98301e3-79d7-4383-ba67-af6438bb33eb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:21.991699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98301e3-79d7-4383-ba67-af6438bb33eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:21.993125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98301e3-79d7-4383-ba67-af6438bb33eb None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:22.002280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 437/882] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Aug 24 07:51:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:22.009224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e35adb-a866-4321-9d23-d8e3f82882c1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:22.025860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98301e3-79d7-4383-ba67-af6438bb33eb None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:22.117748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e35adb-a866-4321-9d23-d8e3f82882c1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:22.131039 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98301e3-79d7-4383-ba67-af6438bb33eb None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:22.155089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5220b49-c55e-4187-bf87-e820b6d70a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:22.156180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5220b49-c55e-4187-bf87-e820b6d70a8a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:22.156680 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5220b49-c55e-4187-bf87-e820b6d70a8a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:22.157164 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5220b49-c55e-4187-bf87-e820b6d70a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:22.167742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289dbf0-173f-4314-b0e9-822747feb31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:22.168416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289dbf0-173f-4314-b0e9-822747feb31a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:22.168691 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289dbf0-173f-4314-b0e9-822747feb31a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:22.168960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289dbf0-173f-4314-b0e9-822747feb31a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:22.169551 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289dbf0-173f-4314-b0e9-822747feb31a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:22.170462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5220b49-c55e-4187-bf87-e820b6d70a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:22.170891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289dbf0-173f-4314-b0e9-822747feb31a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:22.172531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5220b49-c55e-4187-bf87-e820b6d70a8a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e289dbf0-173f-4314-b0e9-822747feb31a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:22.180571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:22.181578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:22.183801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 438/883] 10.222.0.62 () {56 vars in 1132 bytes} [Wed Aug 24 07:51:22 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:22.188894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289dbf0-173f-4314-b0e9-822747feb31a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c5220b49-c55e-4187-bf87-e820b6d70a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:22.191936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:22.192885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:22.194116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:22.194116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:22.194116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:22.194116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 446/884] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:22.198988 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5220b49-c55e-4187-bf87-e820b6d70a8a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:22.226536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:22.255455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:22.304109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289dbf0-173f-4314-b0e9-822747feb31a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:22.308701 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5220b49-c55e-4187-bf87-e820b6d70a8a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:22.341119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88aa68-be07-474a-b23f-ce7e4b7f6f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:22.341722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88aa68-be07-474a-b23f-ce7e4b7f6f3f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:22.342000 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88aa68-be07-474a-b23f-ce7e4b7f6f3f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:22.342268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88aa68-be07-474a-b23f-ce7e4b7f6f3f None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:22.342892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88aa68-be07-474a-b23f-ce7e4b7f6f3f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:22.343190 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88aa68-be07-474a-b23f-ce7e4b7f6f3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:22.344030 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332bb3b-60df-4369-a98f-220d62287364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:22.344567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88aa68-be07-474a-b23f-ce7e4b7f6f3f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:22.344751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332bb3b-60df-4369-a98f-220d62287364 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:22.344905 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332bb3b-60df-4369-a98f-220d62287364 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:22.345161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332bb3b-60df-4369-a98f-220d62287364 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:22.345798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332bb3b-60df-4369-a98f-220d62287364 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:22.346098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332bb3b-60df-4369-a98f-220d62287364 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:22.347929 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e332bb3b-60df-4369-a98f-220d62287364 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:22.351917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 439/885] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 24 07:51:22 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:22.351917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47213feb-322e-453d-b2ec-93bd4385f5f2 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:22.351917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47213feb-322e-453d-b2ec-93bd4385f5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:22.351917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47213feb-322e-453d-b2ec-93bd4385f5f2 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:22.352696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 440/886] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:22.356867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47213feb-322e-453d-b2ec-93bd4385f5f2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:22.365440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 447/887] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:22.367001 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e538ba-327f-4956-97f5-a79a6f3d32fc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:22.367432 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e538ba-327f-4956-97f5-a79a6f3d32fc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:22.367961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e538ba-327f-4956-97f5-a79a6f3d32fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:22.391391 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b8e538ba-327f-4956-97f5-a79a6f3d32fc None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:22.393464 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b8e538ba-327f-4956-97f5-a79a6f3d32fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:22.460703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 448/888] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:22.461528 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e538ba-327f-4956-97f5-a79a6f3d32fc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:22.463183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47213feb-322e-453d-b2ec-93bd4385f5f2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:22.473685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:22.489361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:22.506693 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f47aef2-7ede-4f27-95ba-bb6a5e130dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:22.507296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47aef2-7ede-4f27-95ba-bb6a5e130dd3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:22.507574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47aef2-7ede-4f27-95ba-bb6a5e130dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:22.507857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f47aef2-7ede-4f27-95ba-bb6a5e130dd3 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:22.508497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47aef2-7ede-4f27-95ba-bb6a5e130dd3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:22.508849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47aef2-7ede-4f27-95ba-bb6a5e130dd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:22.510232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f47aef2-7ede-4f27-95ba-bb6a5e130dd3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:22.519905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 441/889] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 24 07:51:22 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:22.519905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec987d-0068-4c50-918f-9e4855348af6 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:22.519905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec987d-0068-4c50-918f-9e4855348af6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:22.519905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec987d-0068-4c50-918f-9e4855348af6 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:22.519905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 442/890] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:22.520870 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec987d-0068-4c50-918f-9e4855348af6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:22.573580 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e538ba-327f-4956-97f5-a79a6f3d32fc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:22.610059 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13ea99d-13d4-4c1e-80c0-c9a45d6aa932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:22.610802 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea99d-13d4-4c1e-80c0-c9a45d6aa932 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:22.611078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea99d-13d4-4c1e-80c0-c9a45d6aa932 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:22.611349 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13ea99d-13d4-4c1e-80c0-c9a45d6aa932 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:22.618769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ea99d-13d4-4c1e-80c0-c9a45d6aa932 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:22.620473 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13ea99d-13d4-4c1e-80c0-c9a45d6aa932 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:22.623321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec987d-0068-4c50-918f-9e4855348af6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f13ea99d-13d4-4c1e-80c0-c9a45d6aa932 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:22.632147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:22.633093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:22.634072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:22.634072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:22.634072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:22.634072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:22.634072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:22.634072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:22.634072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:22.634072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:22.634072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:51:22.634072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:22.634072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 449/891] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 24 07:51:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:22.634688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ddf80-16c2-4511-af95-c781a8eae614 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:22.635239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ddf80-16c2-4511-af95-c781a8eae614 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:22.635239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0ddf80-16c2-4511-af95-c781a8eae614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:22.653938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ef0ddf80-16c2-4511-af95-c781a8eae614 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:22.655212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ef0ddf80-16c2-4511-af95-c781a8eae614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:22.663796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc25ee0-3996-4ae9-ab11-7b40d1004b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:22.664529 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc25ee0-3996-4ae9-ab11-7b40d1004b05 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:22.664744 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc25ee0-3996-4ae9-ab11-7b40d1004b05 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:22.665018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc25ee0-3996-4ae9-ab11-7b40d1004b05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:22.665717 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc25ee0-3996-4ae9-ab11-7b40d1004b05 None admin] RBAC: Adding query filter params (interface=public, service_id=5d7f905e9de049daa6e7feda7a642ed4, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:22.666031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc25ee0-3996-4ae9-ab11-7b40d1004b05 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:22.668041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc25ee0-3996-4ae9-ab11-7b40d1004b05 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:22.673172 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 443/892] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 24 07:51:22 2022] GET /identity/v3/endpoints?service_id=5d7f905e9de049daa6e7feda7a642ed4&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:22.673953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc25ee0-3996-4ae9-ab11-7b40d1004b05 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:22.723709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:22.727694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:22.732486 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 450/893] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:22 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:22.733360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ddf80-16c2-4511-af95-c781a8eae614 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:22.781705 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc25ee0-3996-4ae9-ab11-7b40d1004b05 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:22.816081 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2d504-66bf-4554-b03f-d5f948cccccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:22.817012 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2d504-66bf-4554-b03f-d5f948cccccb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:22.817529 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2d504-66bf-4554-b03f-d5f948cccccb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:22.818012 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2d504-66bf-4554-b03f-d5f948cccccb None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:22.818965 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2d504-66bf-4554-b03f-d5f948cccccb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:22.819498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2d504-66bf-4554-b03f-d5f948cccccb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:22.821052 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2d504-66bf-4554-b03f-d5f948cccccb None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:22.839565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 444/894] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Aug 24 07:51:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:22.840516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2d504-66bf-4554-b03f-d5f948cccccb None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:22.853006 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0ddf80-16c2-4511-af95-c781a8eae614 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:22.889778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24581d9-59db-4c9c-bf77-10a8981b0c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:22.890416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24581d9-59db-4c9c-bf77-10a8981b0c81 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:22.890691 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24581d9-59db-4c9c-bf77-10a8981b0c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:22.890959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24581d9-59db-4c9c-bf77-10a8981b0c81 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:22.891563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24581d9-59db-4c9c-bf77-10a8981b0c81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:22.892984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24581d9-59db-4c9c-bf77-10a8981b0c81 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:22.898601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 451/895] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 24 07:51:22 2022] GET /identity/v3/services => generated 1268 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:51:22.899340 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24581d9-59db-4c9c-bf77-10a8981b0c81 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:22.966844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2d504-66bf-4554-b03f-d5f948cccccb None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:22.968950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:22.984779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:23.006274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9b79c-4817-4e51-bc4d-ead43458b41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:23.007044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9b79c-4817-4e51-bc4d-ead43458b41f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:23.007383 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9b79c-4817-4e51-bc4d-ead43458b41f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:23.007717 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9b79c-4817-4e51-bc4d-ead43458b41f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:23.008411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9b79c-4817-4e51-bc4d-ead43458b41f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:23.009889 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b9b79c-4817-4e51-bc4d-ead43458b41f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-c0b9b79c-4817-4e51-bc4d-ead43458b41f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:23.020656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:23.028070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:23.028962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 445/896] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:51:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:23.029831 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9b79c-4817-4e51-bc4d-ead43458b41f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:23.044973 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24581d9-59db-4c9c-bf77-10a8981b0c81 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:23.083390 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1625cb-6e3d-4198-b214-e9e45771dbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:23.084038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1625cb-6e3d-4198-b214-e9e45771dbf4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:23.084326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1625cb-6e3d-4198-b214-e9e45771dbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:23.084978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1625cb-6e3d-4198-b214-e9e45771dbf4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:23.136489 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9b79c-4817-4e51-bc4d-ead43458b41f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:23.161126 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1625cb-6e3d-4198-b214-e9e45771dbf4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:23.163460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1625cb-6e3d-4198-b214-e9e45771dbf4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:23.170849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe3e79-6b6e-48b6-9f75-019358d9a197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:23.171542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe3e79-6b6e-48b6-9f75-019358d9a197 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:23.171832 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe3e79-6b6e-48b6-9f75-019358d9a197 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:23.172548 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fe3e79-6b6e-48b6-9f75-019358d9a197 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:23.173142 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe3e79-6b6e-48b6-9f75-019358d9a197 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:23.174864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fe3e79-6b6e-48b6-9f75-019358d9a197 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-74fe3e79-6b6e-48b6-9f75-019358d9a197 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:23.185414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:23.186647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:23.187589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 446/897] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 24 07:51:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:23.188435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe3e79-6b6e-48b6-9f75-019358d9a197 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:23.222186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:23.235329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:23.287527 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 452/898] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:51:22 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:51:23.288862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1625cb-6e3d-4198-b214-e9e45771dbf4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:23.299312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fe3e79-6b6e-48b6-9f75-019358d9a197 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:23.333755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02aa998-b9d6-47fe-b484-32681b04806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:23.334366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02aa998-b9d6-47fe-b484-32681b04806e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:23.334646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02aa998-b9d6-47fe-b484-32681b04806e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:23.334914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02aa998-b9d6-47fe-b484-32681b04806e None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:23.335533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02aa998-b9d6-47fe-b484-32681b04806e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:23.335860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02aa998-b9d6-47fe-b484-32681b04806e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:23.337214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02aa998-b9d6-47fe-b484-32681b04806e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:23.342345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 447/899] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:51:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:23.343136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02aa998-b9d6-47fe-b484-32681b04806e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:23.407224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1625cb-6e3d-4198-b214-e9e45771dbf4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:23.442744 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86912bee-70e7-470a-90d3-d79364cdd1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:23.443352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86912bee-70e7-470a-90d3-d79364cdd1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:23.443632 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86912bee-70e7-470a-90d3-d79364cdd1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:23.443934 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86912bee-70e7-470a-90d3-d79364cdd1b0 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:23.444565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86912bee-70e7-470a-90d3-d79364cdd1b0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:23.444868 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86912bee-70e7-470a-90d3-d79364cdd1b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:23.446223 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86912bee-70e7-470a-90d3-d79364cdd1b0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:23.451593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 453/900] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 24 07:51:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:23.452422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86912bee-70e7-470a-90d3-d79364cdd1b0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:23.474878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:23.482812 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02aa998-b9d6-47fe-b484-32681b04806e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:23.487942 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:23.520945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6b01c-3de4-4fad-a0be-1530dc417e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:23.521579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6b01c-3de4-4fad-a0be-1530dc417e65 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:23.521864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6b01c-3de4-4fad-a0be-1530dc417e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:23.522136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a6b01c-3de4-4fad-a0be-1530dc417e65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:23.533108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6b01c-3de4-4fad-a0be-1530dc417e65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:23.534553 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a6b01c-3de4-4fad-a0be-1530dc417e65 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-65a6b01c-3de4-4fad-a0be-1530dc417e65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:23.552304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:23.553279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:23.554203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:23.554203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:23.554203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:23.554203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 448/901] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:23.554203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6b01c-3de4-4fad-a0be-1530dc417e65 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:23.566895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86912bee-70e7-470a-90d3-d79364cdd1b0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:23.601502 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dde30c-1a37-4ed3-9456-71440fb1fdc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:23.602105 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dde30c-1a37-4ed3-9456-71440fb1fdc4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:23.602416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dde30c-1a37-4ed3-9456-71440fb1fdc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:23.602660 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dde30c-1a37-4ed3-9456-71440fb1fdc4 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:23.603287 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dde30c-1a37-4ed3-9456-71440fb1fdc4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:23.603591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dde30c-1a37-4ed3-9456-71440fb1fdc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:23.605783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dde30c-1a37-4ed3-9456-71440fb1fdc4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:23.610399 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 454/902] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:51:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:23.611173 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dde30c-1a37-4ed3-9456-71440fb1fdc4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:23.669517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a6b01c-3de4-4fad-a0be-1530dc417e65 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:23.706015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78446d1-a2a2-48e6-b9e8-0c68b15aaba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:23.706576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:23.707740 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78446d1-a2a2-48e6-b9e8-0c68b15aaba3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:23.708191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78446d1-a2a2-48e6-b9e8-0c68b15aaba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:23.708464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78446d1-a2a2-48e6-b9e8-0c68b15aaba3 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:23.709087 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78446d1-a2a2-48e6-b9e8-0c68b15aaba3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:23.709437 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78446d1-a2a2-48e6-b9e8-0c68b15aaba3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:23.710961 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78446d1-a2a2-48e6-b9e8-0c68b15aaba3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:23.715897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dde30c-1a37-4ed3-9456-71440fb1fdc4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:23.721759 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 449/903] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 24 07:51:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:23.721759 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78446d1-a2a2-48e6-b9e8-0c68b15aaba3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:23.738507 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:23.761088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a3dc2-a95a-4542-b257-11af01928a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:23.761835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3dc2-a95a-4542-b257-11af01928a12 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:23.762121 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3dc2-a95a-4542-b257-11af01928a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:23.762400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3dc2-a95a-4542-b257-11af01928a12 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:23.763063 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a3dc2-a95a-4542-b257-11af01928a12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:23.763370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a3dc2-a95a-4542-b257-11af01928a12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:23.764781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a3dc2-a95a-4542-b257-11af01928a12 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:23.783274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 455/904] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:23.784332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a3dc2-a95a-4542-b257-11af01928a12 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:23.861773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78446d1-a2a2-48e6-b9e8-0c68b15aaba3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:23.910777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19e2df-51a2-40d7-87a2-3ca88e461ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:23.911644 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19e2df-51a2-40d7-87a2-3ca88e461ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:23.912356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19e2df-51a2-40d7-87a2-3ca88e461ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:23.917867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19e2df-51a2-40d7-87a2-3ca88e461ed6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:23.917867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19e2df-51a2-40d7-87a2-3ca88e461ed6 None admin] RBAC: Adding query filter params (interface=public, service_id=db77350fb1e246a391262098bc663c0f, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:23.917867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19e2df-51a2-40d7-87a2-3ca88e461ed6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:23.917867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19e2df-51a2-40d7-87a2-3ca88e461ed6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:23.918492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a3dc2-a95a-4542-b257-11af01928a12 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:23.923895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 450/905] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 24 07:51:23 2022] GET /identity/v3/endpoints?service_id=db77350fb1e246a391262098bc663c0f&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:23.931181 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19e2df-51a2-40d7-87a2-3ca88e461ed6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:23.965077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1247672-e6d5-489f-a0b2-a9c94fa09991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:23.965714 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1247672-e6d5-489f-a0b2-a9c94fa09991 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:23.966001 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1247672-e6d5-489f-a0b2-a9c94fa09991 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:23.966275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1247672-e6d5-489f-a0b2-a9c94fa09991 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:23.973995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1247672-e6d5-489f-a0b2-a9c94fa09991 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:23.975420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1247672-e6d5-489f-a0b2-a9c94fa09991 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b1247672-e6d5-489f-a0b2-a9c94fa09991 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:23.994576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:23.996133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:23.997043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:23.997043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:23.997043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:23.997043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:23.997043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:23.997043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:23.997043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:23.997043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:23.997480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 456/906] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:24.005052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1247672-e6d5-489f-a0b2-a9c94fa09991 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:24.022396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:24.048951 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:24.084704 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19e2df-51a2-40d7-87a2-3ca88e461ed6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:24.114429 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1247672-e6d5-489f-a0b2-a9c94fa09991 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:24.131870 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39dcca-04f1-4c38-8beb-0a2089e79a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:24.133403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39dcca-04f1-4c38-8beb-0a2089e79a60 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:24.133894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39dcca-04f1-4c38-8beb-0a2089e79a60 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:24.134382 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e39dcca-04f1-4c38-8beb-0a2089e79a60 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:24.135257 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39dcca-04f1-4c38-8beb-0a2089e79a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:24.138380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e39dcca-04f1-4c38-8beb-0a2089e79a60 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:24.155878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 451/907] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 24 07:51:23 2022] GET /identity/v3/services => generated 1268 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:51:24.161065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea3fac9-36cf-47d3-ad54-714f12734199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:24.161756 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3fac9-36cf-47d3-ad54-714f12734199 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:24.162046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3fac9-36cf-47d3-ad54-714f12734199 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:24.162370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea3fac9-36cf-47d3-ad54-714f12734199 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:24.163096 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3fac9-36cf-47d3-ad54-714f12734199 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:24.163405 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3fac9-36cf-47d3-ad54-714f12734199 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:24.164897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea3fac9-36cf-47d3-ad54-714f12734199 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:24.184089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 457/908] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:24.186099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39dcca-04f1-4c38-8beb-0a2089e79a60 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:24.305637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e39dcca-04f1-4c38-8beb-0a2089e79a60 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:24.349321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986f1e9-3820-4077-bbb6-471f8905881b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:24.349930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986f1e9-3820-4077-bbb6-471f8905881b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:24.350209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986f1e9-3820-4077-bbb6-471f8905881b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:24.350476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986f1e9-3820-4077-bbb6-471f8905881b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:24.351190 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986f1e9-3820-4077-bbb6-471f8905881b None admin] RBAC: Adding query filter params (role.id=eef05f488f0548cd8907a60e41374b89, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=2627d6e89afa4774b0897bb0c619cd01) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:24.351498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986f1e9-3820-4077-bbb6-471f8905881b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:24.352974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986f1e9-3820-4077-bbb6-471f8905881b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:24.359628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 452/909] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:51:24 2022] GET /identity/v3/role_assignments?user.id=2627d6e89afa4774b0897bb0c619cd01&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=eef05f488f0548cd8907a60e41374b89 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:24.879894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66b0d7-a373-4345-a44e-4f45d85ad9ee None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:24.880417 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66b0d7-a373-4345-a44e-4f45d85ad9ee None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:24.880417 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f66b0d7-a373-4345-a44e-4f45d85ad9ee None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:24.882065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 458/910] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:24.888195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2743a-89c4-4945-9388-918061114d82 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:24.888598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2743a-89c4-4945-9388-918061114d82 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:24.888768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef2743a-89c4-4945-9388-918061114d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:24.895103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:24.908316 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-eef2743a-89c4-4945-9388-918061114d82 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:24.909511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-eef2743a-89c4-4945-9388-918061114d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:24.983791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 453/911] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:25.257444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66b0d7-a373-4345-a44e-4f45d85ad9ee None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:25.336388 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:25.370006 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f66b0d7-a373-4345-a44e-4f45d85ad9ee None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:25.407885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458cb7f-cdb8-40b3-97e2-d5dca71a70b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:25.408684 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458cb7f-cdb8-40b3-97e2-d5dca71a70b3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:25.409010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458cb7f-cdb8-40b3-97e2-d5dca71a70b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:25.409287 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8458cb7f-cdb8-40b3-97e2-d5dca71a70b3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:25.409868 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458cb7f-cdb8-40b3-97e2-d5dca71a70b3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:25.411212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8458cb7f-cdb8-40b3-97e2-d5dca71a70b3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8458cb7f-cdb8-40b3-97e2-d5dca71a70b3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:25.421332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:25.422267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:25.423178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 459/912] 10.222.0.62 () {56 vars in 1132 bytes} [Wed Aug 24 07:51:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:25.428428 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2743a-89c4-4945-9388-918061114d82 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:25.534392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef2743a-89c4-4945-9388-918061114d82 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:25.565550 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:25.572564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebd1d1-c53f-4a12-a660-f9cbb89abb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:25.573710 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebd1d1-c53f-4a12-a660-f9cbb89abb2f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:25.573984 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebd1d1-c53f-4a12-a660-f9cbb89abb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:25.574251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebd1d1-c53f-4a12-a660-f9cbb89abb2f None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:25.574884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebd1d1-c53f-4a12-a660-f9cbb89abb2f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:25.575188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebd1d1-c53f-4a12-a660-f9cbb89abb2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:25.576577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebd1d1-c53f-4a12-a660-f9cbb89abb2f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:25.581780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 454/913] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 24 07:51:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:25.587790 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458cb7f-cdb8-40b3-97e2-d5dca71a70b3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:25.692016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cdf29-e539-4784-8ff3-0535ed619aeb None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:25.692345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cdf29-e539-4784-8ff3-0535ed619aeb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:25.692566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906cdf29-e539-4784-8ff3-0535ed619aeb None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:25.692743 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8458cb7f-cdb8-40b3-97e2-d5dca71a70b3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:25.694230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 455/914] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:25.699877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f806f-7691-4af3-99f5-f89c1d13c23e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:25.700168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f806f-7691-4af3-99f5-f89c1d13c23e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:25.700447 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3f806f-7691-4af3-99f5-f89c1d13c23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:25.722156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-eb3f806f-7691-4af3-99f5-f89c1d13c23e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:25.723368 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-eb3f806f-7691-4af3-99f5-f89c1d13c23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:25.742646 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865f018-7bed-4d5d-9d84-ba1e0be05a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:25.743707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865f018-7bed-4d5d-9d84-ba1e0be05a5a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:25.744026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865f018-7bed-4d5d-9d84-ba1e0be05a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:25.744347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865f018-7bed-4d5d-9d84-ba1e0be05a5a None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:25.745133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865f018-7bed-4d5d-9d84-ba1e0be05a5a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:25.745365 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865f018-7bed-4d5d-9d84-ba1e0be05a5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:25.747454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865f018-7bed-4d5d-9d84-ba1e0be05a5a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:25.750320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:25.759939 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 460/915] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 24 07:51:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:25.762839 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865f018-7bed-4d5d-9d84-ba1e0be05a5a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:25.816080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 456/916] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:51:25.873648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865f018-7bed-4d5d-9d84-ba1e0be05a5a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:25.909519 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888894db-c5bf-4a28-890d-07c3197bd347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:25.910870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888894db-c5bf-4a28-890d-07c3197bd347 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:25.911373 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888894db-c5bf-4a28-890d-07c3197bd347 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:25.911826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888894db-c5bf-4a28-890d-07c3197bd347 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:25.912709 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888894db-c5bf-4a28-890d-07c3197bd347 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:25.914287 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888894db-c5bf-4a28-890d-07c3197bd347 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:25.992826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 461/917] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 07:51:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:51:26.090394 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f806f-7691-4af3-99f5-f89c1d13c23e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:26.205957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3f806f-7691-4af3-99f5-f89c1d13c23e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:26.206501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa55df-b723-4314-949c-350ffdc19240 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:26.206793 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa55df-b723-4314-949c-350ffdc19240 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:26.207076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fa55df-b723-4314-949c-350ffdc19240 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:26.211884 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 462/918] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:26.217213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efa759-cbe2-488e-85a3-1b5e417b5a38 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:26.217503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efa759-cbe2-488e-85a3-1b5e417b5a38 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:26.217778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efa759-cbe2-488e-85a3-1b5e417b5a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:26.237290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:26.240128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f8efa759-cbe2-488e-85a3-1b5e417b5a38 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:26.241660 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f8efa759-cbe2-488e-85a3-1b5e417b5a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:26.251937 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3b5ea-e077-4276-bc85-972c92b5c193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:26.252552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3b5ea-e077-4276-bc85-972c92b5c193 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:26.252832 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3b5ea-e077-4276-bc85-972c92b5c193 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:26.253097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3b5ea-e077-4276-bc85-972c92b5c193 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:26.253750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3b5ea-e077-4276-bc85-972c92b5c193 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:26.255098 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3b5ea-e077-4276-bc85-972c92b5c193 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:26.298801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:26.315749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 463/919] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:26.329026 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 457/920] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 24 07:51:26 2022] POST /identity/v3/services => generated 241 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:51:26.340612 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f754bc7-b51b-4f83-88a8-6316ec2ac04b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:26.340825 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f754bc7-b51b-4f83-88a8-6316ec2ac04b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:26.341071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f754bc7-b51b-4f83-88a8-6316ec2ac04b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:26.342940 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 464/921] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:26.348619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858aa0-c5e7-4659-abf2-28392c8b5d73 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:26.348900 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858aa0-c5e7-4659-abf2-28392c8b5d73 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:26.349199 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae858aa0-c5e7-4659-abf2-28392c8b5d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:26.369361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ae858aa0-c5e7-4659-abf2-28392c8b5d73 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:26.371159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ae858aa0-c5e7-4659-abf2-28392c8b5d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:26.461282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 458/922] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:26.605137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f754bc7-b51b-4f83-88a8-6316ec2ac04b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:26.708247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f754bc7-b51b-4f83-88a8-6316ec2ac04b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:26.729216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae858aa0-c5e7-4659-abf2-28392c8b5d73 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:26.753125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da40d22-a195-4e9f-af81-e51f453fe8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:26.753764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da40d22-a195-4e9f-af81-e51f453fe8d1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:26.754045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da40d22-a195-4e9f-af81-e51f453fe8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:26.754322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da40d22-a195-4e9f-af81-e51f453fe8d1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:26.755074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da40d22-a195-4e9f-af81-e51f453fe8d1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:26.756840 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da40d22-a195-4e9f-af81-e51f453fe8d1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-9da40d22-a195-4e9f-af81-e51f453fe8d1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:26.768888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:26.769870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:26.770722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 465/923] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:51:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:26.775804 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da40d22-a195-4e9f-af81-e51f453fe8d1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:26.849118 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:26.858967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae858aa0-c5e7-4659-abf2-28392c8b5d73 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:26.871413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:26.905355 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662007b-5980-4167-87b1-0ef016059c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:26.906707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662007b-5980-4167-87b1-0ef016059c6a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:26.907174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662007b-5980-4167-87b1-0ef016059c6a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:26.907643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662007b-5980-4167-87b1-0ef016059c6a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:26.908147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da40d22-a195-4e9f-af81-e51f453fe8d1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:26.922407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662007b-5980-4167-87b1-0ef016059c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-b662007b-5980-4167-87b1-0ef016059c6a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:26.929089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:26.930072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:26.930977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:26.930977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:26.930977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:26.930977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:26.930977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:26.930977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:26.930977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:26.930977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:26.930977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:26.930977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:26.930977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:51:26.930977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:26.934753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 459/924] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Aug 24 07:51:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:26.941787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662007b-5980-4167-87b1-0ef016059c6a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:26.951768 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a82f1-841e-40f2-9ef3-b723ce64e497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:26.952437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a82f1-841e-40f2-9ef3-b723ce64e497 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:26.952693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a82f1-841e-40f2-9ef3-b723ce64e497 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:26.952968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a82f1-841e-40f2-9ef3-b723ce64e497 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:26.953605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a82f1-841e-40f2-9ef3-b723ce64e497 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:26.953910 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a82f1-841e-40f2-9ef3-b723ce64e497 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:26.955803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84a82f1-841e-40f2-9ef3-b723ce64e497 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:26.963054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 466/925] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:51:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:26.968420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a82f1-841e-40f2-9ef3-b723ce64e497 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:27.054731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662007b-5980-4167-87b1-0ef016059c6a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:27.092728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aeb4c-fdc7-4929-bf32-6c36de194d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:27.093395 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aeb4c-fdc7-4929-bf32-6c36de194d8f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:27.093598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aeb4c-fdc7-4929-bf32-6c36de194d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:27.093868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aeb4c-fdc7-4929-bf32-6c36de194d8f None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:27.094532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aeb4c-fdc7-4929-bf32-6c36de194d8f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:27.094833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aeb4c-fdc7-4929-bf32-6c36de194d8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:27.096280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aeb4c-fdc7-4929-bf32-6c36de194d8f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:27.105046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 460/926] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Aug 24 07:51:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:27.110117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a82f1-841e-40f2-9ef3-b723ce64e497 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:27.110725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aeb4c-fdc7-4929-bf32-6c36de194d8f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:27.129135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:27.150421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:27.157992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57191076-f664-4bec-b8dd-a9ee3f29e65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:27.158663 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57191076-f664-4bec-b8dd-a9ee3f29e65d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:27.158949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57191076-f664-4bec-b8dd-a9ee3f29e65d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:27.159221 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57191076-f664-4bec-b8dd-a9ee3f29e65d None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:27.160160 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57191076-f664-4bec-b8dd-a9ee3f29e65d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:27.161844 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57191076-f664-4bec-b8dd-a9ee3f29e65d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:27.164498 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57191076-f664-4bec-b8dd-a9ee3f29e65d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:27.170576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 467/927] 10.222.0.62 () {56 vars in 1114 bytes} [Wed Aug 24 07:51:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:27.179906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57191076-f664-4bec-b8dd-a9ee3f29e65d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:27.237066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aeb4c-fdc7-4929-bf32-6c36de194d8f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:27.280854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57191076-f664-4bec-b8dd-a9ee3f29e65d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:27.284663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb556ff1-5cdf-4ebe-97fc-0f7d2c3db927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:27.285289 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb556ff1-5cdf-4ebe-97fc-0f7d2c3db927 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:27.285592 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb556ff1-5cdf-4ebe-97fc-0f7d2c3db927 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:27.285863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb556ff1-5cdf-4ebe-97fc-0f7d2c3db927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:27.301097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb556ff1-5cdf-4ebe-97fc-0f7d2c3db927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:27.303139 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb556ff1-5cdf-4ebe-97fc-0f7d2c3db927 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-bb556ff1-5cdf-4ebe-97fc-0f7d2c3db927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:27.322022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:27.323033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:27.324442 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:27.324442 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:27.324442 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:27.324442 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 461/928] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:27.326008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0918739-78ec-4086-a504-0d2437870aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:27.326667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0918739-78ec-4086-a504-0d2437870aa3 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:27.326948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0918739-78ec-4086-a504-0d2437870aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:27.327215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0918739-78ec-4086-a504-0d2437870aa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:27.328111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0918739-78ec-4086-a504-0d2437870aa3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:27.328877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb556ff1-5cdf-4ebe-97fc-0f7d2c3db927 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:27.330554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0918739-78ec-4086-a504-0d2437870aa3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:27.427345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:27.440686 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 468/929] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 07:51:27 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:51:27.455811 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb556ff1-5cdf-4ebe-97fc-0f7d2c3db927 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:27.506207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdc0f1-e19d-47a4-9cfd-0605c0123c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:27.506848 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdc0f1-e19d-47a4-9cfd-0605c0123c65 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:27.507132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdc0f1-e19d-47a4-9cfd-0605c0123c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:27.507402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bdc0f1-e19d-47a4-9cfd-0605c0123c65 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:27.508166 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bdc0f1-e19d-47a4-9cfd-0605c0123c65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:27.508468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bdc0f1-e19d-47a4-9cfd-0605c0123c65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:27.510035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bdc0f1-e19d-47a4-9cfd-0605c0123c65 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:27.523586 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 462/930] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:27.528985 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0918739-78ec-4086-a504-0d2437870aa3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:27.569401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:27.641485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0918739-78ec-4086-a504-0d2437870aa3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:27.678278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25561b4-b97c-43a0-a8db-24e4dadec1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:27.678916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25561b4-b97c-43a0-a8db-24e4dadec1da None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:27.679197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25561b4-b97c-43a0-a8db-24e4dadec1da None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:27.679470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25561b4-b97c-43a0-a8db-24e4dadec1da None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:27.687563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25561b4-b97c-43a0-a8db-24e4dadec1da None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:27.689073 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25561b4-b97c-43a0-a8db-24e4dadec1da None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f25561b4-b97c-43a0-a8db-24e4dadec1da None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:27.701900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:27.702885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:27.703873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:27.703873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:27.703873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:27.703873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:27.703873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:27.703873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:27.703873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:27.703873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:27.703873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:51:27.703873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:27.703873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 469/931] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 24 07:51:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:27.708671 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdc0f1-e19d-47a4-9cfd-0605c0123c65 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:27.828492 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bdc0f1-e19d-47a4-9cfd-0605c0123c65 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:27.865499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8955f096-ce06-4931-9762-005e89c5a103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:27.866120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955f096-ce06-4931-9762-005e89c5a103 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:27.866400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955f096-ce06-4931-9762-005e89c5a103 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:27.866670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8955f096-ce06-4931-9762-005e89c5a103 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:27.867399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955f096-ce06-4931-9762-005e89c5a103 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:27.867701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955f096-ce06-4931-9762-005e89c5a103 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:27.869143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8955f096-ce06-4931-9762-005e89c5a103 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:27.878081 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:27.888251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 463/932] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Aug 24 07:51:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:27.896285 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25561b4-b97c-43a0-a8db-24e4dadec1da None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:28.001717 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:28.009214 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25561b4-b97c-43a0-a8db-24e4dadec1da None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:28.011035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad2a99-dc6d-44ae-99f9-a10b07ea4d8a None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.011424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad2a99-dc6d-44ae-99f9-a10b07ea4d8a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.011707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad2a99-dc6d-44ae-99f9-a10b07ea4d8a None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.013367 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 464/933] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:28.018379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8c4e2-0fdb-4828-91a8-e106dfbaf439 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.018665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8c4e2-0fdb-4828-91a8-e106dfbaf439 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.019146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8c4e2-0fdb-4828-91a8-e106dfbaf439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.042561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-66c8c4e2-0fdb-4828-91a8-e106dfbaf439 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:28.043795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-66c8c4e2-0fdb-4828-91a8-e106dfbaf439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:28.054375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dabc68-ce51-4e8f-a665-cd0787574416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:28.055738 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dabc68-ce51-4e8f-a665-cd0787574416 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.056769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dabc68-ce51-4e8f-a665-cd0787574416 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.058048 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dabc68-ce51-4e8f-a665-cd0787574416 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.072022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dabc68-ce51-4e8f-a665-cd0787574416 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:28.074502 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dabc68-ce51-4e8f-a665-cd0787574416 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-c8dabc68-ce51-4e8f-a665-cd0787574416 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:28.093851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:28.095039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:28.096189 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:28.096189 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:28.096189 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:28.098557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 470/934] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:28.103525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dabc68-ce51-4e8f-a665-cd0787574416 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:28.135328 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 465/935] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:51:28.218988 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dabc68-ce51-4e8f-a665-cd0787574416 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:28.253735 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c93306-1da6-4399-9d11-3ad95bdb8150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:28.254577 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c93306-1da6-4399-9d11-3ad95bdb8150 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.255027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c93306-1da6-4399-9d11-3ad95bdb8150 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.255463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c93306-1da6-4399-9d11-3ad95bdb8150 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.256300 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c93306-1da6-4399-9d11-3ad95bdb8150 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:28.256750 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c93306-1da6-4399-9d11-3ad95bdb8150 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:28.258295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c93306-1da6-4399-9d11-3ad95bdb8150 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:28.271591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 471/936] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:28.277581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8c4e2-0fdb-4828-91a8-e106dfbaf439 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:28.384618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6442c2-c458-4330-9a56-6cd41093d952 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.387001 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6442c2-c458-4330-9a56-6cd41093d952 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.387427 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6442c2-c458-4330-9a56-6cd41093d952 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.389859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 472/937] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:28.394881 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc124-46c9-4972-a185-ffb0430c6edc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.395165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc124-46c9-4972-a185-ffb0430c6edc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.395440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc124-46c9-4972-a185-ffb0430c6edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.396292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8c4e2-0fdb-4828-91a8-e106dfbaf439 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:28.409977 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:28.417760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-52adc124-46c9-4972-a185-ffb0430c6edc None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:28.418947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-52adc124-46c9-4972-a185-ffb0430c6edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:28.425090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:28.434291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230e0bc-d8f7-40da-9144-ab44c4a32076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:28.434920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230e0bc-d8f7-40da-9144-ab44c4a32076 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.435196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230e0bc-d8f7-40da-9144-ab44c4a32076 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.435465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230e0bc-d8f7-40da-9144-ab44c4a32076 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.442019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230e0bc-d8f7-40da-9144-ab44c4a32076 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:28.443434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8230e0bc-d8f7-40da-9144-ab44c4a32076 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-8230e0bc-d8f7-40da-9144-ab44c4a32076 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:28.456286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:28.457251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:28.458146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:28.458146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:28.458146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:28.458146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:28.458146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:28.458146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:28.458146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:28.458146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:28.458146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 466/938] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:28.458146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230e0bc-d8f7-40da-9144-ab44c4a32076 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:28.495176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 473/939] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:51:28.496367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adc124-46c9-4972-a185-ffb0430c6edc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:28.586882 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230e0bc-d8f7-40da-9144-ab44c4a32076 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:28.619947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adc124-46c9-4972-a185-ffb0430c6edc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:28.623879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9bc26-685d-47f2-a57e-fc1f2b8d167f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:28.624780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9bc26-685d-47f2-a57e-fc1f2b8d167f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.625244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9bc26-685d-47f2-a57e-fc1f2b8d167f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.625697 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9bc26-685d-47f2-a57e-fc1f2b8d167f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.626460 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9bc26-685d-47f2-a57e-fc1f2b8d167f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:28.628024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9bc26-685d-47f2-a57e-fc1f2b8d167f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-36f9bc26-685d-47f2-a57e-fc1f2b8d167f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:28.638400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:28.639497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:28.640838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:28.640838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:28.640838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:28.640838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:28.640838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:28.640838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:28.640838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:28.640838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:28.640838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:28.640838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:28.640838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:28.640838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:28.640838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:51:28.640838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:28.648522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 467/940] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:28.649900 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9bc26-685d-47f2-a57e-fc1f2b8d167f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:28.658909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d5731-9426-46f9-8d57-861f72a62231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:28.659522 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d5731-9426-46f9-8d57-861f72a62231 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.659797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d5731-9426-46f9-8d57-861f72a62231 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.660142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663d5731-9426-46f9-8d57-861f72a62231 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.660824 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d5731-9426-46f9-8d57-861f72a62231 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:28.661178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d5731-9426-46f9-8d57-861f72a62231 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:28.662809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663d5731-9426-46f9-8d57-861f72a62231 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:28.665657 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:28.681919 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 474/941] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:28.683341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d5731-9426-46f9-8d57-861f72a62231 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:28.715213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:28.769964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9bc26-685d-47f2-a57e-fc1f2b8d167f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:28.791450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663d5731-9426-46f9-8d57-861f72a62231 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:28.809060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1e11c-d987-46ec-b1ff-253b864becfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:28.809855 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1e11c-d987-46ec-b1ff-253b864becfb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.810382 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1e11c-d987-46ec-b1ff-253b864becfb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.810803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1e11c-d987-46ec-b1ff-253b864becfb None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.811595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1e11c-d987-46ec-b1ff-253b864becfb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:28.812073 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1e11c-d987-46ec-b1ff-253b864becfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:28.813801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e1e11c-d987-46ec-b1ff-253b864becfb None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:28.818913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 468/942] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 24 07:51:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:28.819833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1e11c-d987-46ec-b1ff-253b864becfb None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:28.829535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848293e6-c6a6-484b-a1b7-f1b81807e6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:28.830195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848293e6-c6a6-484b-a1b7-f1b81807e6b9 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.830470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848293e6-c6a6-484b-a1b7-f1b81807e6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.830740 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848293e6-c6a6-484b-a1b7-f1b81807e6b9 None admin] PATH_INFO: `/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/2627d6e89afa4774b0897bb0c619cd01/roles/eef05f488f0548cd8907a60e41374b89` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.833313 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848293e6-c6a6-484b-a1b7-f1b81807e6b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1074e261454981a85d02b4b0f75ec5, user_id=2627d6e89afa4774b0897bb0c619cd01, role_id=eef05f488f0548cd8907a60e41374b89)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:28.835108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848293e6-c6a6-484b-a1b7-f1b81807e6b9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:28.920611 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1e11c-d987-46ec-b1ff-253b864becfb None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:28.939884 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 475/943] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:51:28 2022] PUT /identity/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/2627d6e89afa4774b0897bb0c619cd01/roles/eef05f488f0548cd8907a60e41374b89 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:51:28.939884 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848293e6-c6a6-484b-a1b7-f1b81807e6b9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:28.947412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:28.977171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b38d67-0153-488f-b1cb-8dd42a930f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:28.978161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b38d67-0153-488f-b1cb-8dd42a930f0e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:28.978610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b38d67-0153-488f-b1cb-8dd42a930f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:28.979347 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b38d67-0153-488f-b1cb-8dd42a930f0e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:28.980725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b38d67-0153-488f-b1cb-8dd42a930f0e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:28.982253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b38d67-0153-488f-b1cb-8dd42a930f0e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-b9b38d67-0153-488f-b1cb-8dd42a930f0e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:28.995007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:28.996356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:28.997356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 469/944] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 24 07:51:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:29.003513 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b38d67-0153-488f-b1cb-8dd42a930f0e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:29.016476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:29.082088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848293e6-c6a6-484b-a1b7-f1b81807e6b9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:29.125941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265805f-310f-4621-bd17-e3b12f076eda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:29.126660 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265805f-310f-4621-bd17-e3b12f076eda None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:29.127005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265805f-310f-4621-bd17-e3b12f076eda None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:29.127281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265805f-310f-4621-bd17-e3b12f076eda None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:29.129626 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265805f-310f-4621-bd17-e3b12f076eda None admin] RBAC: Adding query filter params (type=compute) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:29.129626 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265805f-310f-4621-bd17-e3b12f076eda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:29.129626 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265805f-310f-4621-bd17-e3b12f076eda None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:29.130142 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b38d67-0153-488f-b1cb-8dd42a930f0e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:29.138661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 476/945] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 24 07:51:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:29.170801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea4ee9-ced0-4461-8621-94dfea6c40cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:29.171523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea4ee9-ced0-4461-8621-94dfea6c40cf None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:29.171771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea4ee9-ced0-4461-8621-94dfea6c40cf None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:29.172133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea4ee9-ced0-4461-8621-94dfea6c40cf None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:29.172790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea4ee9-ced0-4461-8621-94dfea6c40cf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:29.173097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea4ee9-ced0-4461-8621-94dfea6c40cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:29.174497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea4ee9-ced0-4461-8621-94dfea6c40cf None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:29.180773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 470/946] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 24 07:51:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:29.186906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265805f-310f-4621-bd17-e3b12f076eda None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:29.307173 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265805f-310f-4621-bd17-e3b12f076eda None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:29.329326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:29.346801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab76b43-d85e-4b25-b692-0b62bd087398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:29.346801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab76b43-d85e-4b25-b692-0b62bd087398 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:29.346801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab76b43-d85e-4b25-b692-0b62bd087398 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:29.346801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab76b43-d85e-4b25-b692-0b62bd087398 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:29.347424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab76b43-d85e-4b25-b692-0b62bd087398 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:29.347424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab76b43-d85e-4b25-b692-0b62bd087398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:29.348765 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab76b43-d85e-4b25-b692-0b62bd087398 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:29.355163 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 477/947] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 24 07:51:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:29.360690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea4ee9-ced0-4461-8621-94dfea6c40cf None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:29.418298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:29.479263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea4ee9-ced0-4461-8621-94dfea6c40cf None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:29.509822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2cc22-55d3-4530-ad41-c0363163939b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:29.510111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2cc22-55d3-4530-ad41-c0363163939b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:29.510988 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af2cc22-55d3-4530-ad41-c0363163939b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:29.512639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 478/948] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:29.516106 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e19d9-6cf6-4884-b481-04fe6a6d5b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:29.517007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e19d9-6cf6-4884-b481-04fe6a6d5b1a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:29.517453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e19d9-6cf6-4884-b481-04fe6a6d5b1a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:29.517728 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3498a-cc11-4a39-bd8d-4f05c373de54 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:29.518017 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3498a-cc11-4a39-bd8d-4f05c373de54 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:29.518211 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e19d9-6cf6-4884-b481-04fe6a6d5b1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:29.518318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab3498a-cc11-4a39-bd8d-4f05c373de54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:29.519137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e19d9-6cf6-4884-b481-04fe6a6d5b1a None admin] RBAC: Adding query filter params (interface=public, service_id=59add875a5ff410a9571e7b879f0deb8, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:29.519600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e19d9-6cf6-4884-b481-04fe6a6d5b1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:29.521197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611e19d9-6cf6-4884-b481-04fe6a6d5b1a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:29.534505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 471/949] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 24 07:51:29 2022] GET /identity/v3/endpoints?service_id=59add875a5ff410a9571e7b879f0deb8&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:29.536286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e19d9-6cf6-4884-b481-04fe6a6d5b1a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:29.539722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-dab3498a-cc11-4a39-bd8d-4f05c373de54 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:29.540951 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dab3498a-cc11-4a39-bd8d-4f05c373de54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:29.623692 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 479/950] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:29.658644 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e19d9-6cf6-4884-b481-04fe6a6d5b1a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:29.668878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:29.693903 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd33be-eba6-4be2-b103-7b96052aa1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:29.694740 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd33be-eba6-4be2-b103-7b96052aa1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:29.695528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd33be-eba6-4be2-b103-7b96052aa1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:29.696064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd33be-eba6-4be2-b103-7b96052aa1e6 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:29.697155 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd33be-eba6-4be2-b103-7b96052aa1e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:29.699873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfd33be-eba6-4be2-b103-7b96052aa1e6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:29.706222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 472/951] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 24 07:51:29 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:51:29.919301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3498a-cc11-4a39-bd8d-4f05c373de54 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:30.020397 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab3498a-cc11-4a39-bd8d-4f05c373de54 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:30.034890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:30.058351 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566a84e-5afc-46ad-b6ac-29da4954b5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:30.059428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a84e-5afc-46ad-b6ac-29da4954b5c5 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:30.059893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a84e-5afc-46ad-b6ac-29da4954b5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:30.060333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5566a84e-5afc-46ad-b6ac-29da4954b5c5 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:30.061132 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566a84e-5afc-46ad-b6ac-29da4954b5c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:30.062738 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5566a84e-5afc-46ad-b6ac-29da4954b5c5 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:30.065526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: WARNING keystone.server.flask.common [None req-5566a84e-5afc-46ad-b6ac-29da4954b5c5 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 07:51:30.111539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.sql.core [None req-5566a84e-5afc-46ad-b6ac-29da4954b5c5 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 07:51:30.111539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 07:51:30.111539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [parameters: {'id': '33ac10a097e34514a5124540414028f8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 07:51:30.111539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81603) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 07:51:30.129501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5566a84e-5afc-46ad-b6ac-29da4954b5c5 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 33ac10a097e34514a5124540414028f8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 33ac10a097e34514a5124540414028f8. Aug 24 07:51:30.129501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:30.129501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:51:30.129501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:51:30.129501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:51:30.129501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:51:30.129501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:51:30.129501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:51:30.129501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:51:30.129501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:51:30.129501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:51:30.129501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:51:30.129501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result.read() Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 07:51:30.130606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application yield resource Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise self.value Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application session.commit() Aug 24 07:51:30.131856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.session.flush() Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application compat.raise_( Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 07:51:30.133024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 07:51:30.134238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result.read() Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:51:30.135914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [parameters: {'id': '33ac10a097e34514a5124540414028f8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:30.136831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:30.137644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:30.138619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:30.138619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 07:51:30.138619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 07:51:30.138619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:30.138619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:30.138619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 07:51:30.138619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 07:51:30.138619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 33ac10a097e34514a5124540414028f8. Aug 24 07:51:30.138619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:30.141281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 480/952] 10.222.0.62 () {60 vars in 1140 bytes} [Wed Aug 24 07:51:29 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:30.149468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd33be-eba6-4be2-b103-7b96052aa1e6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:30.257520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd33be-eba6-4be2-b103-7b96052aa1e6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:30.293485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e1beb-f3db-43c6-a31b-840c61cb356e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:30.294340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e1beb-f3db-43c6-a31b-840c61cb356e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:30.294795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e1beb-f3db-43c6-a31b-840c61cb356e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:30.295214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e1beb-f3db-43c6-a31b-840c61cb356e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:30.302126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e1beb-f3db-43c6-a31b-840c61cb356e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:30.303698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e1beb-f3db-43c6-a31b-840c61cb356e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-fc3e1beb-f3db-43c6-a31b-840c61cb356e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:30.315828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:30.317064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:30.318296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:30.318296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:30.318296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:30.318296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:30.318296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:30.318296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:30.318296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:30.318296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:30.320447 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 473/953] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:30.327029 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566a84e-5afc-46ad-b6ac-29da4954b5c5 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:30.435781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5566a84e-5afc-46ad-b6ac-29da4954b5c5 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:30.472687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ca6e2-7af1-4b99-91c0-398525bfda8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:30.473291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ca6e2-7af1-4b99-91c0-398525bfda8f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:30.473568 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ca6e2-7af1-4b99-91c0-398525bfda8f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:30.473911 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ca6e2-7af1-4b99-91c0-398525bfda8f None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:30.474567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ca6e2-7af1-4b99-91c0-398525bfda8f None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:30.474868 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ca6e2-7af1-4b99-91c0-398525bfda8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:30.476524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ca6e2-7af1-4b99-91c0-398525bfda8f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:30.497875 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 481/954] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 24 07:51:30 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:31.009002 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b9cf-62fc-4139-8d87-1f85a130b0a9 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:31.009646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b9cf-62fc-4139-8d87-1f85a130b0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:31.010669 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4b9cf-62fc-4139-8d87-1f85a130b0a9 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:31.012702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 474/955] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:31.018525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db36c5-2cd5-4327-87e2-2196e162e649 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:31.019042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db36c5-2cd5-4327-87e2-2196e162e649 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:31.019520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db36c5-2cd5-4327-87e2-2196e162e649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:31.038908 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e1db36c5-2cd5-4327-87e2-2196e162e649 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:31.041208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e1db36c5-2cd5-4327-87e2-2196e162e649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:31.066955 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:31.115125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 482/956] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:31.198808 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472bf95-bb83-4f5e-8c9d-19bf78af070f None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:31.199186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472bf95-bb83-4f5e-8c9d-19bf78af070f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:31.199380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6472bf95-bb83-4f5e-8c9d-19bf78af070f None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:31.201060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 475/957] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:31.209360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820173a-58e5-4323-87db-ccc18ca1a456 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:31.209754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820173a-58e5-4323-87db-ccc18ca1a456 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:31.210127 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820173a-58e5-4323-87db-ccc18ca1a456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:31.229698 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0820173a-58e5-4323-87db-ccc18ca1a456 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:31.230979 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0820173a-58e5-4323-87db-ccc18ca1a456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:31.307888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 483/958] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:31.383633 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472bf95-bb83-4f5e-8c9d-19bf78af070f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:31.415832 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:31.491689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6472bf95-bb83-4f5e-8c9d-19bf78af070f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:31.527059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79682711-5665-4df5-b87b-39d4541a5224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:31.527690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79682711-5665-4df5-b87b-39d4541a5224 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:31.528004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79682711-5665-4df5-b87b-39d4541a5224 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:31.528279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79682711-5665-4df5-b87b-39d4541a5224 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:31.538609 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79682711-5665-4df5-b87b-39d4541a5224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-79682711-5665-4df5-b87b-39d4541a5224 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:31.544118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:31.545090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:31.546454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:31.546454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:31.546454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:31.546454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:31.546454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:31.546454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:31.546454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:31.546454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:31.546454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:31.546454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:31.546454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:51:31.546454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:31.546454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 476/959] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Aug 24 07:51:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:31.551012 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820173a-58e5-4323-87db-ccc18ca1a456 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:31.598380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79682711-5665-4df5-b87b-39d4541a5224 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:31.663561 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:31.673687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820173a-58e5-4323-87db-ccc18ca1a456 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:31.700624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:31.709745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12078a5-d143-403f-8ecd-e47f1aa77b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:31.710124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79682711-5665-4df5-b87b-39d4541a5224 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:31.710359 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12078a5-d143-403f-8ecd-e47f1aa77b9a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:31.710638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12078a5-d143-403f-8ecd-e47f1aa77b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:31.710911 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12078a5-d143-403f-8ecd-e47f1aa77b9a None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:31.711575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12078a5-d143-403f-8ecd-e47f1aa77b9a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:31.711900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12078a5-d143-403f-8ecd-e47f1aa77b9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:31.714127 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12078a5-d143-403f-8ecd-e47f1aa77b9a None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:31.728137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 484/960] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Aug 24 07:51:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:31.729314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275a644-7d48-4d5c-a14d-a96ba11be08e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:31.729601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275a644-7d48-4d5c-a14d-a96ba11be08e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:31.729878 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275a644-7d48-4d5c-a14d-a96ba11be08e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:31.731238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 485/961] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:31.732512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275a644-7d48-4d5c-a14d-a96ba11be08e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:31.750563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b6523-3091-42d6-9100-685e1723a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:31.751175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b6523-3091-42d6-9100-685e1723a8f0 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:31.751456 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b6523-3091-42d6-9100-685e1723a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:31.751730 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b6523-3091-42d6-9100-685e1723a8f0 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:31.752426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b6523-3091-42d6-9100-685e1723a8f0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:31.753772 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6b6523-3091-42d6-9100-685e1723a8f0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:31.827895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 477/962] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 24 07:51:31 2022] POST /identity/v3/services => generated 242 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:51:31.829503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f0ccf-abd3-4473-9194-8d808952c08a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:31.829856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f0ccf-abd3-4473-9194-8d808952c08a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:31.830224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f0ccf-abd3-4473-9194-8d808952c08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:31.859501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-035f0ccf-abd3-4473-9194-8d808952c08a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:31.859690 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275a644-7d48-4d5c-a14d-a96ba11be08e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:31.861179 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-035f0ccf-abd3-4473-9194-8d808952c08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:31.908821 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7459c-6496-4c06-82ec-95261e1fdc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:31.910139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7459c-6496-4c06-82ec-95261e1fdc3d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:31.911613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7459c-6496-4c06-82ec-95261e1fdc3d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:31.912128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d7459c-6496-4c06-82ec-95261e1fdc3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:31.927220 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7459c-6496-4c06-82ec-95261e1fdc3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:31.929408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d7459c-6496-4c06-82ec-95261e1fdc3d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:31.948682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:31.960061 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 478/963] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-67d7459c-6496-4c06-82ec-95261e1fdc3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:31.961231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:31.962924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:31.971555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:31.971555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:31.971555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:31.971555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 486/964] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:31.973810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f0ccf-abd3-4473-9194-8d808952c08a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:32.072205 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:32.081726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f0ccf-abd3-4473-9194-8d808952c08a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:32.118519 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179144f8-f595-45df-acce-1a2deb874713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:32.119058 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179144f8-f595-45df-acce-1a2deb874713 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:32.120161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179144f8-f595-45df-acce-1a2deb874713 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:32.120436 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179144f8-f595-45df-acce-1a2deb874713 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:32.121088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179144f8-f595-45df-acce-1a2deb874713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:32.121387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179144f8-f595-45df-acce-1a2deb874713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:32.122804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179144f8-f595-45df-acce-1a2deb874713 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:32.134772 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 479/965] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:32.141048 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7459c-6496-4c06-82ec-95261e1fdc3d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:32.240700 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179144f8-f595-45df-acce-1a2deb874713 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:32.249065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d7459c-6496-4c06-82ec-95261e1fdc3d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:32.284425 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990da5f-7b41-455b-88bf-1fe5fa648871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:32.285480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990da5f-7b41-455b-88bf-1fe5fa648871 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:32.286026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990da5f-7b41-455b-88bf-1fe5fa648871 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:32.286556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0990da5f-7b41-455b-88bf-1fe5fa648871 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:32.295868 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990da5f-7b41-455b-88bf-1fe5fa648871 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:32.299867 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0990da5f-7b41-455b-88bf-1fe5fa648871 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-0990da5f-7b41-455b-88bf-1fe5fa648871 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:32.310151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:32.311162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:32.312188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:32.312188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:32.312188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:32.312188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:32.312188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:32.312188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:32.312188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:32.312188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:32.312188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 07:51:32.312188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:32.312188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 487/966] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 24 07:51:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:32.317380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990da5f-7b41-455b-88bf-1fe5fa648871 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:32.364702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179144f8-f595-45df-acce-1a2deb874713 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:32.391883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:32.421983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836b29f-fa30-4dc5-a154-0a835965fb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:32.423326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836b29f-fa30-4dc5-a154-0a835965fb97 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:32.424218 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836b29f-fa30-4dc5-a154-0a835965fb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:32.424650 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836b29f-fa30-4dc5-a154-0a835965fb97 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:32.425411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836b29f-fa30-4dc5-a154-0a835965fb97 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:32.427562 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a836b29f-fa30-4dc5-a154-0a835965fb97 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-a836b29f-fa30-4dc5-a154-0a835965fb97 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:32.439245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:32.440662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:32.441574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:32.441574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:32.441574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:32.441574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:32.441574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:32.441574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:32.441574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:32.441574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:32.441574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:32.441574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:32.441574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:32.441574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:32.441574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:32.441574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:32.442819 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 480/967] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 24 07:51:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:32.447539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0990da5f-7b41-455b-88bf-1fe5fa648871 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:32.456751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836b29f-fa30-4dc5-a154-0a835965fb97 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:32.463933 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:32.487992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59752dbf-6ec0-4d7f-955b-c7c99cdf3093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:32.491261 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59752dbf-6ec0-4d7f-955b-c7c99cdf3093 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:32.491261 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59752dbf-6ec0-4d7f-955b-c7c99cdf3093 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:32.491261 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59752dbf-6ec0-4d7f-955b-c7c99cdf3093 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:32.491261 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59752dbf-6ec0-4d7f-955b-c7c99cdf3093 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:32.491261 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59752dbf-6ec0-4d7f-955b-c7c99cdf3093 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:32.492702 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59752dbf-6ec0-4d7f-955b-c7c99cdf3093 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:32.514471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 488/968] 10.222.0.62 () {56 vars in 1149 bytes} [Wed Aug 24 07:51:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:32.519642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59752dbf-6ec0-4d7f-955b-c7c99cdf3093 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:32.587374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836b29f-fa30-4dc5-a154-0a835965fb97 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:32.623511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0d857-9a2c-4248-aac7-890583c53af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:32.624151 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0d857-9a2c-4248-aac7-890583c53af2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:32.624432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0d857-9a2c-4248-aac7-890583c53af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:32.624707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0d857-9a2c-4248-aac7-890583c53af2 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:32.625333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0d857-9a2c-4248-aac7-890583c53af2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:32.625635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0d857-9a2c-4248-aac7-890583c53af2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:32.626992 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0d857-9a2c-4248-aac7-890583c53af2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:32.627858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59752dbf-6ec0-4d7f-955b-c7c99cdf3093 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:32.632498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 481/969] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 24 07:51:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:32.638956 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d7b2-841b-4430-b31b-c7b7e98db60e None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:32.639182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d7b2-841b-4430-b31b-c7b7e98db60e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:32.639457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef8d7b2-841b-4430-b31b-c7b7e98db60e None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:32.643976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 482/970] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:32.643976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8d7b2-841b-4430-b31b-c7b7e98db60e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:32.649384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:32.667387 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0ec9c-286a-4f70-9c8a-c7df951657b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:32.668037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0ec9c-286a-4f70-9c8a-c7df951657b7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:32.668319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0ec9c-286a-4f70-9c8a-c7df951657b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:32.668590 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0ec9c-286a-4f70-9c8a-c7df951657b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:32.717952 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:32.742922 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0ec9c-286a-4f70-9c8a-c7df951657b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:32.744478 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0ec9c-286a-4f70-9c8a-c7df951657b7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:32.753978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef8d7b2-841b-4430-b31b-c7b7e98db60e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:32.789897 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cf44be-2d0e-4e94-a7b8-7ef3c9023b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:32.790533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf44be-2d0e-4e94-a7b8-7ef3c9023b96 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:32.790815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf44be-2d0e-4e94-a7b8-7ef3c9023b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:32.791088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cf44be-2d0e-4e94-a7b8-7ef3c9023b96 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:32.792385 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf44be-2d0e-4e94-a7b8-7ef3c9023b96 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:32.792794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf44be-2d0e-4e94-a7b8-7ef3c9023b96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:32.794163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cf44be-2d0e-4e94-a7b8-7ef3c9023b96 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:32.803875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 483/971] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 24 07:51:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:32.803875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb4811-954f-410e-9a0f-55f60624608d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:32.803875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb4811-954f-410e-9a0f-55f60624608d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:32.803875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fb4811-954f-410e-9a0f-55f60624608d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:32.819818 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b0fb4811-954f-410e-9a0f-55f60624608d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:32.821025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b0fb4811-954f-410e-9a0f-55f60624608d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:32.860424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 489/972] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:51:32 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:51:32.861622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0ec9c-286a-4f70-9c8a-c7df951657b7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:32.882527 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:32.899940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 484/973] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:32 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:32.899940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb4811-954f-410e-9a0f-55f60624608d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:32.980383 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:32.981631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0ec9c-286a-4f70-9c8a-c7df951657b7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:33.025276 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c838dc7-162a-479f-a135-7f33034c4d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:33.026431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c838dc7-162a-479f-a135-7f33034c4d5d None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:33.026716 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c838dc7-162a-479f-a135-7f33034c4d5d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:33.026994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c838dc7-162a-479f-a135-7f33034c4d5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:33.028113 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c838dc7-162a-479f-a135-7f33034c4d5d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:33.029773 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c838dc7-162a-479f-a135-7f33034c4d5d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:33.030730 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fb4811-954f-410e-9a0f-55f60624608d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:33.066568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9a359-f654-43bc-b069-8ee4c3d2377a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:33.067293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9a359-f654-43bc-b069-8ee4c3d2377a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:33.067637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9a359-f654-43bc-b069-8ee4c3d2377a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:33.067999 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9a359-f654-43bc-b069-8ee4c3d2377a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:33.078955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9a359-f654-43bc-b069-8ee4c3d2377a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:33.080405 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9a359-f654-43bc-b069-8ee4c3d2377a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-11b9a359-f654-43bc-b069-8ee4c3d2377a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:33.095403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:33.096685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:33.097608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:33.097608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:33.097608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:33.097608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 485/974] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:33.102654 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9a359-f654-43bc-b069-8ee4c3d2377a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:33.116242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 490/975] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 07:51:32 2022] POST /identity/v3/endpoints => generated 349 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:51:33.189114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c838dc7-162a-479f-a135-7f33034c4d5d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:33.225033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9a359-f654-43bc-b069-8ee4c3d2377a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:33.241198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:33.270864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec740d57-12bb-44fc-b304-438e7d43d955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:33.271799 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740d57-12bb-44fc-b304-438e7d43d955 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:33.272439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740d57-12bb-44fc-b304-438e7d43d955 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:33.273158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec740d57-12bb-44fc-b304-438e7d43d955 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:33.273949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec740d57-12bb-44fc-b304-438e7d43d955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:33.274326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec740d57-12bb-44fc-b304-438e7d43d955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:33.276392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec740d57-12bb-44fc-b304-438e7d43d955 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:33.282795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:33.289943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 486/976] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:33.296440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec740d57-12bb-44fc-b304-438e7d43d955 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:33.313092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c838dc7-162a-479f-a135-7f33034c4d5d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:33.353307 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8543c-427c-4f79-b31b-469a81c82453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:33.353967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8543c-427c-4f79-b31b-469a81c82453 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:33.354249 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8543c-427c-4f79-b31b-469a81c82453 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:33.354554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8543c-427c-4f79-b31b-469a81c82453 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:33.355339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8543c-427c-4f79-b31b-469a81c82453 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:33.356780 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8543c-427c-4f79-b31b-469a81c82453 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:33.403196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.sql.core [None req-58d8543c-427c-4f79-b31b-469a81c82453 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 07:51:33.403196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 07:51:33.403196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [parameters: {'user_id': 'b9308a3605a94a11b09e5209eef3293a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 07:51:33.403196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81603) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-58d8543c-427c-4f79-b31b-469a81c82453 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result.read() Aug 24 07:51:33.411328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:51:33.412284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application yield resource Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application next(self.gen) Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise self.value Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application session.commit() Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 07:51:33.413337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.session.flush() Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application compat.raise_( Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 07:51:33.414781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 07:51:33.415759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application conn.query(q) Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application result.read() Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 07:51:33.417753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b9308a3605a94a11b09e5209eef3293a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:33.419943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 07:51:33.422495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 07:51:33.425601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 07:51:33.425601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 07:51:33.425601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 07:51:33.425601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 07:51:33.425601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 07:51:33.425601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:33.425601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 491/977] 10.222.0.62 () {60 vars in 1131 bytes} [Wed Aug 24 07:51:33 2022] POST /identity/v3/users => generated 160 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:33.425601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8543c-427c-4f79-b31b-469a81c82453 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:33.447362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec740d57-12bb-44fc-b304-438e7d43d955 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:33.487959 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719d15-58c3-4731-8ae8-eb2d64b667ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:33.489151 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719d15-58c3-4731-8ae8-eb2d64b667ba None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:33.489667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719d15-58c3-4731-8ae8-eb2d64b667ba None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:33.490202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e719d15-58c3-4731-8ae8-eb2d64b667ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:33.498082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e719d15-58c3-4731-8ae8-eb2d64b667ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:33.500034 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e719d15-58c3-4731-8ae8-eb2d64b667ba None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-5e719d15-58c3-4731-8ae8-eb2d64b667ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:33.513713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:33.514709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:33.515625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:33.515625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:33.515625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:33.515625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:33.515625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:33.515625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:33.515625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:33.515625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:33.518382 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 487/978] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:33.526355 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719d15-58c3-4731-8ae8-eb2d64b667ba None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:33.526569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8543c-427c-4f79-b31b-469a81c82453 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:33.555641 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:33.563529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0fe6d-5d71-44ed-8cce-1470fc76b760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:33.567400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0fe6d-5d71-44ed-8cce-1470fc76b760 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:33.567400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0fe6d-5d71-44ed-8cce-1470fc76b760 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:33.567400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0fe6d-5d71-44ed-8cce-1470fc76b760 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:33.568497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:33.573998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0fe6d-5d71-44ed-8cce-1470fc76b760 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:33.575618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0fe6d-5d71-44ed-8cce-1470fc76b760 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d8f0fe6d-5d71-44ed-8cce-1470fc76b760 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:33.589664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:33.590643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:33.591724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:33.591724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:33.591724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:33.591724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:33.591724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:33.591724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:33.591724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:33.591724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:33.591724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 07:51:33.591724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:33.595613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 492/979] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:51:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:33.596608 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0fe6d-5d71-44ed-8cce-1470fc76b760 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:33.640305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e719d15-58c3-4731-8ae8-eb2d64b667ba None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:33.688067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf2e06-57c3-465c-bd67-186954a65f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:33.688699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf2e06-57c3-465c-bd67-186954a65f7e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:33.689049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf2e06-57c3-465c-bd67-186954a65f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:33.689321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf2e06-57c3-465c-bd67-186954a65f7e None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:33.690013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf2e06-57c3-465c-bd67-186954a65f7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:33.690314 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf2e06-57c3-465c-bd67-186954a65f7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:33.691724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaf2e06-57c3-465c-bd67-186954a65f7e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:33.713189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 488/980] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:33.714782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf2e06-57c3-465c-bd67-186954a65f7e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:33.727787 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0fe6d-5d71-44ed-8cce-1470fc76b760 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:33.775071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abff88-a524-4bb2-baea-4c3084c3ff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:33.775883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abff88-a524-4bb2-baea-4c3084c3ff5e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:33.776162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abff88-a524-4bb2-baea-4c3084c3ff5e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:33.776433 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abff88-a524-4bb2-baea-4c3084c3ff5e None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:33.777135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abff88-a524-4bb2-baea-4c3084c3ff5e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:33.777435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abff88-a524-4bb2-baea-4c3084c3ff5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:33.779594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abff88-a524-4bb2-baea-4c3084c3ff5e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:33.816905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:33.828554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf2e06-57c3-465c-bd67-186954a65f7e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:33.830812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 493/981] 10.222.0.62 () {56 vars in 1101 bytes} [Wed Aug 24 07:51:33 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:33.871902 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7eca7-31e8-4e3d-abf1-1b693c3aa163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:33.872905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7eca7-31e8-4e3d-abf1-1b693c3aa163 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:33.873391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7eca7-31e8-4e3d-abf1-1b693c3aa163 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:33.873865 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e7eca7-31e8-4e3d-abf1-1b693c3aa163 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:33.874892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7eca7-31e8-4e3d-abf1-1b693c3aa163 None admin] RBAC: Adding query filter params (role.id=eef05f488f0548cd8907a60e41374b89, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=2627d6e89afa4774b0897bb0c619cd01) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:33.875429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7eca7-31e8-4e3d-abf1-1b693c3aa163 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:33.877149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e7eca7-31e8-4e3d-abf1-1b693c3aa163 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:33.882117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb585-74e1-44cb-b521-c77f4a079ef5 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:33.882406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb585-74e1-44cb-b521-c77f4a079ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:33.882666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dfb585-74e1-44cb-b521-c77f4a079ef5 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:33.884315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 494/982] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:33.886204 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 489/983] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:51:33 2022] GET /identity/v3/role_assignments?user.id=2627d6e89afa4774b0897bb0c619cd01&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=eef05f488f0548cd8907a60e41374b89 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:33.894098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1501b-7f61-4e6b-8706-816791ecfd05 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:33.894647 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1501b-7f61-4e6b-8706-816791ecfd05 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:33.895067 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1501b-7f61-4e6b-8706-816791ecfd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:33.917495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cec1501b-7f61-4e6b-8706-816791ecfd05 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:33.919490 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cec1501b-7f61-4e6b-8706-816791ecfd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:33.980966 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:34.002607 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 495/984] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:33 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:34.278496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7eca7-31e8-4e3d-abf1-1b693c3aa163 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:34.386107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e7eca7-31e8-4e3d-abf1-1b693c3aa163 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:34.420878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ef27-defb-4ca4-87a1-13dcadd24a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:34.421511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ef27-defb-4ca4-87a1-13dcadd24a1e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:34.421791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ef27-defb-4ca4-87a1-13dcadd24a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:34.422061 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ef27-defb-4ca4-87a1-13dcadd24a1e None admin] PATH_INFO: `/v3/services/compute` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:34.422638 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4ef27-defb-4ca4-87a1-13dcadd24a1e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:34.424011 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4ef27-defb-4ca4-87a1-13dcadd24a1e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-9ec4ef27-defb-4ca4-87a1-13dcadd24a1e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:34.433187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:34.434246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:34.435123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 490/985] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:34 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:34.441786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1501b-7f61-4e6b-8706-816791ecfd05 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:34.545395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1501b-7f61-4e6b-8706-816791ecfd05 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:34.580704 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256f26f-fe83-4557-94ab-18f8c9ff7a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:34.581461 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256f26f-fe83-4557-94ab-18f8c9ff7a31 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:34.581847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256f26f-fe83-4557-94ab-18f8c9ff7a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:34.582226 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256f26f-fe83-4557-94ab-18f8c9ff7a31 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:34.582973 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256f26f-fe83-4557-94ab-18f8c9ff7a31 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:34.583381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256f26f-fe83-4557-94ab-18f8c9ff7a31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:34.584887 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a256f26f-fe83-4557-94ab-18f8c9ff7a31 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:34.595215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 496/986] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 24 07:51:34 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:34.596843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ef27-defb-4ca4-87a1-13dcadd24a1e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:34.617266 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:34.701272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ef27-defb-4ca4-87a1-13dcadd24a1e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:34.735783 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d31c4-6ec8-4ca7-bd2f-dc6dd6accdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:34.736415 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d31c4-6ec8-4ca7-bd2f-dc6dd6accdd8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:34.736690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d31c4-6ec8-4ca7-bd2f-dc6dd6accdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:34.736957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0d31c4-6ec8-4ca7-bd2f-dc6dd6accdd8 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:34.737575 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d31c4-6ec8-4ca7-bd2f-dc6dd6accdd8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:34.737873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d31c4-6ec8-4ca7-bd2f-dc6dd6accdd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:34.739217 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0d31c4-6ec8-4ca7-bd2f-dc6dd6accdd8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:34.747915 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 491/987] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 24 07:51:34 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:34.751333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256f26f-fe83-4557-94ab-18f8c9ff7a31 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:34.801989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:34.852630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a256f26f-fe83-4557-94ab-18f8c9ff7a31 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:34.885945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970e204-6ba5-429a-b9fb-e767b76840ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:34.886544 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e204-6ba5-429a-b9fb-e767b76840ec None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:34.886820 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e204-6ba5-429a-b9fb-e767b76840ec None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:34.887087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970e204-6ba5-429a-b9fb-e767b76840ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:34.887883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970e204-6ba5-429a-b9fb-e767b76840ec None admin] RBAC: Adding query filter params (interface=public, service_id=a728deb24a3c40ed990a9c021356338b, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:34.888197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970e204-6ba5-429a-b9fb-e767b76840ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:34.889544 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970e204-6ba5-429a-b9fb-e767b76840ec None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:34.899225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 497/988] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 24 07:51:34 2022] GET /identity/v3/endpoints?service_id=a728deb24a3c40ed990a9c021356338b&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:34.900889 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d31c4-6ec8-4ca7-bd2f-dc6dd6accdd8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:34.987135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:35.005938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0d31c4-6ec8-4ca7-bd2f-dc6dd6accdd8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:35.042172 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c446e72-e27c-4b56-ac02-7cb09d032893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:35.042937 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c446e72-e27c-4b56-ac02-7cb09d032893 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:35.043218 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c446e72-e27c-4b56-ac02-7cb09d032893 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:35.043489 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c446e72-e27c-4b56-ac02-7cb09d032893 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:35.044123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c446e72-e27c-4b56-ac02-7cb09d032893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:35.045476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c446e72-e27c-4b56-ac02-7cb09d032893 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:35.055943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 492/989] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 24 07:51:34 2022] GET /identity/v3/services => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:51:35.125086 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1457b1-91d1-490f-bedf-8847ebab5ff7 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:35.125394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1457b1-91d1-490f-bedf-8847ebab5ff7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:35.125677 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1457b1-91d1-490f-bedf-8847ebab5ff7 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:35.127246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 498/990] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:35.132741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3a3d6-fb8a-4feb-a526-9ae83c05cb2c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:35.133022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3a3d6-fb8a-4feb-a526-9ae83c05cb2c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:35.133293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf3a3d6-fb8a-4feb-a526-9ae83c05cb2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:35.153011 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5cf3a3d6-fb8a-4feb-a526-9ae83c05cb2c None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:35.154231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5cf3a3d6-fb8a-4feb-a526-9ae83c05cb2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:35.228397 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 493/991] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:35.492395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1457b1-91d1-490f-bedf-8847ebab5ff7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:35.598534 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1457b1-91d1-490f-bedf-8847ebab5ff7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:35.611798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:35.632096 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71f863-d744-48ab-9ec1-ab2858c6d0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:35.632723 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71f863-d744-48ab-9ec1-ab2858c6d0d9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:35.636856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71f863-d744-48ab-9ec1-ab2858c6d0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:35.636856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71f863-d744-48ab-9ec1-ab2858c6d0d9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:35.636856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71f863-d744-48ab-9ec1-ab2858c6d0d9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:35.636856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71f863-d744-48ab-9ec1-ab2858c6d0d9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2c71f863-d744-48ab-9ec1-ab2858c6d0d9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:35.644444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:35.645443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:35.646420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:35.646420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:35.646420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:35.646420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:35.646420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:35.646420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:35.646420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:35.646420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:35.646420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:35.646420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:35.646420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:35.646420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:35.646420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:35.646420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:35.648005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 499/992] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 24 07:51:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:35.652228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3a3d6-fb8a-4feb-a526-9ae83c05cb2c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:35.731243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:35.753956 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf3a3d6-fb8a-4feb-a526-9ae83c05cb2c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:35.793580 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfe9b44-2e5a-4449-b535-19c0563610fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:35.794192 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9b44-2e5a-4449-b535-19c0563610fd None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:35.794470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9b44-2e5a-4449-b535-19c0563610fd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:35.794740 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfe9b44-2e5a-4449-b535-19c0563610fd None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:35.795366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe9b44-2e5a-4449-b535-19c0563610fd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:35.795667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe9b44-2e5a-4449-b535-19c0563610fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:35.797053 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfe9b44-2e5a-4449-b535-19c0563610fd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:35.806536 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 494/993] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 24 07:51:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:35.807999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71f863-d744-48ab-9ec1-ab2858c6d0d9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:35.868986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a43a-1b96-41bd-9db0-fe8d3d983926 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:35.869977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a43a-1b96-41bd-9db0-fe8d3d983926 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:35.870805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af2a43a-1b96-41bd-9db0-fe8d3d983926 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:35.872597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 495/994] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:35.877408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5b60-5c28-4b11-8bdd-7505fbf403e6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:35.877741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5b60-5c28-4b11-8bdd-7505fbf403e6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:35.877989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5b60-5c28-4b11-8bdd-7505fbf403e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:35.897278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7e3b5b60-5c28-4b11-8bdd-7505fbf403e6 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:35.898394 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7e3b5b60-5c28-4b11-8bdd-7505fbf403e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:35.917341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71f863-d744-48ab-9ec1-ab2858c6d0d9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:35.952540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e424ba3-50f9-43a0-8a98-45a77356b38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:35.953299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e424ba3-50f9-43a0-8a98-45a77356b38c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:35.953583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e424ba3-50f9-43a0-8a98-45a77356b38c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:35.954145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e424ba3-50f9-43a0-8a98-45a77356b38c None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:35.954774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e424ba3-50f9-43a0-8a98-45a77356b38c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:35.955077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e424ba3-50f9-43a0-8a98-45a77356b38c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:35.956468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e424ba3-50f9-43a0-8a98-45a77356b38c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:35.967910 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 500/995] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 24 07:51:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:35.969041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e424ba3-50f9-43a0-8a98-45a77356b38c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:35.977434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 496/996] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:35 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:51:36.015058 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:36.073516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e424ba3-50f9-43a0-8a98-45a77356b38c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:36.107361 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ec55b-a253-4c30-a409-2651be6c6b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:36.107996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ec55b-a253-4c30-a409-2651be6c6b55 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:36.108280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ec55b-a253-4c30-a409-2651be6c6b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:36.108552 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ec55b-a253-4c30-a409-2651be6c6b55 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:36.109252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ec55b-a253-4c30-a409-2651be6c6b55 None admin] RBAC: Adding query filter params (interface=admin, service_id=59add875a5ff410a9571e7b879f0deb8, region_id=RegionOne) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:36.109562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ec55b-a253-4c30-a409-2651be6c6b55 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:36.110916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ec55b-a253-4c30-a409-2651be6c6b55 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:36.116356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 501/997] 10.222.0.62 () {56 vars in 1249 bytes} [Wed Aug 24 07:51:35 2022] GET /identity/v3/endpoints?service_id=59add875a5ff410a9571e7b879f0deb8&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:36.122004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b5b60-5c28-4b11-8bdd-7505fbf403e6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:36.192095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:36.224590 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b5b60-5c28-4b11-8bdd-7505fbf403e6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:36.240497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ec55b-a253-4c30-a409-2651be6c6b55 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:36.259465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64e803-b68e-43b1-bf7c-897c5c9bf93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:36.260637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64e803-b68e-43b1-bf7c-897c5c9bf93f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:36.260915 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64e803-b68e-43b1-bf7c-897c5c9bf93f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:36.261203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c64e803-b68e-43b1-bf7c-897c5c9bf93f None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:36.261798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64e803-b68e-43b1-bf7c-897c5c9bf93f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:36.263152 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c64e803-b68e-43b1-bf7c-897c5c9bf93f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:36.269233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 497/998] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 24 07:51:36 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:51:36.356806 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ec55b-a253-4c30-a409-2651be6c6b55 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:36.359301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:36.395718 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f22c72-818d-4ade-8847-77135e819306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:36.396399 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f22c72-818d-4ade-8847-77135e819306 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:36.396672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f22c72-818d-4ade-8847-77135e819306 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:36.396939 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f22c72-818d-4ade-8847-77135e819306 None admin] PATH_INFO: `/v3/services/image` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:36.397590 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f22c72-818d-4ade-8847-77135e819306 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:36.399008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f22c72-818d-4ade-8847-77135e819306 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-58f22c72-818d-4ade-8847-77135e819306 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:36.409851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:36.410892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:36.411746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 502/999] 10.222.0.62 () {56 vars in 1105 bytes} [Wed Aug 24 07:51:36 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:36.417393 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64e803-b68e-43b1-bf7c-897c5c9bf93f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:36.519176 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c64e803-b68e-43b1-bf7c-897c5c9bf93f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:36.553620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c021b2-ff28-496d-9f70-68d7bfeb680a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:36.554224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c021b2-ff28-496d-9f70-68d7bfeb680a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:36.554505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c021b2-ff28-496d-9f70-68d7bfeb680a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:36.554777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c021b2-ff28-496d-9f70-68d7bfeb680a None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:36.555401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c021b2-ff28-496d-9f70-68d7bfeb680a None admin] RBAC: Adding query filter params (name=image) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:36.555700 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c021b2-ff28-496d-9f70-68d7bfeb680a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:36.557232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c021b2-ff28-496d-9f70-68d7bfeb680a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:36.558466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:36.567228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 498/1000] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:36.568949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f22c72-818d-4ade-8847-77135e819306 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:36.673946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f22c72-818d-4ade-8847-77135e819306 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:36.709029 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f10af3-421c-402b-9915-9f26d6db4804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:36.709689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10af3-421c-402b-9915-9f26d6db4804 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:36.709978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10af3-421c-402b-9915-9f26d6db4804 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:36.710250 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f10af3-421c-402b-9915-9f26d6db4804 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:36.710882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f10af3-421c-402b-9915-9f26d6db4804 None admin] RBAC: Adding query filter params (type=image) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:36.711247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f10af3-421c-402b-9915-9f26d6db4804 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:36.712956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f10af3-421c-402b-9915-9f26d6db4804 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:36.752556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 503/1001] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:36 2022] GET /identity/v3/services?type=image => generated 122 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:36.961674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc1765-3057-4287-a9d1-ea0893c584fd None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:36.962446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc1765-3057-4287-a9d1-ea0893c584fd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:36.962446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bc1765-3057-4287-a9d1-ea0893c584fd None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:36.964121 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 499/1002] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:36.969235 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aebb31-485f-46c5-863e-f8fe511fa7e2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:36.969523 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aebb31-485f-46c5-863e-f8fe511fa7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:36.969795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aebb31-485f-46c5-863e-f8fe511fa7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:36.987955 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-00aebb31-485f-46c5-863e-f8fe511fa7e2 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:36.989148 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-00aebb31-485f-46c5-863e-f8fe511fa7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:37.014894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:37.055672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 504/1003] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:37.320340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc1765-3057-4287-a9d1-ea0893c584fd None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:37.430570 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bc1765-3057-4287-a9d1-ea0893c584fd None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:37.465852 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00435bba-7e52-4e88-b493-4705063eb4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:37.466474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00435bba-7e52-4e88-b493-4705063eb4fe None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:37.466748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00435bba-7e52-4e88-b493-4705063eb4fe None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:37.467010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00435bba-7e52-4e88-b493-4705063eb4fe None admin] PATH_INFO: `/v3/services/compute` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:37.467577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00435bba-7e52-4e88-b493-4705063eb4fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:37.468948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00435bba-7e52-4e88-b493-4705063eb4fe None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-00435bba-7e52-4e88-b493-4705063eb4fe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:37.477403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:37.478398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:37.480576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:37.480576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:37.480576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:37.480576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:37.480576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:37.480576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:37.480576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:37.480576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:37.480576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:37.480576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:37.480576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:37.480576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:37.480576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 07:51:37.480576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:37.481829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 500/1004] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:37.484792 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aebb31-485f-46c5-863e-f8fe511fa7e2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:37.580943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00aebb31-485f-46c5-863e-f8fe511fa7e2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:37.616002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23561e-34c6-4d16-8083-c6d1c068f339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:37.616608 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23561e-34c6-4d16-8083-c6d1c068f339 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:37.616883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23561e-34c6-4d16-8083-c6d1c068f339 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:37.617152 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df23561e-34c6-4d16-8083-c6d1c068f339 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:37.617776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23561e-34c6-4d16-8083-c6d1c068f339 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:37.618077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23561e-34c6-4d16-8083-c6d1c068f339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:37.619457 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df23561e-34c6-4d16-8083-c6d1c068f339 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:37.628880 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 505/1005] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 24 07:51:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:37.630424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00435bba-7e52-4e88-b493-4705063eb4fe None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:37.692285 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:37.733589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00435bba-7e52-4e88-b493-4705063eb4fe None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:37.768343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca73a26-9c37-45a1-a89c-e8bbd39f4bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:37.768955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca73a26-9c37-45a1-a89c-e8bbd39f4bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:37.769233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca73a26-9c37-45a1-a89c-e8bbd39f4bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:37.769503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca73a26-9c37-45a1-a89c-e8bbd39f4bc1 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:37.770129 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca73a26-9c37-45a1-a89c-e8bbd39f4bc1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:37.770430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca73a26-9c37-45a1-a89c-e8bbd39f4bc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:37.771787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca73a26-9c37-45a1-a89c-e8bbd39f4bc1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:37.781843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 501/1006] 10.222.0.62 () {56 vars in 1112 bytes} [Wed Aug 24 07:51:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:37.783053 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23561e-34c6-4d16-8083-c6d1c068f339 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:37.813191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:37.889218 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df23561e-34c6-4d16-8083-c6d1c068f339 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:37.922705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee2d1d-075f-4971-ae13-0859d3688e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:37.923310 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee2d1d-075f-4971-ae13-0859d3688e48 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:37.923588 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee2d1d-075f-4971-ae13-0859d3688e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:37.923879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee2d1d-075f-4971-ae13-0859d3688e48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:37.924524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee2d1d-075f-4971-ae13-0859d3688e48 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:37.925878 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee2d1d-075f-4971-ae13-0859d3688e48 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:38.003882 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 506/1007] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 07:51:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:51:38.225206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157587d8-7aef-4266-a3c8-661ef70d3836 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:38.225701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157587d8-7aef-4266-a3c8-661ef70d3836 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:38.225701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157587d8-7aef-4266-a3c8-661ef70d3836 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:38.227002 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 502/1008] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:38.233281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06a714-c820-45ef-b17c-baf26a84a102 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:38.233569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06a714-c820-45ef-b17c-baf26a84a102 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:38.233837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b06a714-c820-45ef-b17c-baf26a84a102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:38.252615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2b06a714-c820-45ef-b17c-baf26a84a102 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:38.254054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2b06a714-c820-45ef-b17c-baf26a84a102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:38.330552 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 507/1009] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:38 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:38.600759 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157587d8-7aef-4266-a3c8-661ef70d3836 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:38.670385 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6922f7-1125-4a58-925d-e1f0cf029ad8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:38.670905 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6922f7-1125-4a58-925d-e1f0cf029ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:38.670905 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6922f7-1125-4a58-925d-e1f0cf029ad8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:38.672577 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 508/1010] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:38.677463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac90e4-4732-4438-b40e-ca0eb0736fc3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:38.677748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac90e4-4732-4438-b40e-ca0eb0736fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:38.678025 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac90e4-4732-4438-b40e-ca0eb0736fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:38.698449 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c1ac90e4-4732-4438-b40e-ca0eb0736fc3 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:38.699917 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c1ac90e4-4732-4438-b40e-ca0eb0736fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:38.702496 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:38.720360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157587d8-7aef-4266-a3c8-661ef70d3836 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:38.754353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:38.762860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ffd93-9ecf-4f6f-bb71-1c4ed1655c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:38.763482 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ffd93-9ecf-4f6f-bb71-1c4ed1655c92 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:38.763826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ffd93-9ecf-4f6f-bb71-1c4ed1655c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:38.764136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33ffd93-9ecf-4f6f-bb71-1c4ed1655c92 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:38.764945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ffd93-9ecf-4f6f-bb71-1c4ed1655c92 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:38.766078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33ffd93-9ecf-4f6f-bb71-1c4ed1655c92 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-b33ffd93-9ecf-4f6f-bb71-1c4ed1655c92 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:38.775423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:38.778775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:38.779690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 503/1011] 10.222.0.62 () {56 vars in 1126 bytes} [Wed Aug 24 07:51:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:38.782542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ffd93-9ecf-4f6f-bb71-1c4ed1655c92 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:38.798500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 509/1012] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:38 2022] POST /identity/v3/auth/tokens => generated 1726 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:51:38.892013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33ffd93-9ecf-4f6f-bb71-1c4ed1655c92 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:38.925984 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7034fae-55a7-46c9-9e65-b679a904c416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:38.926647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7034fae-55a7-46c9-9e65-b679a904c416 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:38.926930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7034fae-55a7-46c9-9e65-b679a904c416 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:38.927202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7034fae-55a7-46c9-9e65-b679a904c416 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:38.927826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7034fae-55a7-46c9-9e65-b679a904c416 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:38.928157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7034fae-55a7-46c9-9e65-b679a904c416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:38.929528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7034fae-55a7-46c9-9e65-b679a904c416 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:38.939215 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 504/1013] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 24 07:51:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:38.940408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac90e4-4732-4438-b40e-ca0eb0736fc3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:39.039813 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac90e4-4732-4438-b40e-ca0eb0736fc3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:39.068803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7034fae-55a7-46c9-9e65-b679a904c416 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:39.074078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb47a57-5ebc-4e72-8eee-f1525e510212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:39.074689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb47a57-5ebc-4e72-8eee-f1525e510212 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:39.074963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb47a57-5ebc-4e72-8eee-f1525e510212 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:39.075231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb47a57-5ebc-4e72-8eee-f1525e510212 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:39.075867 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb47a57-5ebc-4e72-8eee-f1525e510212 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:39.076185 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb47a57-5ebc-4e72-8eee-f1525e510212 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:39.077538 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb47a57-5ebc-4e72-8eee-f1525e510212 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:39.082419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 510/1014] 10.222.0.62 () {56 vars in 1122 bytes} [Wed Aug 24 07:51:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:39.088700 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb47a57-5ebc-4e72-8eee-f1525e510212 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:39.091429 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:39.135001 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:39.184045 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7034fae-55a7-46c9-9e65-b679a904c416 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:39.198224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb47a57-5ebc-4e72-8eee-f1525e510212 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:39.222099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caba71-59b6-48df-98ea-6bb9315fe1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:39.222707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caba71-59b6-48df-98ea-6bb9315fe1c6 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:39.222988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caba71-59b6-48df-98ea-6bb9315fe1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:39.223258 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caba71-59b6-48df-98ea-6bb9315fe1c6 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:39.223986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caba71-59b6-48df-98ea-6bb9315fe1c6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:39.225295 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caba71-59b6-48df-98ea-6bb9315fe1c6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:39.233555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28fa8a-b130-4306-ba5f-258062a2d123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:39.234183 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28fa8a-b130-4306-ba5f-258062a2d123 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:39.234461 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28fa8a-b130-4306-ba5f-258062a2d123 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:39.234734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28fa8a-b130-4306-ba5f-258062a2d123 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:39.239567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28fa8a-b130-4306-ba5f-258062a2d123 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:39.239567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28fa8a-b130-4306-ba5f-258062a2d123 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:39.317063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 505/1015] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 24 07:51:39 2022] POST /identity/v3/services => generated 242 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:51:39.347334 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 511/1016] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 07:51:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:51:40.017952 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f6af1-a882-4bf8-9003-f48f0ea4531a None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:40.018371 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f6af1-a882-4bf8-9003-f48f0ea4531a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:40.018486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f6af1-a882-4bf8-9003-f48f0ea4531a None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:40.019875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 506/1017] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:40.024956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c50ad-a62b-4743-9358-849250c824d5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:40.025401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c50ad-a62b-4743-9358-849250c824d5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:40.025582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c50ad-a62b-4743-9358-849250c824d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:40.043639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-950c50ad-a62b-4743-9358-849250c824d5 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:40.044844 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-950c50ad-a62b-4743-9358-849250c824d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:40.099721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:40.116374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 512/1018] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:40 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:40.380901 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f6af1-a882-4bf8-9003-f48f0ea4531a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:40.490924 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f6af1-a882-4bf8-9003-f48f0ea4531a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:40.505736 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:40.525031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388380ed-4004-430d-9452-812457a88002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:40.526407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388380ed-4004-430d-9452-812457a88002 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:40.526781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388380ed-4004-430d-9452-812457a88002 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:40.527143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388380ed-4004-430d-9452-812457a88002 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:40.537795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388380ed-4004-430d-9452-812457a88002 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-388380ed-4004-430d-9452-812457a88002 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:40.543127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:40.547243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:40.548186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:40.548186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:40.548186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:40.548186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:40.548186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:40.548186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:40.548186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:40.548186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:40.548186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:40.548186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:40.548186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:51:40.548186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:40.548186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 507/1019] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Aug 24 07:51:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:40.550388 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c50ad-a62b-4743-9358-849250c824d5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:40.647055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c50ad-a62b-4743-9358-849250c824d5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:40.681009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c91522-34d1-4ad9-ae33-47a7c13e797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:40.681644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c91522-34d1-4ad9-ae33-47a7c13e797d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:40.681973 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c91522-34d1-4ad9-ae33-47a7c13e797d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:40.682183 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c91522-34d1-4ad9-ae33-47a7c13e797d None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:40.682840 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c91522-34d1-4ad9-ae33-47a7c13e797d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:40.683138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c91522-34d1-4ad9-ae33-47a7c13e797d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:40.684506 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c91522-34d1-4ad9-ae33-47a7c13e797d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:40.693026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 513/1020] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Aug 24 07:51:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:40.699162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388380ed-4004-430d-9452-812457a88002 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:40.798794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388380ed-4004-430d-9452-812457a88002 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:40.832406 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf76a57-95b7-45e7-bd32-735141392b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:40.833031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf76a57-95b7-45e7-bd32-735141392b5d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:40.833302 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf76a57-95b7-45e7-bd32-735141392b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:40.833564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf76a57-95b7-45e7-bd32-735141392b5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:40.844447 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf76a57-95b7-45e7-bd32-735141392b5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:40.845874 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf76a57-95b7-45e7-bd32-735141392b5d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-1bf76a57-95b7-45e7-bd32-735141392b5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:40.860134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:40.861183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:40.862122 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:40.862122 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:40.862122 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:40.862874 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 508/1021] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:40.867089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c91522-34d1-4ad9-ae33-47a7c13e797d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:40.917731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:40.968437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c91522-34d1-4ad9-ae33-47a7c13e797d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:41.002212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732cd95-96ab-4bb8-98d5-c619cd9a89ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:41.002910 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732cd95-96ab-4bb8-98d5-c619cd9a89ff None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:41.003253 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732cd95-96ab-4bb8-98d5-c619cd9a89ff None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:41.003589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5732cd95-96ab-4bb8-98d5-c619cd9a89ff None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:41.004338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732cd95-96ab-4bb8-98d5-c619cd9a89ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:41.004705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732cd95-96ab-4bb8-98d5-c619cd9a89ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:41.006114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5732cd95-96ab-4bb8-98d5-c619cd9a89ff None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:41.018741 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 514/1022] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:41.024187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf76a57-95b7-45e7-bd32-735141392b5d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:41.052248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:41.125929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf76a57-95b7-45e7-bd32-735141392b5d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:41.159759 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71258ac4-3623-4af1-a63b-7e9abc846580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:41.160410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258ac4-3623-4af1-a63b-7e9abc846580 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:41.160687 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258ac4-3623-4af1-a63b-7e9abc846580 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:41.160956 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71258ac4-3623-4af1-a63b-7e9abc846580 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:41.168540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71258ac4-3623-4af1-a63b-7e9abc846580 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:41.169899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71258ac4-3623-4af1-a63b-7e9abc846580 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-71258ac4-3623-4af1-a63b-7e9abc846580 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:41.181360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:41.182426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:41.183443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:41.183443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:41.183443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:41.183443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:41.183443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:41.183443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:41.183443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:41.183443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:41.183443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:51:41.183443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:41.184805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 509/1023] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 24 07:51:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:41.188257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732cd95-96ab-4bb8-98d5-c619cd9a89ff None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:41.267518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151072ec-9bf6-4a0f-957b-1478c7438518 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:41.267809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151072ec-9bf6-4a0f-957b-1478c7438518 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:41.268120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151072ec-9bf6-4a0f-957b-1478c7438518 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:41.269705 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 510/1024] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:41.274372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c711-47b0-4705-b0ab-065502b27aad None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:41.274653 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c711-47b0-4705-b0ab-065502b27aad None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:41.274925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c711-47b0-4705-b0ab-065502b27aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:41.293554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5732cd95-96ab-4bb8-98d5-c619cd9a89ff None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:41.293741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6018c711-47b0-4705-b0ab-065502b27aad None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:41.294761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6018c711-47b0-4705-b0ab-065502b27aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:41.304582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:41.329091 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb512881-a907-4e74-829b-b4bcbbc2b03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:41.329728 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb512881-a907-4e74-829b-b4bcbbc2b03f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:41.330342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb512881-a907-4e74-829b-b4bcbbc2b03f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:41.330597 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb512881-a907-4e74-829b-b4bcbbc2b03f None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:41.331340 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb512881-a907-4e74-829b-b4bcbbc2b03f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:41.331647 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb512881-a907-4e74-829b-b4bcbbc2b03f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:41.333161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb512881-a907-4e74-829b-b4bcbbc2b03f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:41.352304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 515/1025] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 24 07:51:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:41.353628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2878733-829d-4b2c-ac83-d62718fd5303 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:41.353916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2878733-829d-4b2c-ac83-d62718fd5303 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:41.354192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2878733-829d-4b2c-ac83-d62718fd5303 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:41.355402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 516/1026] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:41.357780 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2878733-829d-4b2c-ac83-d62718fd5303 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:41.367884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 511/1027] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:51:41.370119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff040-9669-427d-b295-ed1f943db030 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:41.370633 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff040-9669-427d-b295-ed1f943db030 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:41.370916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ff040-9669-427d-b295-ed1f943db030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:41.394473 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c51ff040-9669-427d-b295-ed1f943db030 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:41.395683 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c51ff040-9669-427d-b295-ed1f943db030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:41.408138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:41.474479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 512/1028] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:41 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:41.475601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2878733-829d-4b2c-ac83-d62718fd5303 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:41.511875 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db05e86-4123-48cb-b78e-8fe5e2286191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:41.512485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db05e86-4123-48cb-b78e-8fe5e2286191 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:41.512764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db05e86-4123-48cb-b78e-8fe5e2286191 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:41.513035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db05e86-4123-48cb-b78e-8fe5e2286191 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:41.548187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:41.581307 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db05e86-4123-48cb-b78e-8fe5e2286191 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:41.583033 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db05e86-4123-48cb-b78e-8fe5e2286191 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:41.633796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ff040-9669-427d-b295-ed1f943db030 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:41.686885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 517/1029] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:51:41 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:51:41.692630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db05e86-4123-48cb-b78e-8fe5e2286191 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:41.734852 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51ff040-9669-427d-b295-ed1f943db030 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:41.757875 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:41.768261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c216c6-2e98-4cb8-8491-1a2bb87640b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:41.777827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c216c6-2e98-4cb8-8491-1a2bb87640b3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:41.777827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c216c6-2e98-4cb8-8491-1a2bb87640b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:41.777827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c216c6-2e98-4cb8-8491-1a2bb87640b3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:41.777827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c216c6-2e98-4cb8-8491-1a2bb87640b3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:41.777827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c216c6-2e98-4cb8-8491-1a2bb87640b3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-20c216c6-2e98-4cb8-8491-1a2bb87640b3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:41.780392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:41.781574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:41.782742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 513/1030] 10.222.0.62 () {56 vars in 1105 bytes} [Wed Aug 24 07:51:41 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:41.783814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c216c6-2e98-4cb8-8491-1a2bb87640b3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:41.795007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db05e86-4123-48cb-b78e-8fe5e2286191 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:41.796039 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:41.829111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da679f4-cc9a-479f-b0cf-a7d304f5e5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:41.829734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da679f4-cc9a-479f-b0cf-a7d304f5e5f1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:41.830005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da679f4-cc9a-479f-b0cf-a7d304f5e5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:41.830271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da679f4-cc9a-479f-b0cf-a7d304f5e5f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:41.842052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da679f4-cc9a-479f-b0cf-a7d304f5e5f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:41.843594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da679f4-cc9a-479f-b0cf-a7d304f5e5f1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8da679f4-cc9a-479f-b0cf-a7d304f5e5f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:41.857877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:41.859119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:41.860085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:41.860085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:41.860085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:41.860085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 518/1031] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:41.860318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da679f4-cc9a-479f-b0cf-a7d304f5e5f1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:41.894993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c216c6-2e98-4cb8-8491-1a2bb87640b3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:41.926546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d740-0298-469f-ab63-72e52d72463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:41.927164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d740-0298-469f-ab63-72e52d72463b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:41.927439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d740-0298-469f-ab63-72e52d72463b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:41.927700 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e762d740-0298-469f-ab63-72e52d72463b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:41.928835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762d740-0298-469f-ab63-72e52d72463b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:41.930236 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e762d740-0298-469f-ab63-72e52d72463b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:41.932333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 514/1032] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:41.933126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d740-0298-469f-ab63-72e52d72463b None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:41.958365 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da679f4-cc9a-479f-b0cf-a7d304f5e5f1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:41.977626 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:41.990970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bef2fb-c780-48f8-9a3d-c6a2e86ddd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:41.991598 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bef2fb-c780-48f8-9a3d-c6a2e86ddd56 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:41.991897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bef2fb-c780-48f8-9a3d-c6a2e86ddd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:41.992169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bef2fb-c780-48f8-9a3d-c6a2e86ddd56 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:41.992783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bef2fb-c780-48f8-9a3d-c6a2e86ddd56 None admin] RBAC: Adding query filter params (name=image) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:41.993082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bef2fb-c780-48f8-9a3d-c6a2e86ddd56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:41.994962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bef2fb-c780-48f8-9a3d-c6a2e86ddd56 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:41.999535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 519/1033] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:41 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:42.000348 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bef2fb-c780-48f8-9a3d-c6a2e86ddd56 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:42.017981 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:42.039066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e762d740-0298-469f-ab63-72e52d72463b None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:42.072196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0818f7-d61a-44ac-9e04-9bf7c378d38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:42.072805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0818f7-d61a-44ac-9e04-9bf7c378d38d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:42.073088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0818f7-d61a-44ac-9e04-9bf7c378d38d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:42.073361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0818f7-d61a-44ac-9e04-9bf7c378d38d None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:42.073997 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0818f7-d61a-44ac-9e04-9bf7c378d38d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:42.074297 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0818f7-d61a-44ac-9e04-9bf7c378d38d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:42.075943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0818f7-d61a-44ac-9e04-9bf7c378d38d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:42.088639 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 515/1034] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:42.089572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0818f7-d61a-44ac-9e04-9bf7c378d38d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:42.100978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bef2fb-c780-48f8-9a3d-c6a2e86ddd56 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:42.134103 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44064b-71a3-481c-876a-5b9426d38e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:42.134870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44064b-71a3-481c-876a-5b9426d38e47 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:42.135156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44064b-71a3-481c-876a-5b9426d38e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:42.135428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44064b-71a3-481c-876a-5b9426d38e47 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:42.136092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44064b-71a3-481c-876a-5b9426d38e47 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:42.137487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44064b-71a3-481c-876a-5b9426d38e47 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:42.188332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0818f7-d61a-44ac-9e04-9bf7c378d38d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:42.222459 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fc5da-dc99-47d6-8048-c37f7ea8a6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:42.223057 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fc5da-dc99-47d6-8048-c37f7ea8a6bb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:42.223338 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fc5da-dc99-47d6-8048-c37f7ea8a6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:42.223611 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fc5da-dc99-47d6-8048-c37f7ea8a6bb None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:42.224264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fc5da-dc99-47d6-8048-c37f7ea8a6bb None admin] RBAC: Adding query filter params (type=image) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:42.224566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fc5da-dc99-47d6-8048-c37f7ea8a6bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:42.225908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fc5da-dc99-47d6-8048-c37f7ea8a6bb None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:42.226367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 520/1035] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 24 07:51:41 2022] POST /identity/v3/projects => generated 311 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:51:42.227346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44064b-71a3-481c-876a-5b9426d38e47 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:42.236329 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 516/1036] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:42.237430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fc5da-dc99-47d6-8048-c37f7ea8a6bb None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:42.240731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:42.272880 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:42.349047 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44064b-71a3-481c-876a-5b9426d38e47 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:42.355240 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fc5da-dc99-47d6-8048-c37f7ea8a6bb None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:42.389985 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af78cfd-ac37-42b0-ae47-683b957f6845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:42.390333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af78cfd-ac37-42b0-ae47-683b957f6845 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:42.390593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af78cfd-ac37-42b0-ae47-683b957f6845 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:42.390857 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af78cfd-ac37-42b0-ae47-683b957f6845 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:42.399205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af78cfd-ac37-42b0-ae47-683b957f6845 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:42.401453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af78cfd-ac37-42b0-ae47-683b957f6845 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:42.402264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28b14c-a491-4195-8b22-44b3e1fe5497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:42.403203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28b14c-a491-4195-8b22-44b3e1fe5497 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:42.403203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28b14c-a491-4195-8b22-44b3e1fe5497 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:42.403421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28b14c-a491-4195-8b22-44b3e1fe5497 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:42.404598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28b14c-a491-4195-8b22-44b3e1fe5497 None admin] RBAC: Adding query filter params (interface=public, service_id=e6bd9256c43a4f7dae9981748bb7370f, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:42.404598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28b14c-a491-4195-8b22-44b3e1fe5497 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:42.405745 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28b14c-a491-4195-8b22-44b3e1fe5497 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:42.411067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 517/1037] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 24 07:51:42 2022] GET /identity/v3/endpoints?service_id=e6bd9256c43a4f7dae9981748bb7370f&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-1af78cfd-ac37-42b0-ae47-683b957f6845 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:42.413937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:42.415018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:42.416629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:42.416629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:42.416629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:42.416629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:42.416629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:42.416629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:42.416629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:42.416629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:42.416629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 521/1038] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:42.418144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28b14c-a491-4195-8b22-44b3e1fe5497 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:42.421146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af78cfd-ac37-42b0-ae47-683b957f6845 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:42.489787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:42.527605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28b14c-a491-4195-8b22-44b3e1fe5497 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:42.528457 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:42.535224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af78cfd-ac37-42b0-ae47-683b957f6845 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:42.565532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66de138-e03d-4721-be8b-fb97e3cb7ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:42.566151 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66de138-e03d-4721-be8b-fb97e3cb7ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:42.566431 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66de138-e03d-4721-be8b-fb97e3cb7ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:42.566702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66de138-e03d-4721-be8b-fb97e3cb7ea6 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:42.567308 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66de138-e03d-4721-be8b-fb97e3cb7ea6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:42.568699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66de138-e03d-4721-be8b-fb97e3cb7ea6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:42.573909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff631fd-bf13-4c46-b164-3d5186454e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:42.574742 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff631fd-bf13-4c46-b164-3d5186454e86 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:42.575209 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff631fd-bf13-4c46-b164-3d5186454e86 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:42.575653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff631fd-bf13-4c46-b164-3d5186454e86 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:42.576064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 518/1039] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 24 07:51:42 2022] GET /identity/v3/services => generated 1957 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:51:42.576734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff631fd-bf13-4c46-b164-3d5186454e86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:42.577039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff631fd-bf13-4c46-b164-3d5186454e86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:42.578640 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff631fd-bf13-4c46-b164-3d5186454e86 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:42.596652 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 522/1040] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:42.602750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66de138-e03d-4721-be8b-fb97e3cb7ea6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:42.711302 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66de138-e03d-4721-be8b-fb97e3cb7ea6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:42.746428 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:42.753376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c7aa3-628a-4899-9b20-9e12cd589126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:42.756290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c7aa3-628a-4899-9b20-9e12cd589126 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:42.756290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c7aa3-628a-4899-9b20-9e12cd589126 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:42.756290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c7aa3-628a-4899-9b20-9e12cd589126 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:42.756290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c7aa3-628a-4899-9b20-9e12cd589126 None admin] RBAC: Adding query filter params (role.id=eef05f488f0548cd8907a60e41374b89, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=9b99cff7a5f549adadee002f8ab1f5d9) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:42.756290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c7aa3-628a-4899-9b20-9e12cd589126 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:42.757036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c7aa3-628a-4899-9b20-9e12cd589126 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:42.763062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 519/1041] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:51:42 2022] GET /identity/v3/role_assignments?user.id=9b99cff7a5f549adadee002f8ab1f5d9&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=eef05f488f0548cd8907a60e41374b89 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:44.187243 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c8093-6ecc-430a-b6b6-519e63275941 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:44.187801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c8093-6ecc-430a-b6b6-519e63275941 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:44.187801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c8093-6ecc-430a-b6b6-519e63275941 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:44.189208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 523/1042] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:44.194522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e283e1f-df3a-423d-b97f-503e58fb6f06 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:44.194913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e283e1f-df3a-423d-b97f-503e58fb6f06 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:44.195073 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e283e1f-df3a-423d-b97f-503e58fb6f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:44.214264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6e283e1f-df3a-423d-b97f-503e58fb6f06 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:44.215453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6e283e1f-df3a-423d-b97f-503e58fb6f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:44.283438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 520/1043] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:44.523329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d284071-5c3e-4c74-9136-fa58f09accda None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:44.523653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d284071-5c3e-4c74-9136-fa58f09accda None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:44.523917 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d284071-5c3e-4c74-9136-fa58f09accda None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:44.525987 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 524/1044] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:44.531413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea882a9-79ae-478d-a857-c210977ffab7 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:44.531698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea882a9-79ae-478d-a857-c210977ffab7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:44.532029 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea882a9-79ae-478d-a857-c210977ffab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:44.549972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d284071-5c3e-4c74-9136-fa58f09accda None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:44.550672 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3ea882a9-79ae-478d-a857-c210977ffab7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:44.551889 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3ea882a9-79ae-478d-a857-c210977ffab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:44.627886 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 521/1045] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:51:44.628194 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43eff7-b372-457a-acef-90cb190fb11c None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:44.628483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43eff7-b372-457a-acef-90cb190fb11c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:44.628756 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43eff7-b372-457a-acef-90cb190fb11c None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:44.630129 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 522/1046] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:44.635186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c9c00-05fb-4044-b2cf-d099bbbda595 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:44.635547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c9c00-05fb-4044-b2cf-d099bbbda595 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:44.635820 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c9c00-05fb-4044-b2cf-d099bbbda595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:44.653787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-803c9c00-05fb-4044-b2cf-d099bbbda595 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:44.655193 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-803c9c00-05fb-4044-b2cf-d099bbbda595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:44.659035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d284071-5c3e-4c74-9136-fa58f09accda None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:44.693134 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9971ce-f8ed-48c5-bfcd-33558ffab866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:44.694156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9971ce-f8ed-48c5-bfcd-33558ffab866 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:44.694435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9971ce-f8ed-48c5-bfcd-33558ffab866 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:44.694737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9971ce-f8ed-48c5-bfcd-33558ffab866 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:44.695897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9971ce-f8ed-48c5-bfcd-33558ffab866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:44.698881 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9971ce-f8ed-48c5-bfcd-33558ffab866 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:44.700987 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 525/1047] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:44.706842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9971ce-f8ed-48c5-bfcd-33558ffab866 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:44.709940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:44.730346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 523/1048] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:51:44.735290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:44.809401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9971ce-f8ed-48c5-bfcd-33558ffab866 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:44.843953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dce31-32bf-4fe9-8481-f497d5fb3843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:44.844563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dce31-32bf-4fe9-8481-f497d5fb3843 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:44.844845 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dce31-32bf-4fe9-8481-f497d5fb3843 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:44.845120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dce31-32bf-4fe9-8481-f497d5fb3843 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:44.845758 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dce31-32bf-4fe9-8481-f497d5fb3843 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:44.847173 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dce31-32bf-4fe9-8481-f497d5fb3843 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:44.893999 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c9c00-05fb-4044-b2cf-d099bbbda595 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:44.945582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 526/1049] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:51:44 2022] POST /identity/v3/users => generated 285 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:51:44.997080 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dce31-32bf-4fe9-8481-f497d5fb3843 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:45.009242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c9c00-05fb-4044-b2cf-d099bbbda595 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:45.048144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9a2c1-1d64-481d-a136-05e8bf2bcd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:45.048801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9a2c1-1d64-481d-a136-05e8bf2bcd57 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:45.049078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9a2c1-1d64-481d-a136-05e8bf2bcd57 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:45.049353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9a2c1-1d64-481d-a136-05e8bf2bcd57 None admin] PATH_INFO: `/v3/services/image` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:45.049945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9a2c1-1d64-481d-a136-05e8bf2bcd57 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:45.051328 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae9a2c1-1d64-481d-a136-05e8bf2bcd57 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-fae9a2c1-1d64-481d-a136-05e8bf2bcd57 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:45.061374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:45.062491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:45.063362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 524/1050] 10.222.0.62 () {56 vars in 1105 bytes} [Wed Aug 24 07:51:44 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:45.068530 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9a2c1-1d64-481d-a136-05e8bf2bcd57 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:45.097198 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:45.120803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dce31-32bf-4fe9-8481-f497d5fb3843 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:45.125497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:45.165351 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278edccd-15cf-4cf2-96c8-02f9cc2fa99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:45.166015 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278edccd-15cf-4cf2-96c8-02f9cc2fa99a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:45.166292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278edccd-15cf-4cf2-96c8-02f9cc2fa99a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:45.166558 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278edccd-15cf-4cf2-96c8-02f9cc2fa99a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:45.177075 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278edccd-15cf-4cf2-96c8-02f9cc2fa99a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-278edccd-15cf-4cf2-96c8-02f9cc2fa99a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:45.182524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:45.183529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:45.184458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:45.184458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:45.184458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:45.184458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:45.184458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:45.184458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:45.184458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:45.184458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:45.184458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:45.184458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:45.184458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:51:45.184458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:45.184458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 527/1051] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Aug 24 07:51:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:45.185511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9a2c1-1d64-481d-a136-05e8bf2bcd57 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:45.191331 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278edccd-15cf-4cf2-96c8-02f9cc2fa99a None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:45.222864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70662320-e283-4ce8-ae30-8f2b5f53a61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:45.223623 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70662320-e283-4ce8-ae30-8f2b5f53a61e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:45.223940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70662320-e283-4ce8-ae30-8f2b5f53a61e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:45.224214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70662320-e283-4ce8-ae30-8f2b5f53a61e None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:45.225438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70662320-e283-4ce8-ae30-8f2b5f53a61e None admin] RBAC: Adding query filter params (name=image) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:45.225749 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70662320-e283-4ce8-ae30-8f2b5f53a61e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:45.227115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70662320-e283-4ce8-ae30-8f2b5f53a61e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:45.234343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 525/1052] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:45.239906 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70662320-e283-4ce8-ae30-8f2b5f53a61e None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:45.302248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278edccd-15cf-4cf2-96c8-02f9cc2fa99a None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:45.340401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93a7fc-21fd-4263-8ca4-93e5bd65a2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:45.341020 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93a7fc-21fd-4263-8ca4-93e5bd65a2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:45.341245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93a7fc-21fd-4263-8ca4-93e5bd65a2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:45.341468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93a7fc-21fd-4263-8ca4-93e5bd65a2f9 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:45.342184 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93a7fc-21fd-4263-8ca4-93e5bd65a2f9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:45.342423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93a7fc-21fd-4263-8ca4-93e5bd65a2f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:45.343783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c93a7fc-21fd-4263-8ca4-93e5bd65a2f9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:45.349344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70662320-e283-4ce8-ae30-8f2b5f53a61e None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:45.352295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 528/1053] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Aug 24 07:51:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:45.358327 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93a7fc-21fd-4263-8ca4-93e5bd65a2f9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:45.361813 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:45.364431 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:45.392013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91b5fc-1eac-4bb9-ba58-51b883e54882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:45.392629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91b5fc-1eac-4bb9-ba58-51b883e54882 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:45.392905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91b5fc-1eac-4bb9-ba58-51b883e54882 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:45.393175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91b5fc-1eac-4bb9-ba58-51b883e54882 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:45.393799 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91b5fc-1eac-4bb9-ba58-51b883e54882 None admin] RBAC: Adding query filter params (type=image) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:45.394099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91b5fc-1eac-4bb9-ba58-51b883e54882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:45.395440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91b5fc-1eac-4bb9-ba58-51b883e54882 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:45.401040 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 526/1054] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:45.406745 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91b5fc-1eac-4bb9-ba58-51b883e54882 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:45.472894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93a7fc-21fd-4263-8ca4-93e5bd65a2f9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:45.516446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b665f-421d-4557-aa91-ee16c964c394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:45.517080 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b665f-421d-4557-aa91-ee16c964c394 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:45.517361 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b665f-421d-4557-aa91-ee16c964c394 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:45.517634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b665f-421d-4557-aa91-ee16c964c394 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:45.517951 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91b5fc-1eac-4bb9-ba58-51b883e54882 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:45.528993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b665f-421d-4557-aa91-ee16c964c394 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:45.530757 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b665f-421d-4557-aa91-ee16c964c394 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-cb8b665f-421d-4557-aa91-ee16c964c394 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:45.545342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:45.546337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:45.547248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:45.547248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:45.547248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:45.547248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 529/1055] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:45.552022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b665f-421d-4557-aa91-ee16c964c394 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:45.558515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee54d94-95ad-41e5-b159-b05c68dea702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:45.559126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee54d94-95ad-41e5-b159-b05c68dea702 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:45.559404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee54d94-95ad-41e5-b159-b05c68dea702 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:45.559674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee54d94-95ad-41e5-b159-b05c68dea702 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:45.560360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee54d94-95ad-41e5-b159-b05c68dea702 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:45.561847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee54d94-95ad-41e5-b159-b05c68dea702 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:45.608122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:45.650638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b665f-421d-4557-aa91-ee16c964c394 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:45.660334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 527/1056] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 07:51:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:51:45.700513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2cc16-a9ae-4be1-a3c6-f69b522129d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:45.701132 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2cc16-a9ae-4be1-a3c6-f69b522129d4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:45.701411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2cc16-a9ae-4be1-a3c6-f69b522129d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:45.701677 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2cc16-a9ae-4be1-a3c6-f69b522129d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:45.702325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2cc16-a9ae-4be1-a3c6-f69b522129d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:45.702627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2cc16-a9ae-4be1-a3c6-f69b522129d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:45.704112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f2cc16-a9ae-4be1-a3c6-f69b522129d4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:45.723434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 530/1057] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:45.725615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee54d94-95ad-41e5-b159-b05c68dea702 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:45.760821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:45.837072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee54d94-95ad-41e5-b159-b05c68dea702 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:45.877523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aead2-fe3c-46c9-a6bd-5336379ee076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:45.878103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aead2-fe3c-46c9-a6bd-5336379ee076 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:45.878384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aead2-fe3c-46c9-a6bd-5336379ee076 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:45.878656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aead2-fe3c-46c9-a6bd-5336379ee076 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:45.886146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8aead2-fe3c-46c9-a6bd-5336379ee076 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:45.887575 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8aead2-fe3c-46c9-a6bd-5336379ee076 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-4a8aead2-fe3c-46c9-a6bd-5336379ee076 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:45.899022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:45.900829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:45.901838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:45.901838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:45.901838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:45.901838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:45.901838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:45.901838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:45.901838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:45.901838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:45.901838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:51:45.901838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:45.903912 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 528/1058] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 24 07:51:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:45.906690 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2cc16-a9ae-4be1-a3c6-f69b522129d4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:46.008842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2cc16-a9ae-4be1-a3c6-f69b522129d4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:46.020660 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:46.045266 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd0aa5-bcc0-47a6-a083-1c58a947f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:46.046012 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0aa5-bcc0-47a6-a083-1c58a947f87f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:46.046327 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0aa5-bcc0-47a6-a083-1c58a947f87f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:46.046672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd0aa5-bcc0-47a6-a083-1c58a947f87f None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:46.047475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd0aa5-bcc0-47a6-a083-1c58a947f87f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:46.047873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd0aa5-bcc0-47a6-a083-1c58a947f87f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:46.049375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd0aa5-bcc0-47a6-a083-1c58a947f87f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:46.072819 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 531/1059] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 24 07:51:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:46.074241 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aead2-fe3c-46c9-a6bd-5336379ee076 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:46.172388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:46.181853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aead2-fe3c-46c9-a6bd-5336379ee076 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:46.218399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926982a6-c7e7-44e1-b32d-f8f42da944b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:46.219030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926982a6-c7e7-44e1-b32d-f8f42da944b7 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:46.219311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926982a6-c7e7-44e1-b32d-f8f42da944b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:46.219581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926982a6-c7e7-44e1-b32d-f8f42da944b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:46.229742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926982a6-c7e7-44e1-b32d-f8f42da944b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:46.231176 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926982a6-c7e7-44e1-b32d-f8f42da944b7 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-926982a6-c7e7-44e1-b32d-f8f42da944b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:46.245522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:46.246664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:46.247824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:46.247824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:46.247824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:46.251892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 529/1060] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:46.252496 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd0aa5-bcc0-47a6-a083-1c58a947f87f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:46.354207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd0aa5-bcc0-47a6-a083-1c58a947f87f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:46.396340 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32539015-2577-4ce6-8b6b-259df6eaf389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:46.396947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539015-2577-4ce6-8b6b-259df6eaf389 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:46.397225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539015-2577-4ce6-8b6b-259df6eaf389 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:46.397494 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32539015-2577-4ce6-8b6b-259df6eaf389 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:46.398131 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32539015-2577-4ce6-8b6b-259df6eaf389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:46.398429 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32539015-2577-4ce6-8b6b-259df6eaf389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:46.399819 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32539015-2577-4ce6-8b6b-259df6eaf389 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:46.415515 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 532/1061] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:46.417101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926982a6-c7e7-44e1-b32d-f8f42da944b7 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:46.517329 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926982a6-c7e7-44e1-b32d-f8f42da944b7 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:46.549975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a44c8-392e-4f73-bda8-af295a9b55a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:46.550595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a44c8-392e-4f73-bda8-af295a9b55a4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:46.550931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a44c8-392e-4f73-bda8-af295a9b55a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:46.551202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a44c8-392e-4f73-bda8-af295a9b55a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:46.558372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a44c8-392e-4f73-bda8-af295a9b55a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:46.559788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a44c8-392e-4f73-bda8-af295a9b55a4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-156a44c8-392e-4f73-bda8-af295a9b55a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:46.570761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:46.571718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:46.578464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:46.578464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:46.578464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:46.578464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:46.578464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:46.578464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:46.578464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:46.578464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:46.578464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 530/1062] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:46.578972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32539015-2577-4ce6-8b6b-259df6eaf389 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:46.607422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:46.679957 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32539015-2577-4ce6-8b6b-259df6eaf389 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:46.715787 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425f568a-419e-4ab9-9ef6-2595eb369c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:46.716418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f568a-419e-4ab9-9ef6-2595eb369c19 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:46.716696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f568a-419e-4ab9-9ef6-2595eb369c19 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:46.716964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425f568a-419e-4ab9-9ef6-2595eb369c19 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:46.717705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f568a-419e-4ab9-9ef6-2595eb369c19 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:46.718010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f568a-419e-4ab9-9ef6-2595eb369c19 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:46.719414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425f568a-419e-4ab9-9ef6-2595eb369c19 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:46.736690 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 533/1063] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:46.737888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a44c8-392e-4f73-bda8-af295a9b55a4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:46.741760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:46.841786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a44c8-392e-4f73-bda8-af295a9b55a4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:46.875581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c8bf83-0360-4316-b68d-bb4184426dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:46.876261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8bf83-0360-4316-b68d-bb4184426dec None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:46.876536 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8bf83-0360-4316-b68d-bb4184426dec None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:46.876805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c8bf83-0360-4316-b68d-bb4184426dec None admin] PATH_INFO: `/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/9b99cff7a5f549adadee002f8ab1f5d9/roles/eef05f488f0548cd8907a60e41374b89` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:46.878929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8bf83-0360-4316-b68d-bb4184426dec None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1074e261454981a85d02b4b0f75ec5, user_id=9b99cff7a5f549adadee002f8ab1f5d9, role_id=eef05f488f0548cd8907a60e41374b89)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:46.880377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c8bf83-0360-4316-b68d-bb4184426dec None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:46.938853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 531/1064] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:51:46 2022] PUT /identity/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/9b99cff7a5f549adadee002f8ab1f5d9/roles/eef05f488f0548cd8907a60e41374b89 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:51:46.960819 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90452396-3b4d-4a2b-aedf-0690b3b37ab0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:46.961096 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90452396-3b4d-4a2b-aedf-0690b3b37ab0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:46.961621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90452396-3b4d-4a2b-aedf-0690b3b37ab0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:46.963194 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 534/1065] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:46.969503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad2e1f-57cf-44de-bce1-a4cf1112115c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:46.969793 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad2e1f-57cf-44de-bce1-a4cf1112115c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:46.970061 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad2e1f-57cf-44de-bce1-a4cf1112115c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:46.990503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ecad2e1f-57cf-44de-bce1-a4cf1112115c None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:46.991716 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ecad2e1f-57cf-44de-bce1-a4cf1112115c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:47.058758 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:47.067887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 532/1066] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:47.340070 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90452396-3b4d-4a2b-aedf-0690b3b37ab0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:47.436137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:47.449895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90452396-3b4d-4a2b-aedf-0690b3b37ab0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:47.484141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2185639-7632-446c-8731-94b3fc44177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:47.484768 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2185639-7632-446c-8731-94b3fc44177a None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:47.485044 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2185639-7632-446c-8731-94b3fc44177a None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:47.485312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2185639-7632-446c-8731-94b3fc44177a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:47.495343 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2185639-7632-446c-8731-94b3fc44177a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-f2185639-7632-446c-8731-94b3fc44177a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:47.499994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:47.500994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:47.501847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:47.501847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:47.501847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:47.501847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:47.501847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:47.501847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:47.501847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:47.501847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:47.501847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:47.501847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:47.501847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:47.501847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:47.503239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 535/1067] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:51:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:47.506959 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad2e1f-57cf-44de-bce1-a4cf1112115c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:47.609859 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad2e1f-57cf-44de-bce1-a4cf1112115c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:47.618293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c666c4d-bdcb-460e-8573-1a00bd8d3e67 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:47.618588 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c666c4d-bdcb-460e-8573-1a00bd8d3e67 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:47.618894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c666c4d-bdcb-460e-8573-1a00bd8d3e67 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:47.620384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 536/1068] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:51:47.624996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784a8ff-2c0e-4be0-85c4-bd22fb01a9f1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:47.625280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784a8ff-2c0e-4be0-85c4-bd22fb01a9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:47.625567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784a8ff-2c0e-4be0-85c4-bd22fb01a9f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:47.643877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1784a8ff-2c0e-4be0-85c4-bd22fb01a9f1 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:47.645206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1784a8ff-2c0e-4be0-85c4-bd22fb01a9f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:47.646149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248888a-58d6-435c-a38f-914e47d857ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:47.646748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248888a-58d6-435c-a38f-914e47d857ce None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:47.647022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248888a-58d6-435c-a38f-914e47d857ce None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:47.647296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248888a-58d6-435c-a38f-914e47d857ce None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:47.647966 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248888a-58d6-435c-a38f-914e47d857ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:47.648801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248888a-58d6-435c-a38f-914e47d857ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:47.649592 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248888a-58d6-435c-a38f-914e47d857ce None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:47.663586 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 533/1069] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:51:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:47.665095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248888a-58d6-435c-a38f-914e47d857ce None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:47.720207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 537/1070] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:51:47.733100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:47.777700 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248888a-58d6-435c-a38f-914e47d857ce None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:47.810484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4694d0e-b445-40c5-84e7-9ebbf48adf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:47.811105 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4694d0e-b445-40c5-84e7-9ebbf48adf85 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:47.811379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4694d0e-b445-40c5-84e7-9ebbf48adf85 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:47.811645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4694d0e-b445-40c5-84e7-9ebbf48adf85 None admin] PATH_INFO: `/v3/users/4c297d9f942f48ffb5baf432866561df` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:47.825207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4694d0e-b445-40c5-84e7-9ebbf48adf85 None admin] RBAC: Authorizing `identity:get_user(user_id=4c297d9f942f48ffb5baf432866561df)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:47.826630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4694d0e-b445-40c5-84e7-9ebbf48adf85 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:47.828457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 534/1071] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:51:47 2022] GET /identity/v3/users/4c297d9f942f48ffb5baf432866561df => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:47.834163 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784a8ff-2c0e-4be0-85c4-bd22fb01a9f1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:47.911369 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:47.932907 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784a8ff-2c0e-4be0-85c4-bd22fb01a9f1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:47.966807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25230fd-7228-4494-8396-451de515731d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:47.967418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25230fd-7228-4494-8396-451de515731d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:47.967692 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25230fd-7228-4494-8396-451de515731d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:47.967986 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25230fd-7228-4494-8396-451de515731d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:47.987046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4694d0e-b445-40c5-84e7-9ebbf48adf85 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:48.040506 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25230fd-7228-4494-8396-451de515731d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:48.042144 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25230fd-7228-4494-8396-451de515731d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:48.093531 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4694d0e-b445-40c5-84e7-9ebbf48adf85 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:48.107260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:48.125986 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:48.128270 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734bb8c-cf6a-487f-a574-85e74e748895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:48.128980 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734bb8c-cf6a-487f-a574-85e74e748895 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:48.129357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734bb8c-cf6a-487f-a574-85e74e748895 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:48.130036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734bb8c-cf6a-487f-a574-85e74e748895 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:48.150570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 538/1072] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:51:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:51:48.156439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25230fd-7228-4494-8396-451de515731d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:48.203646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734bb8c-cf6a-487f-a574-85e74e748895 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:48.205027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734bb8c-cf6a-487f-a574-85e74e748895 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:48.261858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25230fd-7228-4494-8396-451de515731d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:48.298444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a4f4f-4180-44f2-879e-b81613373866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:48.299067 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a4f4f-4180-44f2-879e-b81613373866 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:48.299342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a4f4f-4180-44f2-879e-b81613373866 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:48.299613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a4f4f-4180-44f2-879e-b81613373866 None admin] PATH_INFO: `/v3/projects/c2b24f555bf644039458c22a3d093763` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:48.300750 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a4f4f-4180-44f2-879e-b81613373866 None admin] RBAC: Authorizing `identity:get_project(project_id=c2b24f555bf644039458c22a3d093763)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:48.302159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a4f4f-4180-44f2-879e-b81613373866 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:48.303784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 539/1073] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:51:48 2022] GET /identity/v3/projects/c2b24f555bf644039458c22a3d093763 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:48.310513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a4f4f-4180-44f2-879e-b81613373866 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:48.311893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 535/1074] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:51:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:51:48.317074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734bb8c-cf6a-487f-a574-85e74e748895 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:48.331586 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:48.364289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:48.423421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734bb8c-cf6a-487f-a574-85e74e748895 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:48.430568 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a4f4f-4180-44f2-879e-b81613373866 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:48.465688 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61767bab-8740-40a4-8f8a-4633cde3627c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:48.466337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61767bab-8740-40a4-8f8a-4633cde3627c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:48.466615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61767bab-8740-40a4-8f8a-4633cde3627c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:48.466883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61767bab-8740-40a4-8f8a-4633cde3627c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:48.469470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664f513-2f7a-4a5b-90dd-e2d395988597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:48.470076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f513-2f7a-4a5b-90dd-e2d395988597 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:48.470356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f513-2f7a-4a5b-90dd-e2d395988597 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:48.470630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664f513-2f7a-4a5b-90dd-e2d395988597 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:48.471350 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664f513-2f7a-4a5b-90dd-e2d395988597 None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=c2b24f555bf644039458c22a3d093763, user.id=4c297d9f942f48ffb5baf432866561df) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:48.471659 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664f513-2f7a-4a5b-90dd-e2d395988597 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:48.473120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664f513-2f7a-4a5b-90dd-e2d395988597 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:48.477424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61767bab-8740-40a4-8f8a-4633cde3627c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:48.487902 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61767bab-8740-40a4-8f8a-4633cde3627c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:48.488139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 540/1075] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:51:48 2022] GET /identity/v3/role_assignments?user.id=4c297d9f942f48ffb5baf432866561df&scope.project.id=c2b24f555bf644039458c22a3d093763&role.id=68b1888f7bb644a39938b8d41006a813 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-61767bab-8740-40a4-8f8a-4633cde3627c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:48.504964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:48.506027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:48.507943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:48.507943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:48.507943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:48.507943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 536/1076] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:48.513186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664f513-2f7a-4a5b-90dd-e2d395988597 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:48.642079 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664f513-2f7a-4a5b-90dd-e2d395988597 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:48.653841 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:48.677956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f23da85-34f8-4d81-a190-a6dccabc412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:48.678616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23da85-34f8-4d81-a190-a6dccabc412b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:48.678896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23da85-34f8-4d81-a190-a6dccabc412b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:48.679169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f23da85-34f8-4d81-a190-a6dccabc412b None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:48.679809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23da85-34f8-4d81-a190-a6dccabc412b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:48.680142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23da85-34f8-4d81-a190-a6dccabc412b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:48.681533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f23da85-34f8-4d81-a190-a6dccabc412b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:48.699965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 541/1077] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:48.881992 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6322fc-9be7-4e01-8629-8ed97e68e7b0 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:48.882320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6322fc-9be7-4e01-8629-8ed97e68e7b0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:48.882550 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6322fc-9be7-4e01-8629-8ed97e68e7b0 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:48.884120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 537/1078] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:48.889537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09cf09-9934-4008-b92d-f027eb2ab6af None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:48.889823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09cf09-9934-4008-b92d-f027eb2ab6af None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:48.890100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09cf09-9934-4008-b92d-f027eb2ab6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:48.909762 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9e09cf09-9934-4008-b92d-f027eb2ab6af None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:48.910965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9e09cf09-9934-4008-b92d-f027eb2ab6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:48.986771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 542/1079] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:49.256254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6322fc-9be7-4e01-8629-8ed97e68e7b0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:49.322300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:49.358539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6322fc-9be7-4e01-8629-8ed97e68e7b0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:49.395707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010db1b-b000-4091-9585-a8160233d071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:49.396367 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010db1b-b000-4091-9585-a8160233d071 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:49.396643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010db1b-b000-4091-9585-a8160233d071 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:49.396911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8010db1b-b000-4091-9585-a8160233d071 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:49.407212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8010db1b-b000-4091-9585-a8160233d071 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-8010db1b-b000-4091-9585-a8160233d071 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:49.411838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:49.412976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:49.413844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:49.413844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:49.413844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:49.413844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:49.413844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:49.413844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:49.413844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:49.413844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:49.413844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:49.413844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:49.413844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 07:51:49.413844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:49.413844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 538/1080] 10.222.0.62 () {56 vars in 1120 bytes} [Wed Aug 24 07:51:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:49.419509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09cf09-9934-4008-b92d-f027eb2ab6af None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:49.512932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:49.522055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09cf09-9934-4008-b92d-f027eb2ab6af None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:49.559129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff689be-fcdb-488f-97af-f9d9dee5085c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:49.559741 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff689be-fcdb-488f-97af-f9d9dee5085c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:49.560049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff689be-fcdb-488f-97af-f9d9dee5085c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:49.560324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff689be-fcdb-488f-97af-f9d9dee5085c None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:49.560996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff689be-fcdb-488f-97af-f9d9dee5085c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:49.561299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff689be-fcdb-488f-97af-f9d9dee5085c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:49.562657 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff689be-fcdb-488f-97af-f9d9dee5085c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:49.570804 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 543/1081] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Aug 24 07:51:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:49.576264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010db1b-b000-4091-9585-a8160233d071 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:49.673497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8010db1b-b000-4091-9585-a8160233d071 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:49.699466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:49.708124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e48633-fba6-4f3c-b819-2fb38aa18a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:49.708749 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e48633-fba6-4f3c-b819-2fb38aa18a82 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:49.709025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e48633-fba6-4f3c-b819-2fb38aa18a82 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:49.709295 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e48633-fba6-4f3c-b819-2fb38aa18a82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:49.719670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e48633-fba6-4f3c-b819-2fb38aa18a82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:49.721129 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e48633-fba6-4f3c-b819-2fb38aa18a82 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-02e48633-fba6-4f3c-b819-2fb38aa18a82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:49.735520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:49.736515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:49.737883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:49.737883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:49.737883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:49.737883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 539/1082] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:49.742480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff689be-fcdb-488f-97af-f9d9dee5085c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:49.839247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff689be-fcdb-488f-97af-f9d9dee5085c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:49.872513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc839d54-5a2b-4821-bfe8-7c65b0147595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:49.873108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc839d54-5a2b-4821-bfe8-7c65b0147595 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:49.873386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc839d54-5a2b-4821-bfe8-7c65b0147595 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:49.873653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc839d54-5a2b-4821-bfe8-7c65b0147595 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:49.874284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc839d54-5a2b-4821-bfe8-7c65b0147595 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:49.880075 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc839d54-5a2b-4821-bfe8-7c65b0147595 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:49.880075 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc839d54-5a2b-4821-bfe8-7c65b0147595 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:49.888103 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 544/1083] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:49.893842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e48633-fba6-4f3c-b819-2fb38aa18a82 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:49.990628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e48633-fba6-4f3c-b819-2fb38aa18a82 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:50.023528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511588ee-f6d2-4aca-9a2e-47d9c8dd9db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:50.024180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511588ee-f6d2-4aca-9a2e-47d9c8dd9db8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:50.024459 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511588ee-f6d2-4aca-9a2e-47d9c8dd9db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:50.024754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511588ee-f6d2-4aca-9a2e-47d9c8dd9db8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:50.032259 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511588ee-f6d2-4aca-9a2e-47d9c8dd9db8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:50.033688 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511588ee-f6d2-4aca-9a2e-47d9c8dd9db8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-511588ee-f6d2-4aca-9a2e-47d9c8dd9db8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:51:50.045189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:50.046327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:50.047725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:50.047725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:50.047725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:51:50.047725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:51:50.047725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:51:50.047725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:51:50.047725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:51:50.047725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:51:50.047725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 07:51:50.047725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:50.047725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 540/1084] 10.222.0.62 () {56 vars in 1093 bytes} [Wed Aug 24 07:51:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:50.052021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc839d54-5a2b-4821-bfe8-7c65b0147595 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:50.076290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:50.149176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc839d54-5a2b-4821-bfe8-7c65b0147595 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:50.182726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69ee2f-2489-40f1-88e6-af575ba502b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:50.183324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69ee2f-2489-40f1-88e6-af575ba502b4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:50.183604 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69ee2f-2489-40f1-88e6-af575ba502b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:50.183904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69ee2f-2489-40f1-88e6-af575ba502b4 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:50.184624 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69ee2f-2489-40f1-88e6-af575ba502b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:50.184929 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69ee2f-2489-40f1-88e6-af575ba502b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:50.186331 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69ee2f-2489-40f1-88e6-af575ba502b4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:50.202797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 545/1085] 10.222.0.62 () {56 vars in 1133 bytes} [Wed Aug 24 07:51:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:50.208500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511588ee-f6d2-4aca-9a2e-47d9c8dd9db8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:50.249128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:50.308628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511588ee-f6d2-4aca-9a2e-47d9c8dd9db8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:50.341729 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792cb64-4ce1-4428-9c29-473f219dfb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:50.342334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792cb64-4ce1-4428-9c29-473f219dfb0d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:50.342610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792cb64-4ce1-4428-9c29-473f219dfb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:50.342874 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792cb64-4ce1-4428-9c29-473f219dfb0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:50.393378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be454b35-3f50-41cd-9625-647b5a0cd23d None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:50.393673 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be454b35-3f50-41cd-9625-647b5a0cd23d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:50.393956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be454b35-3f50-41cd-9625-647b5a0cd23d None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:50.395298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 546/1086] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:50.400667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc087e-2349-46e7-ac93-cf0cc275645b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:50.400945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc087e-2349-46e7-ac93-cf0cc275645b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:50.401244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc087e-2349-46e7-ac93-cf0cc275645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:50.412162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792cb64-4ce1-4428-9c29-473f219dfb0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:50.413593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792cb64-4ce1-4428-9c29-473f219dfb0d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:50.419363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f7dc087e-2349-46e7-ac93-cf0cc275645b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:50.420604 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f7dc087e-2349-46e7-ac93-cf0cc275645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:50.452710 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:50.488611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 547/1087] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:51:50.517731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 541/1088] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:51:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:51:50.518807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc087e-2349-46e7-ac93-cf0cc275645b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:50.531384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:50.615029 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc087e-2349-46e7-ac93-cf0cc275645b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:50.648043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3549a-569b-4184-9736-6962ba272afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:50.648663 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3549a-569b-4184-9736-6962ba272afd None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:50.648943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3549a-569b-4184-9736-6962ba272afd None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:50.649214 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3549a-569b-4184-9736-6962ba272afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:50.659746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3549a-569b-4184-9736-6962ba272afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:50.661176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b3549a-569b-4184-9736-6962ba272afd None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-d7b3549a-569b-4184-9736-6962ba272afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:51:50.675909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:50.683808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:51:50.684965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:51:50.684965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:51:50.684965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:50.684965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 548/1089] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:50.685204 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792cb64-4ce1-4428-9c29-473f219dfb0d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:50.758058 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3549a-569b-4184-9736-6962ba272afd None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:50.784166 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792cb64-4ce1-4428-9c29-473f219dfb0d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:50.817483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0e668-29d3-444f-b2ee-9833f1a834ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:50.818086 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0e668-29d3-444f-b2ee-9833f1a834ea None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:50.818366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0e668-29d3-444f-b2ee-9833f1a834ea None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:50.818638 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0e668-29d3-444f-b2ee-9833f1a834ea None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:50.819270 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0e668-29d3-444f-b2ee-9833f1a834ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:50.819578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0e668-29d3-444f-b2ee-9833f1a834ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:50.820931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:50.821064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0e668-29d3-444f-b2ee-9833f1a834ea None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:50.829025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:50.833993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 542/1090] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:51:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:50.840628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0e668-29d3-444f-b2ee-9833f1a834ea None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:50.860531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3549a-569b-4184-9736-6962ba272afd None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:50.894734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ae7a5-6a99-45c1-a4d4-938401cfc26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:50.895359 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ae7a5-6a99-45c1-a4d4-938401cfc26d None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:50.895639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ae7a5-6a99-45c1-a4d4-938401cfc26d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:50.895938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ae7a5-6a99-45c1-a4d4-938401cfc26d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:50.906315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ae7a5-6a99-45c1-a4d4-938401cfc26d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-e03ae7a5-6a99-45c1-a4d4-938401cfc26d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:50.911513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:50.912670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:50.914024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:50.914024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:50.914024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:50.914024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:50.914024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:50.914024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:50.914024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:50.914024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:50.914024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:50.914024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:50.914024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:50.914024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:50.914024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 549/1091] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:51:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:50.918654 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ae7a5-6a99-45c1-a4d4-938401cfc26d None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:50.942060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0e668-29d3-444f-b2ee-9833f1a834ea None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:50.976637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a600a74-ebaf-44f9-9e71-93681a59208a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:50.977259 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a600a74-ebaf-44f9-9e71-93681a59208a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:50.977540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a600a74-ebaf-44f9-9e71-93681a59208a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:50.977816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a600a74-ebaf-44f9-9e71-93681a59208a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:50.984309 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a600a74-ebaf-44f9-9e71-93681a59208a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:50.985727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a600a74-ebaf-44f9-9e71-93681a59208a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-2a600a74-ebaf-44f9-9e71-93681a59208a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:51:50.997713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:50.998696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:50.999621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:51:50.999621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:51:50.999621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:51:50.999621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:51:50.999621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:51:50.999621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:51:50.999621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:51:50.999621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:51:50.999621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 543/1092] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:51:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:51:51.004510 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a600a74-ebaf-44f9-9e71-93681a59208a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:51.017575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ae7a5-6a99-45c1-a4d4-938401cfc26d None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:51.039745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:51.050534 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b3e2b-d8d8-4881-bcef-08c5db397fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:51.051137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b3e2b-d8d8-4881-bcef-08c5db397fbe None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:51.052231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b3e2b-d8d8-4881-bcef-08c5db397fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:51.052231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b3e2b-d8d8-4881-bcef-08c5db397fbe None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:51.052465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b3e2b-d8d8-4881-bcef-08c5db397fbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:51.052785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b3e2b-d8d8-4881-bcef-08c5db397fbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:51.054153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b3e2b-d8d8-4881-bcef-08c5db397fbe None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:51.062277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:51.063159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 550/1093] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:51:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:51.069125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b3e2b-d8d8-4881-bcef-08c5db397fbe None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:51.103925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a600a74-ebaf-44f9-9e71-93681a59208a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:51.137703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3ad41-92f1-4346-bf76-ccd9c4baba2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:51.138304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3ad41-92f1-4346-bf76-ccd9c4baba2a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:51.138583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3ad41-92f1-4346-bf76-ccd9c4baba2a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:51.138857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d3ad41-92f1-4346-bf76-ccd9c4baba2a None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:51.139537 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3ad41-92f1-4346-bf76-ccd9c4baba2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:51.139867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3ad41-92f1-4346-bf76-ccd9c4baba2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:51.141278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d3ad41-92f1-4346-bf76-ccd9c4baba2a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:51.152920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 544/1094] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:51:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:51.159005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3ad41-92f1-4346-bf76-ccd9c4baba2a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:51.167108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b3e2b-d8d8-4881-bcef-08c5db397fbe None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:51.200969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c52c8-e2a1-48aa-af08-dcac22ef41a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:51.201595 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c52c8-e2a1-48aa-af08-dcac22ef41a8 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:51.201875 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c52c8-e2a1-48aa-af08-dcac22ef41a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:51.202149 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c52c8-e2a1-48aa-af08-dcac22ef41a8 None admin] PATH_INFO: `/v3/users/4c297d9f942f48ffb5baf432866561df` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:51.203280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c52c8-e2a1-48aa-af08-dcac22ef41a8 None admin] RBAC: Authorizing `identity:get_user(user_id=4c297d9f942f48ffb5baf432866561df)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:51.204730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c52c8-e2a1-48aa-af08-dcac22ef41a8 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:51.206306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 551/1095] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:51:51 2022] GET /identity/v3/users/4c297d9f942f48ffb5baf432866561df => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:51.212303 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c52c8-e2a1-48aa-af08-dcac22ef41a8 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:51.257823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d3ad41-92f1-4346-bf76-ccd9c4baba2a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:51.263991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:51.274918 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:51.292780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcdd5f-c8ca-4295-8bb4-4b654aedf72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:51.293378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcdd5f-c8ca-4295-8bb4-4b654aedf72d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:51.293650 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcdd5f-c8ca-4295-8bb4-4b654aedf72d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:51.293915 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcdd5f-c8ca-4295-8bb4-4b654aedf72d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:51.294624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abcdd5f-c8ca-4295-8bb4-4b654aedf72d None admin] RBAC: Adding query filter params (role.id=eef05f488f0548cd8907a60e41374b89, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=9b99cff7a5f549adadee002f8ab1f5d9) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:51.294929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abcdd5f-c8ca-4295-8bb4-4b654aedf72d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:51.296364 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abcdd5f-c8ca-4295-8bb4-4b654aedf72d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:51.302017 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 545/1096] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:51:51 2022] GET /identity/v3/role_assignments?user.id=9b99cff7a5f549adadee002f8ab1f5d9&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=eef05f488f0548cd8907a60e41374b89 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:51.310933 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c52c8-e2a1-48aa-af08-dcac22ef41a8 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:51.347234 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7c153d-c1ef-4181-b56c-6c1b4b37c515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:51.347922 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c153d-c1ef-4181-b56c-6c1b4b37c515 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:51.348202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c153d-c1ef-4181-b56c-6c1b4b37c515 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:51.348474 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7c153d-c1ef-4181-b56c-6c1b4b37c515 None admin] PATH_INFO: `/v3/projects/c2b24f555bf644039458c22a3d093763` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:51.349675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c153d-c1ef-4181-b56c-6c1b4b37c515 None admin] RBAC: Authorizing `identity:get_project(project_id=c2b24f555bf644039458c22a3d093763)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:51.351139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7c153d-c1ef-4181-b56c-6c1b4b37c515 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:51.353405 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 552/1097] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:51:51 2022] GET /identity/v3/projects/c2b24f555bf644039458c22a3d093763 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:51:51.359678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcdd5f-c8ca-4295-8bb4-4b654aedf72d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:51.468125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcdd5f-c8ca-4295-8bb4-4b654aedf72d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:51.502702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d97fa48-ce1f-4863-aa8d-0097593422ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:51.503369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97fa48-ce1f-4863-aa8d-0097593422ef None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:51.503649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97fa48-ce1f-4863-aa8d-0097593422ef None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:51.504000 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d97fa48-ce1f-4863-aa8d-0097593422ef None admin] PATH_INFO: `/v3/projects/c2b24f555bf644039458c22a3d093763/users/4c297d9f942f48ffb5baf432866561df/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:51.505934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97fa48-ce1f-4863-aa8d-0097593422ef None admin] RBAC: Authorizing `identity:create_grant(project_id=c2b24f555bf644039458c22a3d093763, user_id=4c297d9f942f48ffb5baf432866561df, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:51.507348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d97fa48-ce1f-4863-aa8d-0097593422ef None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:51.573729 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 546/1098] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:51:51 2022] PUT /identity/v3/projects/c2b24f555bf644039458c22a3d093763/users/4c297d9f942f48ffb5baf432866561df/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:51:53.450024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221c511-5fd6-4ec6-94e7-d36740312b86 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:53.450529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221c511-5fd6-4ec6-94e7-d36740312b86 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:53.450624 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221c511-5fd6-4ec6-94e7-d36740312b86 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:53.451931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 553/1099] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:53.457005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efa032-548c-48e5-a63a-7a9402118ce4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:53.457429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efa032-548c-48e5-a63a-7a9402118ce4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:53.457544 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04efa032-548c-48e5-a63a-7a9402118ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:53.475253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-04efa032-548c-48e5-a63a-7a9402118ce4 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:53.476481 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-04efa032-548c-48e5-a63a-7a9402118ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:53.510144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:53.545629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 547/1100] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:53.817941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221c511-5fd6-4ec6-94e7-d36740312b86 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:53.918282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221c511-5fd6-4ec6-94e7-d36740312b86 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:53.938806 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:53.952381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd4dbb-dcc2-466c-8405-fddec5ea8349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:53.952996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd4dbb-dcc2-466c-8405-fddec5ea8349 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:53.953272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd4dbb-dcc2-466c-8405-fddec5ea8349 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:53.953541 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd4dbb-dcc2-466c-8405-fddec5ea8349 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:53.964143 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bd4dbb-dcc2-466c-8405-fddec5ea8349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-42bd4dbb-dcc2-466c-8405-fddec5ea8349 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:51:53.968903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:51:53.970018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:51:53.971241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:51:53.971241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:51:53.971241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:51:53.971241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:51:53.971241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:51:53.971241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:51:53.971241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:51:53.971241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:51:53.971241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:51:53.971241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:51:53.971241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:51:53.971241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:51:53.971241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 554/1101] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:51:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:51:53.975989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efa032-548c-48e5-a63a-7a9402118ce4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:54.070957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04efa032-548c-48e5-a63a-7a9402118ce4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:54.104567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7b97a-7727-498a-857e-b617b335364a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:54.105159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7b97a-7727-498a-857e-b617b335364a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:54.105433 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7b97a-7727-498a-857e-b617b335364a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:54.105698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7b97a-7727-498a-857e-b617b335364a None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:54.106348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7b97a-7727-498a-857e-b617b335364a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:54.106646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7b97a-7727-498a-857e-b617b335364a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:54.108014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7b97a-7727-498a-857e-b617b335364a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:54.115697 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 548/1102] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:51:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:54.121475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd4dbb-dcc2-466c-8405-fddec5ea8349 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:54.218177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd4dbb-dcc2-466c-8405-fddec5ea8349 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:54.251053 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcca49-d429-4875-ba24-5520977422ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:54.251664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcca49-d429-4875-ba24-5520977422ea None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:54.251969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcca49-d429-4875-ba24-5520977422ea None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:54.252243 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcca49-d429-4875-ba24-5520977422ea None admin] PATH_INFO: `/v3/users/4c297d9f942f48ffb5baf432866561df` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:54.253337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcca49-d429-4875-ba24-5520977422ea None admin] RBAC: Authorizing `identity:get_user(user_id=4c297d9f942f48ffb5baf432866561df)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:54.254751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcca49-d429-4875-ba24-5520977422ea None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:54.256341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 555/1103] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:51:54 2022] GET /identity/v3/users/4c297d9f942f48ffb5baf432866561df => generated 285 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:54.262709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7b97a-7727-498a-857e-b617b335364a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:54.296183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:54.360652 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7b97a-7727-498a-857e-b617b335364a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:54.393887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b974b-d15b-4bf0-81af-091c008e1e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:54.394482 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b974b-d15b-4bf0-81af-091c008e1e4a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:54.394757 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b974b-d15b-4bf0-81af-091c008e1e4a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:54.395022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b974b-d15b-4bf0-81af-091c008e1e4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:54.458743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b974b-d15b-4bf0-81af-091c008e1e4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:54.460247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b974b-d15b-4bf0-81af-091c008e1e4a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:54.492591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:54.556330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 549/1104] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:51:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:51:54.562272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcca49-d429-4875-ba24-5520977422ea None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:54.609849 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:54.658291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcca49-d429-4875-ba24-5520977422ea None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:54.690502 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ec936e-74c9-4b4d-9b79-dc2fab60901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:54.691111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec936e-74c9-4b4d-9b79-dc2fab60901c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:54.691386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec936e-74c9-4b4d-9b79-dc2fab60901c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:54.691655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ec936e-74c9-4b4d-9b79-dc2fab60901c None admin] PATH_INFO: `/v3/projects/c2b24f555bf644039458c22a3d093763` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:54.692771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec936e-74c9-4b4d-9b79-dc2fab60901c None admin] RBAC: Authorizing `identity:get_project(project_id=c2b24f555bf644039458c22a3d093763)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:54.694168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ec936e-74c9-4b4d-9b79-dc2fab60901c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:54.695755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 556/1105] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:51:54 2022] GET /identity/v3/projects/c2b24f555bf644039458c22a3d093763 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:54.702491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b974b-d15b-4bf0-81af-091c008e1e4a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:54.799705 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b974b-d15b-4bf0-81af-091c008e1e4a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:54.832633 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f014352e-70b0-4185-8d76-67025b35bc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:54.833228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014352e-70b0-4185-8d76-67025b35bc53 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:54.833508 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014352e-70b0-4185-8d76-67025b35bc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:54.833779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f014352e-70b0-4185-8d76-67025b35bc53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:54.834491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014352e-70b0-4185-8d76-67025b35bc53 None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=c2b24f555bf644039458c22a3d093763, user.id=4c297d9f942f48ffb5baf432866561df) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:51:54.834798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014352e-70b0-4185-8d76-67025b35bc53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:54.836496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f014352e-70b0-4185-8d76-67025b35bc53 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:54.838245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:54.842492 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 550/1106] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:51:54 2022] GET /identity/v3/role_assignments?user.id=4c297d9f942f48ffb5baf432866561df&scope.project.id=c2b24f555bf644039458c22a3d093763&role.id=68b1888f7bb644a39938b8d41006a813 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:56.732209 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9013641-3547-4a77-8884-390e5b99e1d4 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:56.732713 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9013641-3547-4a77-8884-390e5b99e1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:56.732713 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9013641-3547-4a77-8884-390e5b99e1d4 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:56.734039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 557/1107] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:56.739135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583c763-6338-46eb-aae3-b172f3c31b73 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:56.739579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583c763-6338-46eb-aae3-b172f3c31b73 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:56.739685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4583c763-6338-46eb-aae3-b172f3c31b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:56.758077 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4583c763-6338-46eb-aae3-b172f3c31b73 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:56.759282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4583c763-6338-46eb-aae3-b172f3c31b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:56.823034 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 551/1108] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:57.089356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9013641-3547-4a77-8884-390e5b99e1d4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:57.187295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9013641-3547-4a77-8884-390e5b99e1d4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:57.203241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:57.220669 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb24b31-952b-40b6-ba22-2a9e71ffba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:57.221280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb24b31-952b-40b6-ba22-2a9e71ffba1e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:57.221558 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb24b31-952b-40b6-ba22-2a9e71ffba1e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:57.221829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb24b31-952b-40b6-ba22-2a9e71ffba1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:57.222913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb24b31-952b-40b6-ba22-2a9e71ffba1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:57.224353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb24b31-952b-40b6-ba22-2a9e71ffba1e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:57.225879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 558/1109] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:51:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:57.231580 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583c763-6338-46eb-aae3-b172f3c31b73 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:57.326076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4583c763-6338-46eb-aae3-b172f3c31b73 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:57.351971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:51:57.359542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba9b70-bbf3-4169-853a-b894b66808e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:57.360388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9b70-bbf3-4169-853a-b894b66808e8 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:57.360670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9b70-bbf3-4169-853a-b894b66808e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:57.363066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba9b70-bbf3-4169-853a-b894b66808e8 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:57.363066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba9b70-bbf3-4169-853a-b894b66808e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:57.363066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba9b70-bbf3-4169-853a-b894b66808e8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:57.447738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 552/1110] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:51:57 2022] POST /identity/v3/users => generated 286 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:51:59.366954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c14a51-70f9-4843-94ea-940a0732bcb2 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:59.367515 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c14a51-70f9-4843-94ea-940a0732bcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:59.367515 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c14a51-70f9-4843-94ea-940a0732bcb2 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:59.369564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 559/1111] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:51:59.374763 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cc87d-05a6-4923-9b2e-b50746d20aa1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:59.375221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cc87d-05a6-4923-9b2e-b50746d20aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:59.375317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cc87d-05a6-4923-9b2e-b50746d20aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:59.393992 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a55cc87d-05a6-4923-9b2e-b50746d20aa1 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:51:59.395188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a55cc87d-05a6-4923-9b2e-b50746d20aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:51:59.461293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 553/1112] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:51:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:51:59.731664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c14a51-70f9-4843-94ea-940a0732bcb2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:51:59.830953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c14a51-70f9-4843-94ea-940a0732bcb2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:51:59.864310 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56675443-f6c9-4ba1-a9a9-80a8ee634d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:51:59.864931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56675443-f6c9-4ba1-a9a9-80a8ee634d3e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:51:59.865207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56675443-f6c9-4ba1-a9a9-80a8ee634d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:51:59.865474 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56675443-f6c9-4ba1-a9a9-80a8ee634d3e None admin] PATH_INFO: `/v3/roles/d78c47b14910477fa17f456efbbc177c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:51:59.866858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56675443-f6c9-4ba1-a9a9-80a8ee634d3e None admin] RBAC: Authorizing `identity:get_role(role_id=d78c47b14910477fa17f456efbbc177c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:51:59.868443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56675443-f6c9-4ba1-a9a9-80a8ee634d3e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:51:59.869757 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 560/1113] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:51:59 2022] GET /identity/v3/roles/d78c47b14910477fa17f456efbbc177c => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:51:59.875625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cc87d-05a6-4923-9b2e-b50746d20aa1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:00.050213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cc87d-05a6-4923-9b2e-b50746d20aa1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:00.063537 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:00.082250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256afa5a-52d7-4f97-b03b-4394bb118ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:00.082868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256afa5a-52d7-4f97-b03b-4394bb118ce4 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:00.083143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256afa5a-52d7-4f97-b03b-4394bb118ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:00.083411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256afa5a-52d7-4f97-b03b-4394bb118ce4 None admin] PATH_INFO: `/v3/users/f7c8b1c1368946ba93ea94bb21943f91` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:00.097578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256afa5a-52d7-4f97-b03b-4394bb118ce4 None admin] RBAC: Authorizing `identity:get_user(user_id=f7c8b1c1368946ba93ea94bb21943f91)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:00.099353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256afa5a-52d7-4f97-b03b-4394bb118ce4 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:00.101662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 554/1114] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:51:59 2022] GET /identity/v3/users/f7c8b1c1368946ba93ea94bb21943f91 => generated 286 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:00.107464 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56675443-f6c9-4ba1-a9a9-80a8ee634d3e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:00.158533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:00.204958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56675443-f6c9-4ba1-a9a9-80a8ee634d3e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:00.237065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1a027-2c63-4a97-9dc5-324ba0614961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:00.237652 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1a027-2c63-4a97-9dc5-324ba0614961 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:00.237931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1a027-2c63-4a97-9dc5-324ba0614961 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:00.238200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1a027-2c63-4a97-9dc5-324ba0614961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:00.301710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1a027-2c63-4a97-9dc5-324ba0614961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:00.303098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1a027-2c63-4a97-9dc5-324ba0614961 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:00.350891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:00.397918 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 561/1115] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:52:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:52:00.404052 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256afa5a-52d7-4f97-b03b-4394bb118ce4 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:00.501182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256afa5a-52d7-4f97-b03b-4394bb118ce4 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:00.532948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c920fb-c358-4426-b1a1-77bf38048c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:00.533558 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c920fb-c358-4426-b1a1-77bf38048c3a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:00.533837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c920fb-c358-4426-b1a1-77bf38048c3a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:00.534108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c920fb-c358-4426-b1a1-77bf38048c3a None admin] PATH_INFO: `/v3/projects/c2b24f555bf644039458c22a3d093763` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:00.535211 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c920fb-c358-4426-b1a1-77bf38048c3a None admin] RBAC: Authorizing `identity:get_project(project_id=c2b24f555bf644039458c22a3d093763)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:00.536653 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c920fb-c358-4426-b1a1-77bf38048c3a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:00.538248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 555/1116] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:52:00 2022] GET /identity/v3/projects/c2b24f555bf644039458c22a3d093763 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:00.544837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1a027-2c63-4a97-9dc5-324ba0614961 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:00.639120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1a027-2c63-4a97-9dc5-324ba0614961 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:00.671448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e506aa8-3357-459f-a7ab-59bfc06dec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:00.672059 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e506aa8-3357-459f-a7ab-59bfc06dec15 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:00.672340 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e506aa8-3357-459f-a7ab-59bfc06dec15 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:00.672609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e506aa8-3357-459f-a7ab-59bfc06dec15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:00.673313 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e506aa8-3357-459f-a7ab-59bfc06dec15 None admin] RBAC: Adding query filter params (role.id=d78c47b14910477fa17f456efbbc177c, scope.project.id=c2b24f555bf644039458c22a3d093763, user.id=f7c8b1c1368946ba93ea94bb21943f91) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:52:00.673616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e506aa8-3357-459f-a7ab-59bfc06dec15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:00.675214 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e506aa8-3357-459f-a7ab-59bfc06dec15 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:00.680384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 562/1117] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:52:00 2022] GET /identity/v3/role_assignments?user.id=f7c8b1c1368946ba93ea94bb21943f91&scope.project.id=c2b24f555bf644039458c22a3d093763&role.id=d78c47b14910477fa17f456efbbc177c => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:02.524450 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a4211-fe14-40ec-b277-72e7701d158b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:02.524969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a4211-fe14-40ec-b277-72e7701d158b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:02.525078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a4211-fe14-40ec-b277-72e7701d158b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:02.526391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 556/1118] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:02.531644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a912d0-9c76-4e9a-851c-677667f1d601 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:02.532093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a912d0-9c76-4e9a-851c-677667f1d601 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:02.532212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a912d0-9c76-4e9a-851c-677667f1d601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:02.550625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-82a912d0-9c76-4e9a-851c-677667f1d601 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:02.551835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-82a912d0-9c76-4e9a-851c-677667f1d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:02.563185 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:02.619216 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 563/1119] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:52:02.893397 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a4211-fe14-40ec-b277-72e7701d158b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:02.936111 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:02.995274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a4211-fe14-40ec-b277-72e7701d158b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:03.028155 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859a3dc-a8a3-4658-a6ba-f6dad52c7e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:03.028775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859a3dc-a8a3-4658-a6ba-f6dad52c7e90 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:03.029055 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859a3dc-a8a3-4658-a6ba-f6dad52c7e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:03.029327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f859a3dc-a8a3-4658-a6ba-f6dad52c7e90 None admin] PATH_INFO: `/v3/roles/d78c47b14910477fa17f456efbbc177c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:03.030707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859a3dc-a8a3-4658-a6ba-f6dad52c7e90 None admin] RBAC: Authorizing `identity:get_role(role_id=d78c47b14910477fa17f456efbbc177c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:03.032079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f859a3dc-a8a3-4658-a6ba-f6dad52c7e90 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:03.033364 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 557/1120] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:52:02 2022] GET /identity/v3/roles/d78c47b14910477fa17f456efbbc177c => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:03.039120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a912d0-9c76-4e9a-851c-677667f1d601 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:03.133258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a912d0-9c76-4e9a-851c-677667f1d601 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:03.166380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea115f3-57e4-4ab9-8dde-f0a94bbf13f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:03.166927 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea115f3-57e4-4ab9-8dde-f0a94bbf13f4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:03.167202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea115f3-57e4-4ab9-8dde-f0a94bbf13f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:03.167471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea115f3-57e4-4ab9-8dde-f0a94bbf13f4 None admin] PATH_INFO: `/v3/users/f7c8b1c1368946ba93ea94bb21943f91` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:03.168590 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea115f3-57e4-4ab9-8dde-f0a94bbf13f4 None admin] RBAC: Authorizing `identity:get_user(user_id=f7c8b1c1368946ba93ea94bb21943f91)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:03.170001 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea115f3-57e4-4ab9-8dde-f0a94bbf13f4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:03.171535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 564/1121] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:52:03 2022] GET /identity/v3/users/f7c8b1c1368946ba93ea94bb21943f91 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:03.177161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859a3dc-a8a3-4658-a6ba-f6dad52c7e90 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:03.273789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f859a3dc-a8a3-4658-a6ba-f6dad52c7e90 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:03.282886 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:03.306603 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030e0a3-8ad1-4952-82f3-852b2b887e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:03.307293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030e0a3-8ad1-4952-82f3-852b2b887e2b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:03.307575 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030e0a3-8ad1-4952-82f3-852b2b887e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:03.307762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030e0a3-8ad1-4952-82f3-852b2b887e2b None admin] PATH_INFO: `/v3/projects/c2b24f555bf644039458c22a3d093763` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:03.308911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030e0a3-8ad1-4952-82f3-852b2b887e2b None admin] RBAC: Authorizing `identity:get_project(project_id=c2b24f555bf644039458c22a3d093763)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:03.310318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030e0a3-8ad1-4952-82f3-852b2b887e2b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:03.311942 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 558/1122] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:52:03 2022] GET /identity/v3/projects/c2b24f555bf644039458c22a3d093763 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:03.317731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea115f3-57e4-4ab9-8dde-f0a94bbf13f4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:03.333880 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:03.416685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea115f3-57e4-4ab9-8dde-f0a94bbf13f4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:03.449931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec65c8-6cf4-4e2d-bc08-000cee0a15d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:03.450572 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec65c8-6cf4-4e2d-bc08-000cee0a15d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:03.450850 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec65c8-6cf4-4e2d-bc08-000cee0a15d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:03.451117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec65c8-6cf4-4e2d-bc08-000cee0a15d6 None admin] PATH_INFO: `/v3/projects/c2b24f555bf644039458c22a3d093763/users/f7c8b1c1368946ba93ea94bb21943f91/roles/d78c47b14910477fa17f456efbbc177c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:03.453230 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec65c8-6cf4-4e2d-bc08-000cee0a15d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2b24f555bf644039458c22a3d093763, user_id=f7c8b1c1368946ba93ea94bb21943f91, role_id=d78c47b14910477fa17f456efbbc177c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:03.454645 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec65c8-6cf4-4e2d-bc08-000cee0a15d6 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:03.572187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 565/1123] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:52:03 2022] PUT /identity/v3/projects/c2b24f555bf644039458c22a3d093763/users/f7c8b1c1368946ba93ea94bb21943f91/roles/d78c47b14910477fa17f456efbbc177c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:52:05.431868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e2566-004a-4102-af7a-a3e31ee0e852 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:05.432378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e2566-004a-4102-af7a-a3e31ee0e852 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:05.432497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e2566-004a-4102-af7a-a3e31ee0e852 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:05.433747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 559/1124] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:52:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:05.438849 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbe81a-7645-4841-8998-4da0d83261b8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:05.439281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbe81a-7645-4841-8998-4da0d83261b8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:05.439410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbe81a-7645-4841-8998-4da0d83261b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:05.457655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-71dbe81a-7645-4841-8998-4da0d83261b8 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:05.458839 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-71dbe81a-7645-4841-8998-4da0d83261b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:05.522643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 566/1125] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:52:05.793930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e2566-004a-4102-af7a-a3e31ee0e852 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:05.893726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e2566-004a-4102-af7a-a3e31ee0e852 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:05.926557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914fc74-442f-4562-a8b8-c83fc01b38ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:05.927166 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914fc74-442f-4562-a8b8-c83fc01b38ad None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:05.927444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914fc74-442f-4562-a8b8-c83fc01b38ad None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:05.927716 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3914fc74-442f-4562-a8b8-c83fc01b38ad None admin] PATH_INFO: `/v3/roles/d78c47b14910477fa17f456efbbc177c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:05.929128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914fc74-442f-4562-a8b8-c83fc01b38ad None admin] RBAC: Authorizing `identity:get_role(role_id=d78c47b14910477fa17f456efbbc177c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:05.930606 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3914fc74-442f-4562-a8b8-c83fc01b38ad None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:05.931919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 560/1126] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:52:05 2022] GET /identity/v3/roles/d78c47b14910477fa17f456efbbc177c => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:05.938126 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbe81a-7645-4841-8998-4da0d83261b8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:05.941381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:06.034660 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbe81a-7645-4841-8998-4da0d83261b8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:06.067763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651742ed-8b39-4c8b-aa69-e3ee16f657ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:06.068343 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651742ed-8b39-4c8b-aa69-e3ee16f657ad None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:06.068622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651742ed-8b39-4c8b-aa69-e3ee16f657ad None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:06.068893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651742ed-8b39-4c8b-aa69-e3ee16f657ad None admin] PATH_INFO: `/v3/users/f7c8b1c1368946ba93ea94bb21943f91` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:06.070001 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651742ed-8b39-4c8b-aa69-e3ee16f657ad None admin] RBAC: Authorizing `identity:get_user(user_id=f7c8b1c1368946ba93ea94bb21943f91)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:06.071459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651742ed-8b39-4c8b-aa69-e3ee16f657ad None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:06.073052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 567/1127] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:52:05 2022] GET /identity/v3/users/f7c8b1c1368946ba93ea94bb21943f91 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:06.078823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914fc74-442f-4562-a8b8-c83fc01b38ad None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:06.125929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:06.179622 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3914fc74-442f-4562-a8b8-c83fc01b38ad None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:06.214148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034f7b3-e2c9-4237-a973-d6a9679fd693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:06.214744 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034f7b3-e2c9-4237-a973-d6a9679fd693 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:06.215025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034f7b3-e2c9-4237-a973-d6a9679fd693 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:06.215298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6034f7b3-e2c9-4237-a973-d6a9679fd693 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:06.282688 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034f7b3-e2c9-4237-a973-d6a9679fd693 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:06.284133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6034f7b3-e2c9-4237-a973-d6a9679fd693 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:06.326842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:06.380633 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 561/1128] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:52:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:52:06.387347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651742ed-8b39-4c8b-aa69-e3ee16f657ad None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:06.454147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:06.483482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651742ed-8b39-4c8b-aa69-e3ee16f657ad None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:06.515464 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abaefc5-15c7-456a-80c3-2c9538295f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:06.516108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaefc5-15c7-456a-80c3-2c9538295f93 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:06.516392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaefc5-15c7-456a-80c3-2c9538295f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:06.516664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abaefc5-15c7-456a-80c3-2c9538295f93 None admin] PATH_INFO: `/v3/projects/c2b24f555bf644039458c22a3d093763` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:06.517769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaefc5-15c7-456a-80c3-2c9538295f93 None admin] RBAC: Authorizing `identity:get_project(project_id=c2b24f555bf644039458c22a3d093763)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:06.519177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abaefc5-15c7-456a-80c3-2c9538295f93 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:06.520813 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 568/1129] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:52:06 2022] GET /identity/v3/projects/c2b24f555bf644039458c22a3d093763 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:06.527407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034f7b3-e2c9-4237-a973-d6a9679fd693 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:06.623068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6034f7b3-e2c9-4237-a973-d6a9679fd693 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:06.655535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4606b0-07b2-45c6-b3da-f78dbeda2ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:06.656150 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4606b0-07b2-45c6-b3da-f78dbeda2ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:06.656427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4606b0-07b2-45c6-b3da-f78dbeda2ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:06.656697 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4606b0-07b2-45c6-b3da-f78dbeda2ca3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:06.657404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4606b0-07b2-45c6-b3da-f78dbeda2ca3 None admin] RBAC: Adding query filter params (role.id=d78c47b14910477fa17f456efbbc177c, scope.project.id=c2b24f555bf644039458c22a3d093763, user.id=f7c8b1c1368946ba93ea94bb21943f91) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:52:06.657708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4606b0-07b2-45c6-b3da-f78dbeda2ca3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:06.659105 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4606b0-07b2-45c6-b3da-f78dbeda2ca3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:06.664652 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 562/1130] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:52:06 2022] GET /identity/v3/role_assignments?user.id=f7c8b1c1368946ba93ea94bb21943f91&scope.project.id=c2b24f555bf644039458c22a3d093763&role.id=d78c47b14910477fa17f456efbbc177c => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:08.560876 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085d31-a225-4a70-a51c-ac95ec709262 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:08.561456 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085d31-a225-4a70-a51c-ac95ec709262 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:08.561456 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51085d31-a225-4a70-a51c-ac95ec709262 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:08.562748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 569/1131] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:08.567838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780339-e4fb-4a48-b0ae-9f761cb674bc None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:08.568256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780339-e4fb-4a48-b0ae-9f761cb674bc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:08.568409 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e780339-e4fb-4a48-b0ae-9f761cb674bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:08.586202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0e780339-e4fb-4a48-b0ae-9f761cb674bc None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:08.587583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0e780339-e4fb-4a48-b0ae-9f761cb674bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:08.589519 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:08.653102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 563/1132] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:52:08.923075 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51085d31-a225-4a70-a51c-ac95ec709262 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:09.023345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51085d31-a225-4a70-a51c-ac95ec709262 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:09.056030 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae2401-c171-46cc-97a6-b2558beff8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:09.056640 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae2401-c171-46cc-97a6-b2558beff8cf None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:09.056920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae2401-c171-46cc-97a6-b2558beff8cf None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:09.057193 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae2401-c171-46cc-97a6-b2558beff8cf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:09.058293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae2401-c171-46cc-97a6-b2558beff8cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:09.059733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae2401-c171-46cc-97a6-b2558beff8cf None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:09.061302 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 570/1133] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:52:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:09.067225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e780339-e4fb-4a48-b0ae-9f761cb674bc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:09.161811 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e780339-e4fb-4a48-b0ae-9f761cb674bc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:09.194848 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791002db-fb76-4728-9f2a-71db2b912aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:09.195385 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791002db-fb76-4728-9f2a-71db2b912aff None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:09.196291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791002db-fb76-4728-9f2a-71db2b912aff None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:09.196735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791002db-fb76-4728-9f2a-71db2b912aff None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:09.197376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791002db-fb76-4728-9f2a-71db2b912aff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:09.198778 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791002db-fb76-4728-9f2a-71db2b912aff None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:09.207678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:09.304816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 564/1134] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 24 07:52:09 2022] POST /identity/v3/projects => generated 311 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:52:11.230791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d3631-31c7-422e-abca-2d20ae4dde6a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:11.231356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d3631-31c7-422e-abca-2d20ae4dde6a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:11.231356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9d3631-31c7-422e-abca-2d20ae4dde6a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:11.232704 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 571/1135] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:11.237961 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5771c-1c0d-4c1b-b2cf-bf68ea2c7464 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:11.238371 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5771c-1c0d-4c1b-b2cf-bf68ea2c7464 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:11.238514 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5771c-1c0d-4c1b-b2cf-bf68ea2c7464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:11.256238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-77c5771c-1c0d-4c1b-b2cf-bf68ea2c7464 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:11.257432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-77c5771c-1c0d-4c1b-b2cf-bf68ea2c7464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:11.322879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 565/1136] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:52:11.592368 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d3631-31c7-422e-abca-2d20ae4dde6a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:11.603354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:11.691942 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9d3631-31c7-422e-abca-2d20ae4dde6a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:11.726560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182c0a34-ed91-4af2-a5d0-fc0437d11d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:11.727297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c0a34-ed91-4af2-a5d0-fc0437d11d61 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:11.727574 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c0a34-ed91-4af2-a5d0-fc0437d11d61 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:11.727868 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182c0a34-ed91-4af2-a5d0-fc0437d11d61 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:11.728978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c0a34-ed91-4af2-a5d0-fc0437d11d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:11.730387 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182c0a34-ed91-4af2-a5d0-fc0437d11d61 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:11.732007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 572/1137] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:52:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:11.737836 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5771c-1c0d-4c1b-b2cf-bf68ea2c7464 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:11.835416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5771c-1c0d-4c1b-b2cf-bf68ea2c7464 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:11.855248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:11.869195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc31a26e-b7e8-41ba-9252-f59aba7a5e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:11.870191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31a26e-b7e8-41ba-9252-f59aba7a5e76 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:11.870477 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31a26e-b7e8-41ba-9252-f59aba7a5e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:11.870749 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc31a26e-b7e8-41ba-9252-f59aba7a5e76 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:11.871399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31a26e-b7e8-41ba-9252-f59aba7a5e76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:11.872841 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc31a26e-b7e8-41ba-9252-f59aba7a5e76 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:11.977630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 566/1138] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:52:11 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:52:13.895083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017a96b-c736-4e94-a83b-c9c45800d422 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:13.895623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017a96b-c736-4e94-a83b-c9c45800d422 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:13.895623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017a96b-c736-4e94-a83b-c9c45800d422 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:13.896996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 573/1139] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:13.902252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec7327-a26e-4ee0-8cd9-880d230b9a65 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:13.902779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec7327-a26e-4ee0-8cd9-880d230b9a65 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:13.902779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ec7327-a26e-4ee0-8cd9-880d230b9a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:13.921125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-12ec7327-a26e-4ee0-8cd9-880d230b9a65 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:13.922308 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-12ec7327-a26e-4ee0-8cd9-880d230b9a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:13.987747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 567/1140] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:52:14.258958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017a96b-c736-4e94-a83b-c9c45800d422 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:14.333153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:14.356751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017a96b-c736-4e94-a83b-c9c45800d422 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:14.389730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7b34-ed6c-4a6e-9dde-f25a482acff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:14.390348 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7b34-ed6c-4a6e-9dde-f25a482acff9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:14.390627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7b34-ed6c-4a6e-9dde-f25a482acff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:14.390896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a7b34-ed6c-4a6e-9dde-f25a482acff9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:14.401183 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a7b34-ed6c-4a6e-9dde-f25a482acff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5b2a7b34-ed6c-4a6e-9dde-f25a482acff9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:52:14.405778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:52:14.406994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:52:14.408237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:52:14.408237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:52:14.408237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:52:14.408237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:52:14.408237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:52:14.408237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:52:14.408237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:52:14.408237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:52:14.408237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:52:14.408237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:52:14.408237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:52:14.408237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:52:14.408237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 574/1141] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:52:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:52:14.412845 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec7327-a26e-4ee0-8cd9-880d230b9a65 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:14.509069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ec7327-a26e-4ee0-8cd9-880d230b9a65 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:14.516009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:14.542404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b0311-0fd7-404a-af52-f45c0c47ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:14.543171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b0311-0fd7-404a-af52-f45c0c47ba92 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:14.543602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b0311-0fd7-404a-af52-f45c0c47ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:14.544247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b0311-0fd7-404a-af52-f45c0c47ba92 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:14.544928 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b0311-0fd7-404a-af52-f45c0c47ba92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:52:14.545226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b0311-0fd7-404a-af52-f45c0c47ba92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:14.546577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742b0311-0fd7-404a-af52-f45c0c47ba92 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:14.554251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 568/1142] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:52:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:14.560263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7b34-ed6c-4a6e-9dde-f25a482acff9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:14.656448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a7b34-ed6c-4a6e-9dde-f25a482acff9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:14.688251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343a48d-193f-4857-be62-70888d4f3a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:14.688857 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a48d-193f-4857-be62-70888d4f3a87 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:14.689133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a48d-193f-4857-be62-70888d4f3a87 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:14.689401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c343a48d-193f-4857-be62-70888d4f3a87 None admin] PATH_INFO: `/v3/users/0c3917963c334dabbaa334cab1edfe2b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:14.691994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:14.702734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343a48d-193f-4857-be62-70888d4f3a87 None admin] RBAC: Authorizing `identity:get_user(user_id=0c3917963c334dabbaa334cab1edfe2b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:14.704356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c343a48d-193f-4857-be62-70888d4f3a87 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:14.705961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 575/1143] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:52:14 2022] GET /identity/v3/users/0c3917963c334dabbaa334cab1edfe2b => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:14.712692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b0311-0fd7-404a-af52-f45c0c47ba92 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:14.875789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b0311-0fd7-404a-af52-f45c0c47ba92 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:14.908634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a32b58-af79-4f48-b4ea-eaf08a9940f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:14.909328 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a32b58-af79-4f48-b4ea-eaf08a9940f6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:14.909567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a32b58-af79-4f48-b4ea-eaf08a9940f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:14.909843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a32b58-af79-4f48-b4ea-eaf08a9940f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:14.943029 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:14.975371 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a32b58-af79-4f48-b4ea-eaf08a9940f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:14.976962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a32b58-af79-4f48-b4ea-eaf08a9940f6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:15.070984 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 569/1144] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:52:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:52:15.076867 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343a48d-193f-4857-be62-70888d4f3a87 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:15.172225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c343a48d-193f-4857-be62-70888d4f3a87 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:15.204970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabc5a6a-4365-466a-a1e8-39fb5bee8c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:15.205581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc5a6a-4365-466a-a1e8-39fb5bee8c1c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:15.205861 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc5a6a-4365-466a-a1e8-39fb5bee8c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:15.206135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabc5a6a-4365-466a-a1e8-39fb5bee8c1c None admin] PATH_INFO: `/v3/projects/b55bdb722a5848c882ca7fd56208f0a9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:15.207231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc5a6a-4365-466a-a1e8-39fb5bee8c1c None admin] RBAC: Authorizing `identity:get_project(project_id=b55bdb722a5848c882ca7fd56208f0a9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:15.208702 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabc5a6a-4365-466a-a1e8-39fb5bee8c1c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:15.210576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 576/1145] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:52:15 2022] GET /identity/v3/projects/b55bdb722a5848c882ca7fd56208f0a9 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:15.216680 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a32b58-af79-4f48-b4ea-eaf08a9940f6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:15.280754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:15.313810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a32b58-af79-4f48-b4ea-eaf08a9940f6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:15.345976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fdbc97-3ff2-4f4f-bc38-d946faf002cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:15.346564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdbc97-3ff2-4f4f-bc38-d946faf002cc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:15.346840 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdbc97-3ff2-4f4f-bc38-d946faf002cc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:15.347107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fdbc97-3ff2-4f4f-bc38-d946faf002cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:15.347809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdbc97-3ff2-4f4f-bc38-d946faf002cc None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=b55bdb722a5848c882ca7fd56208f0a9, user.id=0c3917963c334dabbaa334cab1edfe2b) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:52:15.348141 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdbc97-3ff2-4f4f-bc38-d946faf002cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:15.349538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fdbc97-3ff2-4f4f-bc38-d946faf002cc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:15.355147 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 570/1146] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:52:15 2022] GET /identity/v3/role_assignments?user.id=0c3917963c334dabbaa334cab1edfe2b&scope.project.id=b55bdb722a5848c882ca7fd56208f0a9&role.id=68b1888f7bb644a39938b8d41006a813 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:17.379435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75e05-ffca-43e9-a769-252f3e8a28c9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:17.379877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75e05-ffca-43e9-a769-252f3e8a28c9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:17.380012 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f75e05-ffca-43e9-a769-252f3e8a28c9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:17.381362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 577/1147] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:17.387159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc431-ff24-49ea-84ca-3884c07bc529 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:17.387564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc431-ff24-49ea-84ca-3884c07bc529 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:17.387704 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbc431-ff24-49ea-84ca-3884c07bc529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:17.405304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8ccbc431-ff24-49ea-84ca-3884c07bc529 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:17.406494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8ccbc431-ff24-49ea-84ca-3884c07bc529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:17.471471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 571/1148] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:52:17.738405 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f75e05-ffca-43e9-a769-252f3e8a28c9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:17.799567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:17.838582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f75e05-ffca-43e9-a769-252f3e8a28c9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:17.872329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50d583-e087-40c2-85b5-48ddec346b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:17.872948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50d583-e087-40c2-85b5-48ddec346b10 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:17.873231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50d583-e087-40c2-85b5-48ddec346b10 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:17.873507 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50d583-e087-40c2-85b5-48ddec346b10 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:17.883441 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50d583-e087-40c2-85b5-48ddec346b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-fd50d583-e087-40c2-85b5-48ddec346b10 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:52:17.888191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:52:17.889299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:52:17.890460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:52:17.890460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:52:17.890460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:52:17.890460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:52:17.890460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:52:17.890460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:52:17.890460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:52:17.890460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:52:17.890460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:52:17.890460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:52:17.890460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:52:17.890460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:52:17.890460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 578/1149] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:52:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:52:17.895530 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc431-ff24-49ea-84ca-3884c07bc529 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:17.954727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:17.993963 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbc431-ff24-49ea-84ca-3884c07bc529 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:18.027195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f5cf9-4a1c-4582-8b03-185389cb7cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:18.027788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f5cf9-4a1c-4582-8b03-185389cb7cc3 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:18.028096 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f5cf9-4a1c-4582-8b03-185389cb7cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:18.028368 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f5cf9-4a1c-4582-8b03-185389cb7cc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:18.029019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f5cf9-4a1c-4582-8b03-185389cb7cc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:52:18.029322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f5cf9-4a1c-4582-8b03-185389cb7cc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:18.030669 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8f5cf9-4a1c-4582-8b03-185389cb7cc3 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:18.038843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 572/1150] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:52:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:18.045259 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50d583-e087-40c2-85b5-48ddec346b10 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:18.142695 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50d583-e087-40c2-85b5-48ddec346b10 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:18.165147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:18.176212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058b45-7a25-4480-a851-0f17d6026737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:18.176911 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058b45-7a25-4480-a851-0f17d6026737 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:18.177194 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058b45-7a25-4480-a851-0f17d6026737 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:18.177466 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb058b45-7a25-4480-a851-0f17d6026737 None admin] PATH_INFO: `/v3/users/0c3917963c334dabbaa334cab1edfe2b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:18.178590 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb058b45-7a25-4480-a851-0f17d6026737 None admin] RBAC: Authorizing `identity:get_user(user_id=0c3917963c334dabbaa334cab1edfe2b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:18.180101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb058b45-7a25-4480-a851-0f17d6026737 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:18.181685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 579/1151] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:52:18 2022] GET /identity/v3/users/0c3917963c334dabbaa334cab1edfe2b => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:18.187382 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f5cf9-4a1c-4582-8b03-185389cb7cc3 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:18.284731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f5cf9-4a1c-4582-8b03-185389cb7cc3 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:18.306947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:18.317092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d28fa0a-ef93-462a-b7e1-cb40e7c6864c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:18.319634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28fa0a-ef93-462a-b7e1-cb40e7c6864c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:18.319634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28fa0a-ef93-462a-b7e1-cb40e7c6864c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:18.319634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d28fa0a-ef93-462a-b7e1-cb40e7c6864c None admin] PATH_INFO: `/v3/projects/b55bdb722a5848c882ca7fd56208f0a9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:18.319634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28fa0a-ef93-462a-b7e1-cb40e7c6864c None admin] RBAC: Authorizing `identity:get_project(project_id=b55bdb722a5848c882ca7fd56208f0a9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:18.321345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d28fa0a-ef93-462a-b7e1-cb40e7c6864c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:18.322922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 573/1152] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:52:18 2022] GET /identity/v3/projects/b55bdb722a5848c882ca7fd56208f0a9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:18.328878 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058b45-7a25-4480-a851-0f17d6026737 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:18.426998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb058b45-7a25-4480-a851-0f17d6026737 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:18.459337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe3aa0-c83c-484d-9411-085df25b3d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:18.460321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe3aa0-c83c-484d-9411-085df25b3d3f None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:18.461307 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe3aa0-c83c-484d-9411-085df25b3d3f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:18.461608 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe3aa0-c83c-484d-9411-085df25b3d3f None admin] PATH_INFO: `/v3/projects/b55bdb722a5848c882ca7fd56208f0a9/users/0c3917963c334dabbaa334cab1edfe2b/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:18.463507 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe3aa0-c83c-484d-9411-085df25b3d3f None admin] RBAC: Authorizing `identity:create_grant(project_id=b55bdb722a5848c882ca7fd56208f0a9, user_id=0c3917963c334dabbaa334cab1edfe2b, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:18.464952 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fe3aa0-c83c-484d-9411-085df25b3d3f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:18.548080 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 580/1153] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:52:18 2022] PUT /identity/v3/projects/b55bdb722a5848c882ca7fd56208f0a9/users/0c3917963c334dabbaa334cab1edfe2b/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:52:20.412673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fe280-db03-42f0-ace0-e2ea2b333eca None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:20.413146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fe280-db03-42f0-ace0-e2ea2b333eca None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:20.413253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388fe280-db03-42f0-ace0-e2ea2b333eca None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:20.415097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 574/1154] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:20.420235 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbd315-a81b-4af8-87e0-faff6ed915c6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:20.420631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbd315-a81b-4af8-87e0-faff6ed915c6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:20.420784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbd315-a81b-4af8-87e0-faff6ed915c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:20.438102 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4ebbd315-a81b-4af8-87e0-faff6ed915c6 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:20.439270 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4ebbd315-a81b-4af8-87e0-faff6ed915c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:20.483551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:20.502582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 581/1155] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:52:20.776182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fe280-db03-42f0-ace0-e2ea2b333eca None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:20.875196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388fe280-db03-42f0-ace0-e2ea2b333eca None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:20.908304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7c094-8395-4bed-ad85-71c49818cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:20.908917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7c094-8395-4bed-ad85-71c49818cae9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:20.909195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7c094-8395-4bed-ad85-71c49818cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:20.909463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7c094-8395-4bed-ad85-71c49818cae9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:20.919201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7c094-8395-4bed-ad85-71c49818cae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-79a7c094-8395-4bed-ad85-71c49818cae9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:52:20.923920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:52:20.925072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:52:20.925926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:52:20.925926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:52:20.925926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:52:20.925926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:52:20.925926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:52:20.925926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:52:20.925926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:52:20.925926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:52:20.925926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:52:20.925926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:52:20.925926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:52:20.925926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:52:20.925926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 575/1156] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:52:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:52:20.931458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbd315-a81b-4af8-87e0-faff6ed915c6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:21.025652 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbd315-a81b-4af8-87e0-faff6ed915c6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:21.057925 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc3046-8178-4ff4-8ae2-aaf783bd6cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:21.058459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3046-8178-4ff4-8ae2-aaf783bd6cfa None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:21.058733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3046-8178-4ff4-8ae2-aaf783bd6cfa None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:21.058997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dc3046-8178-4ff4-8ae2-aaf783bd6cfa None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:21.059641 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc3046-8178-4ff4-8ae2-aaf783bd6cfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:52:21.059967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc3046-8178-4ff4-8ae2-aaf783bd6cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:21.061302 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dc3046-8178-4ff4-8ae2-aaf783bd6cfa None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:21.068863 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 582/1157] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:52:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:21.075252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7c094-8395-4bed-ad85-71c49818cae9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:21.127601 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:21.175015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7c094-8395-4bed-ad85-71c49818cae9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:21.208817 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948bccc-b8e7-4afb-8211-121b05c83951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:21.209430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948bccc-b8e7-4afb-8211-121b05c83951 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:21.209961 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948bccc-b8e7-4afb-8211-121b05c83951 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:21.210232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c948bccc-b8e7-4afb-8211-121b05c83951 None admin] PATH_INFO: `/v3/users/0c3917963c334dabbaa334cab1edfe2b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:21.211385 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948bccc-b8e7-4afb-8211-121b05c83951 None admin] RBAC: Authorizing `identity:get_user(user_id=0c3917963c334dabbaa334cab1edfe2b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:21.212828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c948bccc-b8e7-4afb-8211-121b05c83951 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:21.214372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 576/1158] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:52:21 2022] GET /identity/v3/users/0c3917963c334dabbaa334cab1edfe2b => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:21.220276 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc3046-8178-4ff4-8ae2-aaf783bd6cfa None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:21.262434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:21.318078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dc3046-8178-4ff4-8ae2-aaf783bd6cfa None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:21.350352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf7522-cfa6-42f3-8410-af5cf313b7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:21.350948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7522-cfa6-42f3-8410-af5cf313b7de None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:21.351961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7522-cfa6-42f3-8410-af5cf313b7de None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:21.352242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bf7522-cfa6-42f3-8410-af5cf313b7de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:21.417047 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf7522-cfa6-42f3-8410-af5cf313b7de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:21.418468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bf7522-cfa6-42f3-8410-af5cf313b7de None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:21.458036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:21.514140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 583/1159] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:52:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:52:21.520063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948bccc-b8e7-4afb-8211-121b05c83951 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:21.617470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c948bccc-b8e7-4afb-8211-121b05c83951 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:21.635955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:21.649858 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ed29f-0ffa-4376-b29c-9b9929393198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:21.650472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ed29f-0ffa-4376-b29c-9b9929393198 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:21.650752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ed29f-0ffa-4376-b29c-9b9929393198 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:21.651023 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ed29f-0ffa-4376-b29c-9b9929393198 None admin] PATH_INFO: `/v3/projects/b55bdb722a5848c882ca7fd56208f0a9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:21.652156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ed29f-0ffa-4376-b29c-9b9929393198 None admin] RBAC: Authorizing `identity:get_project(project_id=b55bdb722a5848c882ca7fd56208f0a9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:21.653561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ed29f-0ffa-4376-b29c-9b9929393198 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:21.655147 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 577/1160] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:52:21 2022] GET /identity/v3/projects/b55bdb722a5848c882ca7fd56208f0a9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:21.661124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf7522-cfa6-42f3-8410-af5cf313b7de None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:21.757462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bf7522-cfa6-42f3-8410-af5cf313b7de None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:21.790664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a8755-4c81-47d6-8992-c8c6bd2f1a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:21.791260 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a8755-4c81-47d6-8992-c8c6bd2f1a90 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:21.791542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a8755-4c81-47d6-8992-c8c6bd2f1a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:21.791817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a8755-4c81-47d6-8992-c8c6bd2f1a90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:21.792566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a8755-4c81-47d6-8992-c8c6bd2f1a90 None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=b55bdb722a5848c882ca7fd56208f0a9, user.id=0c3917963c334dabbaa334cab1edfe2b) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:52:21.792878 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a8755-4c81-47d6-8992-c8c6bd2f1a90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:21.794292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a8755-4c81-47d6-8992-c8c6bd2f1a90 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:21.799805 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 584/1161] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:52:21 2022] GET /identity/v3/role_assignments?user.id=0c3917963c334dabbaa334cab1edfe2b&scope.project.id=b55bdb722a5848c882ca7fd56208f0a9&role.id=68b1888f7bb644a39938b8d41006a813 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:23.709823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c8877-8f3e-45ba-9cc5-0754a0bc2879 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:23.710416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c8877-8f3e-45ba-9cc5-0754a0bc2879 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:23.710416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c8877-8f3e-45ba-9cc5-0754a0bc2879 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:23.712202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 578/1162] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:52:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:52:23.717463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b89b9c-6988-477f-bb64-46e905a119e0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:23.717864 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b89b9c-6988-477f-bb64-46e905a119e0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:23.718023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b89b9c-6988-477f-bb64-46e905a119e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:23.731077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:23.736302 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-15b89b9c-6988-477f-bb64-46e905a119e0 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:23.737496 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-15b89b9c-6988-477f-bb64-46e905a119e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:23.803176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 585/1163] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:52:24.074847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c8877-8f3e-45ba-9cc5-0754a0bc2879 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:24.174291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c8877-8f3e-45ba-9cc5-0754a0bc2879 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:24.206597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4739594-d251-4438-a952-1947296b36b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:24.207186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4739594-d251-4438-a952-1947296b36b1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:24.207465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4739594-d251-4438-a952-1947296b36b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:24.207736 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4739594-d251-4438-a952-1947296b36b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:24.260915 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:24.272347 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4739594-d251-4438-a952-1947296b36b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:24.273921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4739594-d251-4438-a952-1947296b36b1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:24.369198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 579/1164] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:52:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:52:24.374968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b89b9c-6988-477f-bb64-46e905a119e0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:24.470936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b89b9c-6988-477f-bb64-46e905a119e0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:24.503025 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b58f4-cc9a-47ad-83be-093cd9b8f73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:24.503644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b58f4-cc9a-47ad-83be-093cd9b8f73b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:24.503948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b58f4-cc9a-47ad-83be-093cd9b8f73b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:24.504225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b58f4-cc9a-47ad-83be-093cd9b8f73b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:24.506774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:24.511873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b58f4-cc9a-47ad-83be-093cd9b8f73b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:24.513292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b58f4-cc9a-47ad-83be-093cd9b8f73b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-ad2b58f4-cc9a-47ad-83be-093cd9b8f73b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:52:24.524800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:52:24.526023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:52:24.526895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 586/1165] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 24 07:52:24 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:52:24.531782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4739594-d251-4438-a952-1947296b36b1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:24.615278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:24.627418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4739594-d251-4438-a952-1947296b36b1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:24.660861 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddaad3-64a8-4b57-a655-dfa1b3f51231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:24.661451 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddaad3-64a8-4b57-a655-dfa1b3f51231 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:24.661729 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddaad3-64a8-4b57-a655-dfa1b3f51231 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:24.661999 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddaad3-64a8-4b57-a655-dfa1b3f51231 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:24.662633 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddaad3-64a8-4b57-a655-dfa1b3f51231 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:52:24.662938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddaad3-64a8-4b57-a655-dfa1b3f51231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:24.664344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddaad3-64a8-4b57-a655-dfa1b3f51231 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:24.671158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 580/1166] 10.222.0.62 () {56 vars in 1115 bytes} [Wed Aug 24 07:52:24 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:26.562579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb06f4-d692-443c-964b-bb6c3397d4d4 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:26.563095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb06f4-d692-443c-964b-bb6c3397d4d4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:26.563095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eb06f4-d692-443c-964b-bb6c3397d4d4 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:26.564485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 587/1167] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:52:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:26.570214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ef76a-c1c3-4de2-b2aa-316bdb9d3c3e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:26.570666 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ef76a-c1c3-4de2-b2aa-316bdb9d3c3e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:26.570762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4ef76a-c1c3-4de2-b2aa-316bdb9d3c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:26.588664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fc4ef76a-c1c3-4de2-b2aa-316bdb9d3c3e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:26.589837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fc4ef76a-c1c3-4de2-b2aa-316bdb9d3c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:26.655002 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 581/1168] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:52:26.919921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb06f4-d692-443c-964b-bb6c3397d4d4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:27.019577 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eb06f4-d692-443c-964b-bb6c3397d4d4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:27.052188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4606777c-c8ee-4710-bf5d-589fc050696d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:27.052779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606777c-c8ee-4710-bf5d-589fc050696d None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:27.053064 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606777c-c8ee-4710-bf5d-589fc050696d None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:27.053335 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4606777c-c8ee-4710-bf5d-589fc050696d None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:27.054527 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606777c-c8ee-4710-bf5d-589fc050696d None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:27.055940 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4606777c-c8ee-4710-bf5d-589fc050696d None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:27.154709 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 588/1169] 10.222.0.62 () {60 vars in 1138 bytes} [Wed Aug 24 07:52:26 2022] POST /identity/v3/domains => generated 267 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:52:29.070137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93845eb4-6cd6-4e1b-84b3-4d2aef21a039 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:29.070674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93845eb4-6cd6-4e1b-84b3-4d2aef21a039 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:29.070674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93845eb4-6cd6-4e1b-84b3-4d2aef21a039 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:29.072023 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 582/1170] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:29.077373 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b74bd6-6515-41f5-9e05-7af4f0e9acfb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:29.077817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b74bd6-6515-41f5-9e05-7af4f0e9acfb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:29.077932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b74bd6-6515-41f5-9e05-7af4f0e9acfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:29.095741 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-33b74bd6-6515-41f5-9e05-7af4f0e9acfb None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:29.096953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-33b74bd6-6515-41f5-9e05-7af4f0e9acfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:29.145958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:29.161573 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 589/1171] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:52:29.434045 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93845eb4-6cd6-4e1b-84b3-4d2aef21a039 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:29.513376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:29.531020 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93845eb4-6cd6-4e1b-84b3-4d2aef21a039 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:29.564386 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df2035-6426-40de-a554-13de29af564b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:29.564997 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df2035-6426-40de-a554-13de29af564b None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:29.565272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df2035-6426-40de-a554-13de29af564b None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:29.565539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df2035-6426-40de-a554-13de29af564b None admin] PATH_INFO: `/v3/domains/802fa248e1bd4071ba50b52826153be2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:29.575428 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df2035-6426-40de-a554-13de29af564b None admin] RBAC: Authorizing `identity:get_domain(domain_id=802fa248e1bd4071ba50b52826153be2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:29.576865 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df2035-6426-40de-a554-13de29af564b None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:29.578414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 583/1172] 10.222.0.62 () {56 vars in 1183 bytes} [Wed Aug 24 07:52:29 2022] GET /identity/v3/domains/802fa248e1bd4071ba50b52826153be2 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:29.584201 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b74bd6-6515-41f5-9e05-7af4f0e9acfb None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:29.680098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b74bd6-6515-41f5-9e05-7af4f0e9acfb None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:29.711371 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bc5af-5d10-4456-ad2c-01c14e26a795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:29.711984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc5af-5d10-4456-ad2c-01c14e26a795 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:29.712304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc5af-5d10-4456-ad2c-01c14e26a795 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:29.712570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bc5af-5d10-4456-ad2c-01c14e26a795 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:29.713193 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bc5af-5d10-4456-ad2c-01c14e26a795 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:29.714613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bc5af-5d10-4456-ad2c-01c14e26a795 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:29.795225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 590/1173] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 24 07:52:29 2022] POST /identity/v3/projects => generated 361 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:52:31.728926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9720c2-c4fc-49cd-b1f2-4174560a5231 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:31.729432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9720c2-c4fc-49cd-b1f2-4174560a5231 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:31.729432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9720c2-c4fc-49cd-b1f2-4174560a5231 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:31.730729 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 584/1174] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:31.736078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0566c-116f-4e33-811c-70ff7f09d489 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:31.736468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0566c-116f-4e33-811c-70ff7f09d489 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:31.736626 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc0566c-116f-4e33-811c-70ff7f09d489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:31.755472 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6dc0566c-116f-4e33-811c-70ff7f09d489 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:31.756732 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6dc0566c-116f-4e33-811c-70ff7f09d489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:31.784433 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:31.819873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 591/1175] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:52:32.091728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9720c2-c4fc-49cd-b1f2-4174560a5231 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:32.189377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9720c2-c4fc-49cd-b1f2-4174560a5231 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:32.222044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1460f21-562a-4989-83b9-cf15f6d1379e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:32.222648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1460f21-562a-4989-83b9-cf15f6d1379e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:32.222923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1460f21-562a-4989-83b9-cf15f6d1379e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:32.223196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1460f21-562a-4989-83b9-cf15f6d1379e None admin] PATH_INFO: `/v3/domains/802fa248e1bd4071ba50b52826153be2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:32.224317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1460f21-562a-4989-83b9-cf15f6d1379e None admin] RBAC: Authorizing `identity:get_domain(domain_id=802fa248e1bd4071ba50b52826153be2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:32.226720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1460f21-562a-4989-83b9-cf15f6d1379e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:32.228316 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 585/1176] 10.222.0.62 () {56 vars in 1183 bytes} [Wed Aug 24 07:52:32 2022] GET /identity/v3/domains/802fa248e1bd4071ba50b52826153be2 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:32.234206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0566c-116f-4e33-811c-70ff7f09d489 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:32.328457 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc0566c-116f-4e33-811c-70ff7f09d489 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:32.361829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a663c-cef0-41b5-8a5a-56f062cc60c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:32.362370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a663c-cef0-41b5-8a5a-56f062cc60c1 None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:32.362651 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a663c-cef0-41b5-8a5a-56f062cc60c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:32.362926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a663c-cef0-41b5-8a5a-56f062cc60c1 None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:32.363571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a663c-cef0-41b5-8a5a-56f062cc60c1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:32.365031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a663c-cef0-41b5-8a5a-56f062cc60c1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:32.451483 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 592/1177] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:52:32 2022] POST /identity/v3/users => generated 311 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:52:34.393262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ffc85-06f2-4222-9656-244f78aaeb8b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:34.393768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ffc85-06f2-4222-9656-244f78aaeb8b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:34.393870 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ffc85-06f2-4222-9656-244f78aaeb8b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:34.395134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 586/1178] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:34.400554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc277de2-1c61-4993-8a1b-c7e9a6af4de4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:34.401000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc277de2-1c61-4993-8a1b-c7e9a6af4de4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:34.401099 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc277de2-1c61-4993-8a1b-c7e9a6af4de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:34.418439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cc277de2-1c61-4993-8a1b-c7e9a6af4de4 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:34.419611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cc277de2-1c61-4993-8a1b-c7e9a6af4de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:34.437338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:34.486052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 593/1179] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:52:34.754814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ffc85-06f2-4222-9656-244f78aaeb8b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:34.767424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:34.854852 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796ffc85-06f2-4222-9656-244f78aaeb8b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:34.887062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecf187-3982-4930-bf62-a5ba5deb41f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:34.887672 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecf187-3982-4930-bf62-a5ba5deb41f1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:34.887976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecf187-3982-4930-bf62-a5ba5deb41f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:34.888244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ecf187-3982-4930-bf62-a5ba5deb41f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:34.898476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ecf187-3982-4930-bf62-a5ba5deb41f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-c5ecf187-3982-4930-bf62-a5ba5deb41f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:52:34.903127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:52:34.904380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:52:34.905542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:52:34.905542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:52:34.905542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:52:34.905542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:52:34.905542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:52:34.905542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:52:34.905542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:52:34.905542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:52:34.905542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:52:34.905542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:52:34.905542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:52:34.905542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:52:34.905542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 587/1180] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:52:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:52:34.910219 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc277de2-1c61-4993-8a1b-c7e9a6af4de4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:35.005328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc277de2-1c61-4993-8a1b-c7e9a6af4de4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:35.039524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603426b1-6345-4d73-bc58-d70b82d12af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:35.040148 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603426b1-6345-4d73-bc58-d70b82d12af2 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:35.040430 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603426b1-6345-4d73-bc58-d70b82d12af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:35.040701 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603426b1-6345-4d73-bc58-d70b82d12af2 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:35.041359 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603426b1-6345-4d73-bc58-d70b82d12af2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:52:35.041664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603426b1-6345-4d73-bc58-d70b82d12af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:35.043011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603426b1-6345-4d73-bc58-d70b82d12af2 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:35.050723 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 594/1181] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:52:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:35.056615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecf187-3982-4930-bf62-a5ba5deb41f1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:35.124410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:35.153783 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ecf187-3982-4930-bf62-a5ba5deb41f1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:35.186182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3d56d-f80e-4959-aae0-ba3c2abbfb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:35.186791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3d56d-f80e-4959-aae0-ba3c2abbfb84 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:35.187068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3d56d-f80e-4959-aae0-ba3c2abbfb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:35.187336 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe3d56d-f80e-4959-aae0-ba3c2abbfb84 None admin] PATH_INFO: `/v3/users/ddfad452bec4411ab910fcfe4f2221d8` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:35.200412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3d56d-f80e-4959-aae0-ba3c2abbfb84 None admin] RBAC: Authorizing `identity:get_user(user_id=ddfad452bec4411ab910fcfe4f2221d8)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:35.201822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe3d56d-f80e-4959-aae0-ba3c2abbfb84 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:35.203365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 588/1182] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:52:35 2022] GET /identity/v3/users/ddfad452bec4411ab910fcfe4f2221d8 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:35.209604 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603426b1-6345-4d73-bc58-d70b82d12af2 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:35.227757 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:35.309472 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603426b1-6345-4d73-bc58-d70b82d12af2 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:35.342938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce72072-3475-44d2-baf7-3e5d60854ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:35.343536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce72072-3475-44d2-baf7-3e5d60854ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:35.343815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce72072-3475-44d2-baf7-3e5d60854ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:35.344125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce72072-3475-44d2-baf7-3e5d60854ec7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:35.409976 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce72072-3475-44d2-baf7-3e5d60854ec7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:35.411399 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce72072-3475-44d2-baf7-3e5d60854ec7 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:35.427138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:35.505919 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 595/1183] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:52:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 07:52:35.512156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3d56d-f80e-4959-aae0-ba3c2abbfb84 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:35.608665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe3d56d-f80e-4959-aae0-ba3c2abbfb84 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:35.633827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:35.641244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853e8cd3-e5e9-460f-9675-7808e0399436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:35.646560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e8cd3-e5e9-460f-9675-7808e0399436 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:35.646560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e8cd3-e5e9-460f-9675-7808e0399436 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:35.646560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853e8cd3-e5e9-460f-9675-7808e0399436 None admin] PATH_INFO: `/v3/projects/11379479956c4cf3ab7c2bf5edf07143` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:35.646560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e8cd3-e5e9-460f-9675-7808e0399436 None admin] RBAC: Authorizing `identity:get_project(project_id=11379479956c4cf3ab7c2bf5edf07143)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:35.646560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853e8cd3-e5e9-460f-9675-7808e0399436 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:35.646560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 589/1184] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:52:35 2022] GET /identity/v3/projects/11379479956c4cf3ab7c2bf5edf07143 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:35.652622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce72072-3475-44d2-baf7-3e5d60854ec7 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:35.746907 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce72072-3475-44d2-baf7-3e5d60854ec7 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:35.762430 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:35.779553 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9365c1c-4020-4d7a-be0e-cdd98bba41e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:35.780172 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9365c1c-4020-4d7a-be0e-cdd98bba41e3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:35.780453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9365c1c-4020-4d7a-be0e-cdd98bba41e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:35.780725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9365c1c-4020-4d7a-be0e-cdd98bba41e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:35.781442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9365c1c-4020-4d7a-be0e-cdd98bba41e3 None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=11379479956c4cf3ab7c2bf5edf07143, user.id=ddfad452bec4411ab910fcfe4f2221d8) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:52:35.781747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9365c1c-4020-4d7a-be0e-cdd98bba41e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:35.783150 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9365c1c-4020-4d7a-be0e-cdd98bba41e3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:35.788829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 596/1185] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:52:35 2022] GET /identity/v3/role_assignments?user.id=ddfad452bec4411ab910fcfe4f2221d8&scope.project.id=11379479956c4cf3ab7c2bf5edf07143&role.id=68b1888f7bb644a39938b8d41006a813 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:37.640636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504163d8-e6f9-4a06-8f94-5b8618bc2caa None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:37.641162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504163d8-e6f9-4a06-8f94-5b8618bc2caa None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:37.641162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504163d8-e6f9-4a06-8f94-5b8618bc2caa None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:37.642408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 590/1186] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:52:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:37.648249 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231f184-473e-42ed-96c7-989fd1ff0cc9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:37.648691 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231f184-473e-42ed-96c7-989fd1ff0cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:37.648785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231f184-473e-42ed-96c7-989fd1ff0cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:37.667039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b231f184-473e-42ed-96c7-989fd1ff0cc9 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:37.668238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b231f184-473e-42ed-96c7-989fd1ff0cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:37.731719 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 597/1187] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:52:37.997847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504163d8-e6f9-4a06-8f94-5b8618bc2caa None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:38.097348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504163d8-e6f9-4a06-8f94-5b8618bc2caa None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:38.130357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635d716-afa2-4af9-bf70-f9564b5478d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:38.130974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635d716-afa2-4af9-bf70-f9564b5478d0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:38.131254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635d716-afa2-4af9-bf70-f9564b5478d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:38.132160 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635d716-afa2-4af9-bf70-f9564b5478d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:38.141875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635d716-afa2-4af9-bf70-f9564b5478d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-2635d716-afa2-4af9-bf70-f9564b5478d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:52:38.146532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:52:38.147727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:52:38.148828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:52:38.148828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:52:38.148828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:52:38.148828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:52:38.148828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:52:38.148828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:52:38.148828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:52:38.148828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:52:38.148828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:52:38.148828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:52:38.148828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:52:38.148828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:52:38.148828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 591/1188] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:52:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:52:38.153892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231f184-473e-42ed-96c7-989fd1ff0cc9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:38.247264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231f184-473e-42ed-96c7-989fd1ff0cc9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:38.257944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:38.279532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86109763-127d-40d8-a9f4-23cb15ac3e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:38.281165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86109763-127d-40d8-a9f4-23cb15ac3e71 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:38.281165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86109763-127d-40d8-a9f4-23cb15ac3e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:38.281165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86109763-127d-40d8-a9f4-23cb15ac3e71 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:38.281437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86109763-127d-40d8-a9f4-23cb15ac3e71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:52:38.281588 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86109763-127d-40d8-a9f4-23cb15ac3e71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:38.282934 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86109763-127d-40d8-a9f4-23cb15ac3e71 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:38.290549 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 598/1189] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:52:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:38.296350 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635d716-afa2-4af9-bf70-f9564b5478d0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:38.351934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:38.397288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635d716-afa2-4af9-bf70-f9564b5478d0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:38.429566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e3d6-90cb-4e9a-955b-989f61aa1aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:38.430178 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e3d6-90cb-4e9a-955b-989f61aa1aa8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:38.430455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e3d6-90cb-4e9a-955b-989f61aa1aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:38.430724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e3d6-90cb-4e9a-955b-989f61aa1aa8 None admin] PATH_INFO: `/v3/users/ddfad452bec4411ab910fcfe4f2221d8` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:38.431833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605e3d6-90cb-4e9a-955b-989f61aa1aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=ddfad452bec4411ab910fcfe4f2221d8)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:38.433275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605e3d6-90cb-4e9a-955b-989f61aa1aa8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:38.434828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 592/1190] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:52:38 2022] GET /identity/v3/users/ddfad452bec4411ab910fcfe4f2221d8 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:38.440595 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86109763-127d-40d8-a9f4-23cb15ac3e71 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:38.536993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86109763-127d-40d8-a9f4-23cb15ac3e71 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:38.569228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751655b-09fb-4b51-a890-5958232fc37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:38.569841 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751655b-09fb-4b51-a890-5958232fc37b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:38.570113 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751655b-09fb-4b51-a890-5958232fc37b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:38.570380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751655b-09fb-4b51-a890-5958232fc37b None admin] PATH_INFO: `/v3/projects/11379479956c4cf3ab7c2bf5edf07143` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:38.571466 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751655b-09fb-4b51-a890-5958232fc37b None admin] RBAC: Authorizing `identity:get_project(project_id=11379479956c4cf3ab7c2bf5edf07143)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:38.572894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f751655b-09fb-4b51-a890-5958232fc37b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:38.574473 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 599/1191] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:52:38 2022] GET /identity/v3/projects/11379479956c4cf3ab7c2bf5edf07143 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:38.580362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e3d6-90cb-4e9a-955b-989f61aa1aa8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:38.676525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e3d6-90cb-4e9a-955b-989f61aa1aa8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:38.699007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:38.709855 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f3130-73af-409b-a13b-adafa1cae950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:38.710509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f3130-73af-409b-a13b-adafa1cae950 None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:38.710786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f3130-73af-409b-a13b-adafa1cae950 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:38.711058 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f3130-73af-409b-a13b-adafa1cae950 None admin] PATH_INFO: `/v3/projects/11379479956c4cf3ab7c2bf5edf07143/users/ddfad452bec4411ab910fcfe4f2221d8/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:38.712999 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f3130-73af-409b-a13b-adafa1cae950 None admin] RBAC: Authorizing `identity:create_grant(project_id=11379479956c4cf3ab7c2bf5edf07143, user_id=ddfad452bec4411ab910fcfe4f2221d8, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:38.714402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f3130-73af-409b-a13b-adafa1cae950 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:38.777153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 593/1192] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:52:38 2022] PUT /identity/v3/projects/11379479956c4cf3ab7c2bf5edf07143/users/ddfad452bec4411ab910fcfe4f2221d8/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:52:40.654046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab9418-37f1-4e9c-90f3-f9d6339e5f40 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:40.654565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab9418-37f1-4e9c-90f3-f9d6339e5f40 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:40.654565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aab9418-37f1-4e9c-90f3-f9d6339e5f40 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:40.655866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 600/1193] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:52:40.661189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cbfbe-28e2-4bbc-b1d0-3e93d8540c51 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:40.661610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cbfbe-28e2-4bbc-b1d0-3e93d8540c51 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:40.661738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597cbfbe-28e2-4bbc-b1d0-3e93d8540c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:40.680365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-597cbfbe-28e2-4bbc-b1d0-3e93d8540c51 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:52:40.681536 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-597cbfbe-28e2-4bbc-b1d0-3e93d8540c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:52:40.745409 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 594/1194] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:52:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:52:41.012828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab9418-37f1-4e9c-90f3-f9d6339e5f40 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:41.054452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:41.110660 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aab9418-37f1-4e9c-90f3-f9d6339e5f40 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:41.141973 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80eb5c-e793-4afa-8887-57c2644e1a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:41.142587 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80eb5c-e793-4afa-8887-57c2644e1a83 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:41.142866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80eb5c-e793-4afa-8887-57c2644e1a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:41.143139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80eb5c-e793-4afa-8887-57c2644e1a83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:41.153977 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80eb5c-e793-4afa-8887-57c2644e1a83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-8f80eb5c-e793-4afa-8887-57c2644e1a83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:52:41.158609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:52:41.159733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:52:41.161024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:52:41.161024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:52:41.161024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:52:41.161024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:52:41.161024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:52:41.161024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:52:41.161024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:52:41.161024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:52:41.161024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:52:41.161024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:52:41.161024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:52:41.161024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:52:41.161024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 601/1195] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:52:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:52:41.166292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cbfbe-28e2-4bbc-b1d0-3e93d8540c51 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:41.262405 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597cbfbe-28e2-4bbc-b1d0-3e93d8540c51 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:41.276972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:41.297017 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9d075-b11c-4226-a199-e43cd8d89839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:41.297620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9d075-b11c-4226-a199-e43cd8d89839 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:41.297900 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9d075-b11c-4226-a199-e43cd8d89839 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:41.298172 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb9d075-b11c-4226-a199-e43cd8d89839 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:41.298830 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9d075-b11c-4226-a199-e43cd8d89839 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:52:41.299132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9d075-b11c-4226-a199-e43cd8d89839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:41.300511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb9d075-b11c-4226-a199-e43cd8d89839 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:41.309392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 595/1196] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:52:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:41.314478 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80eb5c-e793-4afa-8887-57c2644e1a83 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:41.410226 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:41.413803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80eb5c-e793-4afa-8887-57c2644e1a83 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:41.446835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab070988-9cdd-4bac-b6c7-3ac73c4420cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:41.447451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab070988-9cdd-4bac-b6c7-3ac73c4420cc None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:41.447732 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab070988-9cdd-4bac-b6c7-3ac73c4420cc None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:41.448033 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab070988-9cdd-4bac-b6c7-3ac73c4420cc None admin] PATH_INFO: `/v3/users/ddfad452bec4411ab910fcfe4f2221d8` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:41.449154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab070988-9cdd-4bac-b6c7-3ac73c4420cc None admin] RBAC: Authorizing `identity:get_user(user_id=ddfad452bec4411ab910fcfe4f2221d8)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:41.450574 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab070988-9cdd-4bac-b6c7-3ac73c4420cc None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:41.452193 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 602/1197] 10.222.0.62 () {56 vars in 1177 bytes} [Wed Aug 24 07:52:41 2022] GET /identity/v3/users/ddfad452bec4411ab910fcfe4f2221d8 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:41.458120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9d075-b11c-4226-a199-e43cd8d89839 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:41.555247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb9d075-b11c-4226-a199-e43cd8d89839 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:41.588874 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50902ff-4593-4b40-b2df-1c4df8f53e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:41.589468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50902ff-4593-4b40-b2df-1c4df8f53e71 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:41.589745 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50902ff-4593-4b40-b2df-1c4df8f53e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:41.590014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50902ff-4593-4b40-b2df-1c4df8f53e71 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:41.632964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:41.655287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50902ff-4593-4b40-b2df-1c4df8f53e71 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:41.657407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50902ff-4593-4b40-b2df-1c4df8f53e71 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:41.750827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 596/1198] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:52:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:52:41.757362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab070988-9cdd-4bac-b6c7-3ac73c4420cc None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:41.852864 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab070988-9cdd-4bac-b6c7-3ac73c4420cc None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:41.885238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3c684e-1575-45f6-b2a2-ef2f741c1390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:41.885851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c684e-1575-45f6-b2a2-ef2f741c1390 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:41.886137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c684e-1575-45f6-b2a2-ef2f741c1390 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:41.886395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3c684e-1575-45f6-b2a2-ef2f741c1390 None admin] PATH_INFO: `/v3/projects/11379479956c4cf3ab7c2bf5edf07143` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:41.887496 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c684e-1575-45f6-b2a2-ef2f741c1390 None admin] RBAC: Authorizing `identity:get_project(project_id=11379479956c4cf3ab7c2bf5edf07143)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:41.888926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3c684e-1575-45f6-b2a2-ef2f741c1390 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:41.890513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 603/1199] 10.222.0.62 () {56 vars in 1186 bytes} [Wed Aug 24 07:52:41 2022] GET /identity/v3/projects/11379479956c4cf3ab7c2bf5edf07143 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:41.896517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50902ff-4593-4b40-b2df-1c4df8f53e71 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:52:41.969272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:41.990330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50902ff-4593-4b40-b2df-1c4df8f53e71 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:52:42.023579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be994bfc-3cf4-4b16-8431-6eedfe65f56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:52:42.024188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be994bfc-3cf4-4b16-8431-6eedfe65f56f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:52:42.024464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be994bfc-3cf4-4b16-8431-6eedfe65f56f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:52:42.024732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be994bfc-3cf4-4b16-8431-6eedfe65f56f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:52:42.025449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be994bfc-3cf4-4b16-8431-6eedfe65f56f None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=11379479956c4cf3ab7c2bf5edf07143, user.id=ddfad452bec4411ab910fcfe4f2221d8) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:52:42.025752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be994bfc-3cf4-4b16-8431-6eedfe65f56f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:52:42.027163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be994bfc-3cf4-4b16-8431-6eedfe65f56f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:52:42.032642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 597/1200] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:52:41 2022] GET /identity/v3/role_assignments?user.id=ddfad452bec4411ab910fcfe4f2221d8&scope.project.id=11379479956c4cf3ab7c2bf5edf07143&role.id=68b1888f7bb644a39938b8d41006a813 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:52:51.881656 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=82 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:52:52.030175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=30 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:51.485077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0593bf-f221-4eb2-b80d-3a23b44326ef None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:51.485687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0593bf-f221-4eb2-b80d-3a23b44326ef None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:51.485687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0593bf-f221-4eb2-b80d-3a23b44326ef None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:51.486998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 604/1201] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:53:51.492191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b067c-9faa-459a-8c04-c7ed9b46f40a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:51.492593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b067c-9faa-459a-8c04-c7ed9b46f40a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:51.492736 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833b067c-9faa-459a-8c04-c7ed9b46f40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:51.511270 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-833b067c-9faa-459a-8c04-c7ed9b46f40a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:53:51.512492 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-833b067c-9faa-459a-8c04-c7ed9b46f40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:51.581435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 598/1202] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:53:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:53:51.847324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0593bf-f221-4eb2-b80d-3a23b44326ef None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:51.946581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0593bf-f221-4eb2-b80d-3a23b44326ef None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:51.980337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc33712-df0a-46c6-af4e-9f5a413022a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:51.980970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33712-df0a-46c6-af4e-9f5a413022a0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:51.981230 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33712-df0a-46c6-af4e-9f5a413022a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:51.981496 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc33712-df0a-46c6-af4e-9f5a413022a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:51.991438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc33712-df0a-46c6-af4e-9f5a413022a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:51.992876 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc33712-df0a-46c6-af4e-9f5a413022a0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-dcc33712-df0a-46c6-af4e-9f5a413022a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:53:52.010710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:53:52.012037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:53:52.013213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:53:52.013213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:53:52.013213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:53:52.013213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 605/1203] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:53:52.017943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b067c-9faa-459a-8c04-c7ed9b46f40a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:52.114317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833b067c-9faa-459a-8c04-c7ed9b46f40a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:52.142041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:52.147631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9320adf9-4163-4634-b8f4-65ae73e2ade2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:52.148264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320adf9-4163-4634-b8f4-65ae73e2ade2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:52.148540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320adf9-4163-4634-b8f4-65ae73e2ade2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:52.148805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9320adf9-4163-4634-b8f4-65ae73e2ade2 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:52.149434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320adf9-4163-4634-b8f4-65ae73e2ade2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:53:52.149733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320adf9-4163-4634-b8f4-65ae73e2ade2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:52.151685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9320adf9-4163-4634-b8f4-65ae73e2ade2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:52.162354 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 599/1204] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:53:52.169074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc33712-df0a-46c6-af4e-9f5a413022a0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:52.224031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:52.270207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc33712-df0a-46c6-af4e-9f5a413022a0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:52.303136 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4da8ee-0b9b-45b6-9c52-bb3ad8360bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:52.303736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4da8ee-0b9b-45b6-9c52-bb3ad8360bce None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:52.304044 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4da8ee-0b9b-45b6-9c52-bb3ad8360bce None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:52.304320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4da8ee-0b9b-45b6-9c52-bb3ad8360bce None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:52.304957 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4da8ee-0b9b-45b6-9c52-bb3ad8360bce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:52.306395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4da8ee-0b9b-45b6-9c52-bb3ad8360bce None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:52.389481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 606/1205] 10.222.0.62 () {60 vars in 1132 bytes} [Wed Aug 24 07:53:52 2022] POST /identity/v3/users => generated 251 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:53:54.318185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86c3ce-d8d6-4e9d-8919-32b278f90819 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:54.318798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86c3ce-d8d6-4e9d-8919-32b278f90819 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:54.318798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86c3ce-d8d6-4e9d-8919-32b278f90819 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:54.320115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 600/1206] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:53:54.326566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f1561-6be0-4e82-97a5-8cb4029bb788 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:54.327019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f1561-6be0-4e82-97a5-8cb4029bb788 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:54.327222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9f1561-6be0-4e82-97a5-8cb4029bb788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:54.345210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2e9f1561-6be0-4e82-97a5-8cb4029bb788 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:53:54.348220 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2e9f1561-6be0-4e82-97a5-8cb4029bb788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:54.412545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 607/1207] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:53:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:53:54.685862 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86c3ce-d8d6-4e9d-8919-32b278f90819 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:54.786246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86c3ce-d8d6-4e9d-8919-32b278f90819 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:54.819730 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d16e0b-dce0-4b56-8d5c-50d01f4ff351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:54.820373 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d16e0b-dce0-4b56-8d5c-50d01f4ff351 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:54.820650 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d16e0b-dce0-4b56-8d5c-50d01f4ff351 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:54.820919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d16e0b-dce0-4b56-8d5c-50d01f4ff351 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:54.831647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d16e0b-dce0-4b56-8d5c-50d01f4ff351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-84d16e0b-dce0-4b56-8d5c-50d01f4ff351 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:53:54.836430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:53:54.839084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:53:54.840209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:53:54.840209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:53:54.840209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:53:54.840209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:53:54.840209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:53:54.840209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:53:54.840209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:53:54.840209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:53:54.840209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:53:54.840209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:53:54.840209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:53:54.840209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:53:54.840209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 601/1208] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:53:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:53:54.843678 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f1561-6be0-4e82-97a5-8cb4029bb788 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:54.882364 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:54.942577 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9f1561-6be0-4e82-97a5-8cb4029bb788 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:54.975434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816fdda-b9f5-482b-a166-e02c9c465628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:54.976069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816fdda-b9f5-482b-a166-e02c9c465628 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:54.976354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816fdda-b9f5-482b-a166-e02c9c465628 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:54.976629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816fdda-b9f5-482b-a166-e02c9c465628 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:54.977296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816fdda-b9f5-482b-a166-e02c9c465628 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:53:54.977596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816fdda-b9f5-482b-a166-e02c9c465628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:54.978998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816fdda-b9f5-482b-a166-e02c9c465628 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:54.986666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 608/1209] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:53:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:53:54.992594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d16e0b-dce0-4b56-8d5c-50d01f4ff351 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:55.043642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:55.092233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d16e0b-dce0-4b56-8d5c-50d01f4ff351 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:55.124840 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba7c16-7ad2-4277-afc5-1e96477abf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:55.125458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba7c16-7ad2-4277-afc5-1e96477abf40 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:55.125735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba7c16-7ad2-4277-afc5-1e96477abf40 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:55.126002 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba7c16-7ad2-4277-afc5-1e96477abf40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:55.137774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba7c16-7ad2-4277-afc5-1e96477abf40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:55.141753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba7c16-7ad2-4277-afc5-1e96477abf40 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-0eba7c16-7ad2-4277-afc5-1e96477abf40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:53:55.152974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:53:55.154825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:53:55.156659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:53:55.156659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:53:55.156659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:53:55.156659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 602/1210] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:53:55.160422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816fdda-b9f5-482b-a166-e02c9c465628 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:55.255631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:55.258359 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816fdda-b9f5-482b-a166-e02c9c465628 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:55.292294 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524d50-458c-4d43-9ae9-5ee4e3ad65d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:55.292899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524d50-458c-4d43-9ae9-5ee4e3ad65d9 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:55.293182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524d50-458c-4d43-9ae9-5ee4e3ad65d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:55.293456 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524d50-458c-4d43-9ae9-5ee4e3ad65d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:55.294095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25524d50-458c-4d43-9ae9-5ee4e3ad65d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:53:55.294404 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25524d50-458c-4d43-9ae9-5ee4e3ad65d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:55.295751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25524d50-458c-4d43-9ae9-5ee4e3ad65d9 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:55.307143 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 609/1211] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:53:55.312899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba7c16-7ad2-4277-afc5-1e96477abf40 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:55.418128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba7c16-7ad2-4277-afc5-1e96477abf40 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:55.419639 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:55.451673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7abfc5-e921-4136-84ae-6fb6a11c9a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:55.452316 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7abfc5-e921-4136-84ae-6fb6a11c9a3f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:55.452595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7abfc5-e921-4136-84ae-6fb6a11c9a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:55.452867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7abfc5-e921-4136-84ae-6fb6a11c9a3f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:55.459795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7abfc5-e921-4136-84ae-6fb6a11c9a3f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:55.461243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7abfc5-e921-4136-84ae-6fb6a11c9a3f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-fe7abfc5-e921-4136-84ae-6fb6a11c9a3f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:53:55.473095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:53:55.479429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:53:55.480455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:53:55.480455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:53:55.480455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:53:55.480455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:53:55.480455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:53:55.480455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:53:55.480455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:53:55.480455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:53:55.480455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:53:55.480455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:53:55.480455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 603/1212] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:53:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:53:55.481084 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524d50-458c-4d43-9ae9-5ee4e3ad65d9 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:55.578695 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25524d50-458c-4d43-9ae9-5ee4e3ad65d9 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:55.611418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039abb9a-9701-4406-9ae2-442250c5588e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:55.612082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039abb9a-9701-4406-9ae2-442250c5588e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:55.612361 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039abb9a-9701-4406-9ae2-442250c5588e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:55.612632 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039abb9a-9701-4406-9ae2-442250c5588e None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:55.613372 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039abb9a-9701-4406-9ae2-442250c5588e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:53:55.613674 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039abb9a-9701-4406-9ae2-442250c5588e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:55.615094 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039abb9a-9701-4406-9ae2-442250c5588e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:55.631926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 610/1213] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Aug 24 07:53:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:53:55.638734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7abfc5-e921-4136-84ae-6fb6a11c9a3f None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:55.739810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7abfc5-e921-4136-84ae-6fb6a11c9a3f None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:55.773717 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d749c9e-6e80-4dbb-8b22-d9e2586f502d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:55.774312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749c9e-6e80-4dbb-8b22-d9e2586f502d None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:55.774588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749c9e-6e80-4dbb-8b22-d9e2586f502d None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:55.774883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749c9e-6e80-4dbb-8b22-d9e2586f502d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:55.804029 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:55.843676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d749c9e-6e80-4dbb-8b22-d9e2586f502d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:55.845097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d749c9e-6e80-4dbb-8b22-d9e2586f502d None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:55.942776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 604/1214] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:53:55 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:53:55.948726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039abb9a-9701-4406-9ae2-442250c5588e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:55.967696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:56.047603 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039abb9a-9701-4406-9ae2-442250c5588e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:56.080864 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b8505-c339-4d13-9ea6-56c99efecf37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:56.081479 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8505-c339-4d13-9ea6-56c99efecf37 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:56.081754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8505-c339-4d13-9ea6-56c99efecf37 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:56.082021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b8505-c339-4d13-9ea6-56c99efecf37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:56.091487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b8505-c339-4d13-9ea6-56c99efecf37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:56.092941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b8505-c339-4d13-9ea6-56c99efecf37 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-dc0b8505-c339-4d13-9ea6-56c99efecf37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:53:56.107487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:53:56.108610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:53:56.109601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:53:56.109601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:53:56.109601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:53:56.109601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 611/1215] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:53:56.114393 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d749c9e-6e80-4dbb-8b22-d9e2586f502d None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:56.174380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:56.212035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d749c9e-6e80-4dbb-8b22-d9e2586f502d None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:56.246283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba473bbb-38ca-45a5-8019-0ad6419aec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:56.250472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba473bbb-38ca-45a5-8019-0ad6419aec84 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:56.250472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba473bbb-38ca-45a5-8019-0ad6419aec84 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:56.250472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba473bbb-38ca-45a5-8019-0ad6419aec84 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:56.250472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba473bbb-38ca-45a5-8019-0ad6419aec84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:53:56.250472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba473bbb-38ca-45a5-8019-0ad6419aec84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:56.250472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba473bbb-38ca-45a5-8019-0ad6419aec84 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:56.261494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 605/1216] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:53:56.267341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b8505-c339-4d13-9ea6-56c99efecf37 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:56.339315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:56.369501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b8505-c339-4d13-9ea6-56c99efecf37 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:56.404483 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239a667-bceb-4b80-b6fd-549a6a428e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:56.405108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239a667-bceb-4b80-b6fd-549a6a428e22 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:56.405384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239a667-bceb-4b80-b6fd-549a6a428e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:56.405653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7239a667-bceb-4b80-b6fd-549a6a428e22 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:56.412199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239a667-bceb-4b80-b6fd-549a6a428e22 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:56.413612 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7239a667-bceb-4b80-b6fd-549a6a428e22 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-7239a667-bceb-4b80-b6fd-549a6a428e22 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:53:56.425002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:53:56.426083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:53:56.427228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:53:56.427228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:53:56.427228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:53:56.427228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:53:56.427228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:53:56.427228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:53:56.427228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:53:56.427228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:53:56.427228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 612/1217] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:53:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:53:56.432120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba473bbb-38ca-45a5-8019-0ad6419aec84 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:56.533678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba473bbb-38ca-45a5-8019-0ad6419aec84 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:56.556154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:56.567259 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd59ca3-8892-421e-ac2d-fbebd0c9298f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:56.567883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd59ca3-8892-421e-ac2d-fbebd0c9298f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:56.568167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd59ca3-8892-421e-ac2d-fbebd0c9298f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:56.568437 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd59ca3-8892-421e-ac2d-fbebd0c9298f None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:56.569118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd59ca3-8892-421e-ac2d-fbebd0c9298f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:53:56.569420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd59ca3-8892-421e-ac2d-fbebd0c9298f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:56.570868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd59ca3-8892-421e-ac2d-fbebd0c9298f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:56.582139 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 606/1218] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:53:56.588889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239a667-bceb-4b80-b6fd-549a6a428e22 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:56.687149 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7239a667-bceb-4b80-b6fd-549a6a428e22 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:56.716284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:56.721872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d76b2-28c4-4d65-9945-650938aa8c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:56.722466 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d76b2-28c4-4d65-9945-650938aa8c4e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:56.722739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d76b2-28c4-4d65-9945-650938aa8c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:56.723008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d76b2-28c4-4d65-9945-650938aa8c4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:56.723732 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d76b2-28c4-4d65-9945-650938aa8c4e None admin] RBAC: Adding query filter params (role.id=bd638a70b0d5447ab1d78f20ef54200e, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=d213e29685f3402b804d4d8fbc88ba96) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:53:56.724072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d76b2-28c4-4d65-9945-650938aa8c4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:56.725484 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d76b2-28c4-4d65-9945-650938aa8c4e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:56.730824 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 613/1219] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:53:56 2022] GET /identity/v3/role_assignments?user.id=d213e29685f3402b804d4d8fbc88ba96&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=bd638a70b0d5447ab1d78f20ef54200e => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:53:58.605355 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103031f-5ae8-41ce-8ae2-9c48261452f8 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:58.605904 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103031f-5ae8-41ce-8ae2-9c48261452f8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:58.605904 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103031f-5ae8-41ce-8ae2-9c48261452f8 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:58.607245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 607/1220] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:53:58.616478 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5df5-9de3-4912-a1e1-3c53a3e7fba4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:58.616899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5df5-9de3-4912-a1e1-3c53a3e7fba4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:58.617033 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1c5df5-9de3-4912-a1e1-3c53a3e7fba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:58.634751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cc1c5df5-9de3-4912-a1e1-3c53a3e7fba4 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:53:58.635837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cc1c5df5-9de3-4912-a1e1-3c53a3e7fba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:53:58.700328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 614/1221] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:53:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:53:58.974732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103031f-5ae8-41ce-8ae2-9c48261452f8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:59.075960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103031f-5ae8-41ce-8ae2-9c48261452f8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:59.110029 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc284e10-db50-495a-828d-ed2b90fb3af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:59.110648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc284e10-db50-495a-828d-ed2b90fb3af9 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:59.110926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc284e10-db50-495a-828d-ed2b90fb3af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:59.111196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc284e10-db50-495a-828d-ed2b90fb3af9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:59.121353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc284e10-db50-495a-828d-ed2b90fb3af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-cc284e10-db50-495a-828d-ed2b90fb3af9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:53:59.126072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:53:59.127203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:53:59.128474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:53:59.128474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:53:59.128474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:53:59.128474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:53:59.128474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:53:59.128474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:53:59.128474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:53:59.128474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:53:59.128474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:53:59.128474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:53:59.128474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:53:59.128474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:53:59.128474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 608/1222] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:53:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:53:59.133273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c5df5-9de3-4912-a1e1-3c53a3e7fba4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:59.230634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1c5df5-9de3-4912-a1e1-3c53a3e7fba4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:59.253594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:59.264382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d70c0f-87e0-4c0b-a4c3-d72e6528d426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:59.264990 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d70c0f-87e0-4c0b-a4c3-d72e6528d426 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:59.265271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d70c0f-87e0-4c0b-a4c3-d72e6528d426 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:59.265543 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d70c0f-87e0-4c0b-a4c3-d72e6528d426 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:59.266202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d70c0f-87e0-4c0b-a4c3-d72e6528d426 None admin] RBAC: Adding query filter params (name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:53:59.266504 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d70c0f-87e0-4c0b-a4c3-d72e6528d426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:59.267939 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d70c0f-87e0-4c0b-a4c3-d72e6528d426 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:59.276270 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 615/1223] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:53:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:53:59.282039 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc284e10-db50-495a-828d-ed2b90fb3af9 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:59.326367 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:59.381154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc284e10-db50-495a-828d-ed2b90fb3af9 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:59.416356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15ce98-b2e0-497b-918a-3bedd692f117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:59.416981 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15ce98-b2e0-497b-918a-3bedd692f117 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:59.417261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15ce98-b2e0-497b-918a-3bedd692f117 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:59.417529 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15ce98-b2e0-497b-918a-3bedd692f117 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:59.427175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15ce98-b2e0-497b-918a-3bedd692f117 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:59.428628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15ce98-b2e0-497b-918a-3bedd692f117 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-ae15ce98-b2e0-497b-918a-3bedd692f117 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:53:59.443549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:53:59.444804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:53:59.445719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:53:59.445719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:53:59.445719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:53:59.445719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 609/1224] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:53:59.451069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d70c0f-87e0-4c0b-a4c3-d72e6528d426 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:59.550392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d70c0f-87e0-4c0b-a4c3-d72e6528d426 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:59.584001 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336895c-2c5b-4e40-8d09-3bc1dbc2c36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:59.584594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336895c-2c5b-4e40-8d09-3bc1dbc2c36e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:59.584872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336895c-2c5b-4e40-8d09-3bc1dbc2c36e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:59.585140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336895c-2c5b-4e40-8d09-3bc1dbc2c36e None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:59.585763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336895c-2c5b-4e40-8d09-3bc1dbc2c36e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:53:59.586062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336895c-2c5b-4e40-8d09-3bc1dbc2c36e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:59.587436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336895c-2c5b-4e40-8d09-3bc1dbc2c36e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:59.598711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 616/1225] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:53:59.604595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15ce98-b2e0-497b-918a-3bedd692f117 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:59.698817 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:59.705528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15ce98-b2e0-497b-918a-3bedd692f117 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:59.738856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28d84e-7e62-422b-96ae-86ac3529ad36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:59.739480 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d84e-7e62-422b-96ae-86ac3529ad36 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:59.739761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d84e-7e62-422b-96ae-86ac3529ad36 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:59.740064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa28d84e-7e62-422b-96ae-86ac3529ad36 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:59.747824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28d84e-7e62-422b-96ae-86ac3529ad36 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:59.749274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa28d84e-7e62-422b-96ae-86ac3529ad36 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-aa28d84e-7e62-422b-96ae-86ac3529ad36 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:53:59.760596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:53:59.761703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:53:59.762905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:53:59.762905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:53:59.762905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:53:59.762905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:53:59.762905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:53:59.762905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:53:59.762905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:53:59.762905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:53:59.762905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:53:59.762905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:53:59.762905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 610/1226] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:53:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:53:59.767566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336895c-2c5b-4e40-8d09-3bc1dbc2c36e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:53:59.815659 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:53:59.866355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336895c-2c5b-4e40-8d09-3bc1dbc2c36e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:53:59.899180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf29f5-0ef6-412f-8e15-662fe1aab77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:53:59.899811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf29f5-0ef6-412f-8e15-662fe1aab77c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:53:59.900128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf29f5-0ef6-412f-8e15-662fe1aab77c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:53:59.900427 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf29f5-0ef6-412f-8e15-662fe1aab77c None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:53:59.901162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf29f5-0ef6-412f-8e15-662fe1aab77c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:53:59.901444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf29f5-0ef6-412f-8e15-662fe1aab77c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:53:59.902916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf29f5-0ef6-412f-8e15-662fe1aab77c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:53:59.920385 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 617/1227] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Aug 24 07:53:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:53:59.926078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28d84e-7e62-422b-96ae-86ac3529ad36 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:00.028305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa28d84e-7e62-422b-96ae-86ac3529ad36 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:00.062732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1c869-bbe8-4b92-b202-e9e47595854a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:00.063347 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1c869-bbe8-4b92-b202-e9e47595854a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:00.063624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1c869-bbe8-4b92-b202-e9e47595854a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:00.063913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e1c869-bbe8-4b92-b202-e9e47595854a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:00.074013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1c869-bbe8-4b92-b202-e9e47595854a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:00.075385 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e1c869-bbe8-4b92-b202-e9e47595854a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-b5e1c869-bbe8-4b92-b202-e9e47595854a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:54:00.089665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:00.090881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:54:00.092053 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:54:00.092053 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:00.092053 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:00.092053 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 611/1228] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:00.096757 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf29f5-0ef6-412f-8e15-662fe1aab77c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:00.195236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf29f5-0ef6-412f-8e15-662fe1aab77c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:00.197698 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:00.228745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f88a6-3310-4bb8-8894-616046349c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:00.229342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f88a6-3310-4bb8-8894-616046349c2f None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:00.229617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f88a6-3310-4bb8-8894-616046349c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:00.229881 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5f88a6-3310-4bb8-8894-616046349c2f None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:00.230697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f88a6-3310-4bb8-8894-616046349c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:00.230996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f88a6-3310-4bb8-8894-616046349c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:00.232448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5f88a6-3310-4bb8-8894-616046349c2f None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:00.243464 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 618/1229] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:00.249223 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1c869-bbe8-4b92-b202-e9e47595854a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:00.258781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:00.349469 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e1c869-bbe8-4b92-b202-e9e47595854a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:00.383201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a819b46-3813-4cdb-aab0-f76928704cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:00.383822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a819b46-3813-4cdb-aab0-f76928704cfc None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:00.384698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a819b46-3813-4cdb-aab0-f76928704cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:00.384958 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a819b46-3813-4cdb-aab0-f76928704cfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:00.391515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a819b46-3813-4cdb-aab0-f76928704cfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:00.393007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a819b46-3813-4cdb-aab0-f76928704cfc None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-0a819b46-3813-4cdb-aab0-f76928704cfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:54:00.403955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:00.404932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:00.405880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:54:00.405880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:54:00.405880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:54:00.405880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:54:00.405880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:54:00.405880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:54:00.405880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:54:00.405880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:00.405880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 612/1230] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:00.410901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f88a6-3310-4bb8-8894-616046349c2f None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:00.511464 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5f88a6-3310-4bb8-8894-616046349c2f None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:00.545163 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d1d5a-4bbc-4230-a2c0-c96002ab3703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:00.545760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d1d5a-4bbc-4230-a2c0-c96002ab3703 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:00.546038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d1d5a-4bbc-4230-a2c0-c96002ab3703 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:00.546308 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d1d5a-4bbc-4230-a2c0-c96002ab3703 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:00.546983 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d1d5a-4bbc-4230-a2c0-c96002ab3703 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:00.547373 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d1d5a-4bbc-4230-a2c0-c96002ab3703 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:00.548902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d1d5a-4bbc-4230-a2c0-c96002ab3703 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:00.561395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 619/1231] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:00.567488 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a819b46-3813-4cdb-aab0-f76928704cfc None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:00.632102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:00.665792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a819b46-3813-4cdb-aab0-f76928704cfc None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:00.700023 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3866f4c-7009-45a9-8f58-49621f2a5dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:00.700662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3866f4c-7009-45a9-8f58-49621f2a5dbd None admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:00.700940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3866f4c-7009-45a9-8f58-49621f2a5dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:00.701207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3866f4c-7009-45a9-8f58-49621f2a5dbd None admin] PATH_INFO: `/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/d213e29685f3402b804d4d8fbc88ba96/roles/bd638a70b0d5447ab1d78f20ef54200e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:00.715462 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3866f4c-7009-45a9-8f58-49621f2a5dbd None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1074e261454981a85d02b4b0f75ec5, user_id=d213e29685f3402b804d4d8fbc88ba96, role_id=bd638a70b0d5447ab1d78f20ef54200e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:00.716918 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3866f4c-7009-45a9-8f58-49621f2a5dbd None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:00.794574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 613/1232] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:54:00 2022] PUT /identity/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/d213e29685f3402b804d4d8fbc88ba96/roles/bd638a70b0d5447ab1d78f20ef54200e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:02.641652 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a94dc-97b3-41b8-8e92-2b941dd32c56 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:02.642189 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a94dc-97b3-41b8-8e92-2b941dd32c56 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:02.642189 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18a94dc-97b3-41b8-8e92-2b941dd32c56 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:02.643458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 620/1233] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:02.648678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349f697-82f4-43f0-b30b-e9a154f5c44a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:02.649121 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349f697-82f4-43f0-b30b-e9a154f5c44a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:02.649213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349f697-82f4-43f0-b30b-e9a154f5c44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:02.668340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b349f697-82f4-43f0-b30b-e9a154f5c44a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:02.669532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b349f697-82f4-43f0-b30b-e9a154f5c44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:02.735962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 614/1234] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:54:03.003253 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a94dc-97b3-41b8-8e92-2b941dd32c56 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:03.029291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:03.103939 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18a94dc-97b3-41b8-8e92-2b941dd32c56 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:03.139471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356a707-99c5-412e-83d8-0602a89dc972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:03.140137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356a707-99c5-412e-83d8-0602a89dc972 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:03.140415 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356a707-99c5-412e-83d8-0602a89dc972 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:03.140691 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3356a707-99c5-412e-83d8-0602a89dc972 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:03.150949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3356a707-99c5-412e-83d8-0602a89dc972 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-3356a707-99c5-412e-83d8-0602a89dc972 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:54:03.155638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:03.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:03.157783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:03.157783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:03.157783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:03.157783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:03.157783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:54:03.157783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:54:03.157783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:54:03.157783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:54:03.157783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:54:03.157783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:54:03.157783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 07:54:03.157783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:54:03.157783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 621/1235] 10.222.0.62 () {56 vars in 1102 bytes} [Wed Aug 24 07:54:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:03.162775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349f697-82f4-43f0-b30b-e9a154f5c44a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:03.209473 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:03.263568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b349f697-82f4-43f0-b30b-e9a154f5c44a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:03.296515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99982554-8418-4afe-999a-dedfd1831292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:03.297107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99982554-8418-4afe-999a-dedfd1831292 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:03.297376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99982554-8418-4afe-999a-dedfd1831292 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:03.297640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99982554-8418-4afe-999a-dedfd1831292 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:03.298294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99982554-8418-4afe-999a-dedfd1831292 None admin] RBAC: Adding query filter params (name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:03.298590 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99982554-8418-4afe-999a-dedfd1831292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:03.299967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99982554-8418-4afe-999a-dedfd1831292 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:03.309139 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 615/1236] 10.222.0.62 () {56 vars in 1103 bytes} [Wed Aug 24 07:54:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:03.314918 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356a707-99c5-412e-83d8-0602a89dc972 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:03.399274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:03.414627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3356a707-99c5-412e-83d8-0602a89dc972 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:03.447992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3ce90-ec80-4bce-ac4c-32bc253e2bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:03.448619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3ce90-ec80-4bce-ac4c-32bc253e2bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:03.448898 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3ce90-ec80-4bce-ac4c-32bc253e2bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:03.449171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3ce90-ec80-4bce-ac4c-32bc253e2bb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:03.459300 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3ce90-ec80-4bce-ac4c-32bc253e2bb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:03.460771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3ce90-ec80-4bce-ac4c-32bc253e2bb1 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-12e3ce90-ec80-4bce-ac4c-32bc253e2bb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:54:03.475707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:03.476899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:54:03.478679 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:54:03.478679 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:03.478679 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:54:03.478679 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 622/1237] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:54:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:54:03.483535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99982554-8418-4afe-999a-dedfd1831292 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:03.581568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99982554-8418-4afe-999a-dedfd1831292 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:03.590146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:03.614264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1e56a-87e5-44cc-9312-7ab0693d68ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:03.614865 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1e56a-87e5-44cc-9312-7ab0693d68ac None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:03.615137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1e56a-87e5-44cc-9312-7ab0693d68ac None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:03.615424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1e56a-87e5-44cc-9312-7ab0693d68ac None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:03.616064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1e56a-87e5-44cc-9312-7ab0693d68ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:03.616362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1e56a-87e5-44cc-9312-7ab0693d68ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:03.617712 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1e56a-87e5-44cc-9312-7ab0693d68ac None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:03.630226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 616/1238] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:03.636204 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3ce90-ec80-4bce-ac4c-32bc253e2bb1 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:03.733526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3ce90-ec80-4bce-ac4c-32bc253e2bb1 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:03.766577 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d046c22-8aaf-41c3-8fad-0263c3df84be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:03.767192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d046c22-8aaf-41c3-8fad-0263c3df84be None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:03.767470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d046c22-8aaf-41c3-8fad-0263c3df84be None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:03.767739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d046c22-8aaf-41c3-8fad-0263c3df84be None admin] PATH_INFO: `/v3/users/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:03.770428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:03.775965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d046c22-8aaf-41c3-8fad-0263c3df84be None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:03.777388 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d046c22-8aaf-41c3-8fad-0263c3df84be None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-2d046c22-8aaf-41c3-8fad-0263c3df84be None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:54:03.788224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:03.789341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:03.791263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:03.791263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:03.791263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:54:03.791263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:54:03.791263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:54:03.791263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:54:03.791263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:54:03.791263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:54:03.791263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:54:03.791263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:54:03.791263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 623/1239] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:54:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:03.797971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1e56a-87e5-44cc-9312-7ab0693d68ac None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:03.895496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1e56a-87e5-44cc-9312-7ab0693d68ac None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:03.929154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6cfdf-5d75-4fd9-84c6-aee2bb84764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:03.929804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6cfdf-5d75-4fd9-84c6-aee2bb84764c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:03.930110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6cfdf-5d75-4fd9-84c6-aee2bb84764c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:03.930375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6cfdf-5d75-4fd9-84c6-aee2bb84764c None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:03.931202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6cfdf-5d75-4fd9-84c6-aee2bb84764c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:03.931521 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6cfdf-5d75-4fd9-84c6-aee2bb84764c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:03.932956 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6cfdf-5d75-4fd9-84c6-aee2bb84764c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:03.949539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 617/1240] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Aug 24 07:54:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:03.955521 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d046c22-8aaf-41c3-8fad-0263c3df84be None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:04.054682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d046c22-8aaf-41c3-8fad-0263c3df84be None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:04.087975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c579c-fef1-4770-ae22-3af24ab2a84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:04.088572 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c579c-fef1-4770-ae22-3af24ab2a84b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:04.088849 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c579c-fef1-4770-ae22-3af24ab2a84b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:04.089119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c579c-fef1-4770-ae22-3af24ab2a84b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:04.148486 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:04.155453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c579c-fef1-4770-ae22-3af24ab2a84b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:04.156888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c579c-fef1-4770-ae22-3af24ab2a84b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:04.255393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 624/1241] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:54:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:54:04.261798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6cfdf-5d75-4fd9-84c6-aee2bb84764c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:04.289471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:04.367230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6cfdf-5d75-4fd9-84c6-aee2bb84764c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:04.401605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84205d8e-82bc-45f4-81be-715b7ad98b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:04.402167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84205d8e-82bc-45f4-81be-715b7ad98b85 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:04.402445 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84205d8e-82bc-45f4-81be-715b7ad98b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:04.402714 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84205d8e-82bc-45f4-81be-715b7ad98b85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:04.412407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84205d8e-82bc-45f4-81be-715b7ad98b85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:04.413827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84205d8e-82bc-45f4-81be-715b7ad98b85 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-84205d8e-82bc-45f4-81be-715b7ad98b85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:54:04.428468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:04.429655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:54:04.430641 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:54:04.430641 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:04.430641 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:04.430641 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 618/1242] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:04.436039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c579c-fef1-4770-ae22-3af24ab2a84b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:04.527721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:04.533389 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c579c-fef1-4770-ae22-3af24ab2a84b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:04.566279 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0ad13-4972-4490-8dae-f3fb21d47e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:04.566885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0ad13-4972-4490-8dae-f3fb21d47e99 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:04.567168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0ad13-4972-4490-8dae-f3fb21d47e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:04.567445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0ad13-4972-4490-8dae-f3fb21d47e99 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:04.568123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0ad13-4972-4490-8dae-f3fb21d47e99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:04.568427 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0ad13-4972-4490-8dae-f3fb21d47e99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:04.569862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0ad13-4972-4490-8dae-f3fb21d47e99 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:04.581774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 625/1243] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:04.588052 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84205d8e-82bc-45f4-81be-715b7ad98b85 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:04.666315 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:04.687024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84205d8e-82bc-45f4-81be-715b7ad98b85 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:04.720133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f46830-46af-48cd-b973-898fa5dfb216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:04.720748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f46830-46af-48cd-b973-898fa5dfb216 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:04.721027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f46830-46af-48cd-b973-898fa5dfb216 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:04.721301 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f46830-46af-48cd-b973-898fa5dfb216 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:04.728468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f46830-46af-48cd-b973-898fa5dfb216 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:04.729920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f46830-46af-48cd-b973-898fa5dfb216 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-e2f46830-46af-48cd-b973-898fa5dfb216 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:54:04.741444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:04.742642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:04.743872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:54:04.743872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:54:04.743872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:54:04.743872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:54:04.743872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:54:04.743872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:54:04.743872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:54:04.743872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:04.743872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 619/1244] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:54:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:04.749032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0ad13-4972-4490-8dae-f3fb21d47e99 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:04.852234 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0ad13-4972-4490-8dae-f3fb21d47e99 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:04.884937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59bf0f-e3be-487a-abfa-ccced87c6563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:04.885543 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59bf0f-e3be-487a-abfa-ccced87c6563 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:04.885821 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59bf0f-e3be-487a-abfa-ccced87c6563 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:04.886093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59bf0f-e3be-487a-abfa-ccced87c6563 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:04.886777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59bf0f-e3be-487a-abfa-ccced87c6563 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:04.887080 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59bf0f-e3be-487a-abfa-ccced87c6563 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:04.888522 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59bf0f-e3be-487a-abfa-ccced87c6563 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:04.900902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 626/1245] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:54:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:04.907227 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f46830-46af-48cd-b973-898fa5dfb216 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:05.005957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f46830-46af-48cd-b973-898fa5dfb216 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:05.039657 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0417ef-7fba-4fb5-8233-37ed33f3374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:05.040318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0417ef-7fba-4fb5-8233-37ed33f3374e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:05.040608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0417ef-7fba-4fb5-8233-37ed33f3374e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:05.040882 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0417ef-7fba-4fb5-8233-37ed33f3374e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:05.041593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0417ef-7fba-4fb5-8233-37ed33f3374e None admin] RBAC: Adding query filter params (role.id=bd638a70b0d5447ab1d78f20ef54200e, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=d213e29685f3402b804d4d8fbc88ba96) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:05.041898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0417ef-7fba-4fb5-8233-37ed33f3374e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:05.043293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0417ef-7fba-4fb5-8233-37ed33f3374e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:05.049009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 620/1246] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:54:04 2022] GET /identity/v3/role_assignments?user.id=d213e29685f3402b804d4d8fbc88ba96&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=bd638a70b0d5447ab1d78f20ef54200e => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:07.008357 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b1f20-f937-4f07-afff-7392a24e5647 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:07.009566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b1f20-f937-4f07-afff-7392a24e5647 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:07.009737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b1f20-f937-4f07-afff-7392a24e5647 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:07.011087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 627/1247] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:07.016604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba503c2a-78d7-42f0-b057-2c45fbd27fa4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:07.017097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba503c2a-78d7-42f0-b057-2c45fbd27fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:07.017198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba503c2a-78d7-42f0-b057-2c45fbd27fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:07.023501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:07.036637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ba503c2a-78d7-42f0-b057-2c45fbd27fa4 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:07.037826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ba503c2a-78d7-42f0-b057-2c45fbd27fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:07.104708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 621/1248] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:54:07.375874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b1f20-f937-4f07-afff-7392a24e5647 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:07.394127 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:07.475212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b1f20-f937-4f07-afff-7392a24e5647 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:07.507367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7be707-04b1-4118-a92f-79b9239280f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:07.508016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7be707-04b1-4118-a92f-79b9239280f0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:07.508298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7be707-04b1-4118-a92f-79b9239280f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:07.509128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7be707-04b1-4118-a92f-79b9239280f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:07.519011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7be707-04b1-4118-a92f-79b9239280f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-cb7be707-04b1-4118-a92f-79b9239280f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:54:07.523696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:07.525516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:07.526463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:07.526463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:07.526463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:07.526463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:07.526463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:54:07.526463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:54:07.526463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:54:07.526463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:54:07.526463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:54:07.526463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:54:07.526463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:54:07.526463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:54:07.526463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 628/1249] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:54:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:07.531544 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba503c2a-78d7-42f0-b057-2c45fbd27fa4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:07.628274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba503c2a-78d7-42f0-b057-2c45fbd27fa4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:07.656953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:07.661832 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56902c90-1dd4-4d81-b22f-1d698ccee5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:07.662428 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56902c90-1dd4-4d81-b22f-1d698ccee5d2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:07.662703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56902c90-1dd4-4d81-b22f-1d698ccee5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:07.662968 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56902c90-1dd4-4d81-b22f-1d698ccee5d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:07.663614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56902c90-1dd4-4d81-b22f-1d698ccee5d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:07.663940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56902c90-1dd4-4d81-b22f-1d698ccee5d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:07.665396 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56902c90-1dd4-4d81-b22f-1d698ccee5d2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:07.673408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 622/1250] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:54:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:07.679232 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7be707-04b1-4118-a92f-79b9239280f0 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:07.753908 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:07.775875 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7be707-04b1-4118-a92f-79b9239280f0 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:07.807901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ef650-a486-479d-9425-774359b84d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:07.808521 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ef650-a486-479d-9425-774359b84d4b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:07.808798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ef650-a486-479d-9425-774359b84d4b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:07.809105 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4ef650-a486-479d-9425-774359b84d4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:07.819498 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ef650-a486-479d-9425-774359b84d4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:07.820954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4ef650-a486-479d-9425-774359b84d4b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-eb4ef650-a486-479d-9425-774359b84d4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:54:07.836095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:07.837251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:54:07.838217 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:54:07.838217 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:07.838217 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:54:07.838217 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 629/1251] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:54:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:07.843181 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56902c90-1dd4-4d81-b22f-1d698ccee5d2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:07.940143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56902c90-1dd4-4d81-b22f-1d698ccee5d2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:07.972371 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b705f5d-585f-4d4c-913f-da214f9cf62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:07.972967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b705f5d-585f-4d4c-913f-da214f9cf62c None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:07.973245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b705f5d-585f-4d4c-913f-da214f9cf62c None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:07.973513 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b705f5d-585f-4d4c-913f-da214f9cf62c None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:07.974140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b705f5d-585f-4d4c-913f-da214f9cf62c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:07.974439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b705f5d-585f-4d4c-913f-da214f9cf62c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:07.975778 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b705f5d-585f-4d4c-913f-da214f9cf62c None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:07.987880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 623/1252] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:54:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:07.994185 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ef650-a486-479d-9425-774359b84d4b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:08.093652 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4ef650-a486-479d-9425-774359b84d4b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:08.120840 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:08.128671 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9b1e4-470c-48f3-9cc7-db39b767794b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:08.129301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9b1e4-470c-48f3-9cc7-db39b767794b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:08.129580 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9b1e4-470c-48f3-9cc7-db39b767794b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:08.129851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9b1e4-470c-48f3-9cc7-db39b767794b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:08.137187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9b1e4-470c-48f3-9cc7-db39b767794b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:08.138675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9b1e4-470c-48f3-9cc7-db39b767794b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-38d9b1e4-470c-48f3-9cc7-db39b767794b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:54:08.149454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:08.150683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:08.151965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:08.151965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:08.151965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:54:08.151965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:54:08.151965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:54:08.151965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:54:08.151965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:54:08.151965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:54:08.151965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:54:08.151965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:54:08.151965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 630/1253] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:54:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:08.156411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b705f5d-585f-4d4c-913f-da214f9cf62c None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:08.211628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:08.254677 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b705f5d-585f-4d4c-913f-da214f9cf62c None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:08.287592 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d583a0-613f-4db7-84b0-00d74b5da294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:08.288246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d583a0-613f-4db7-84b0-00d74b5da294 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:08.288520 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d583a0-613f-4db7-84b0-00d74b5da294 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:08.288786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d583a0-613f-4db7-84b0-00d74b5da294 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:08.289502 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d583a0-613f-4db7-84b0-00d74b5da294 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:08.290361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d583a0-613f-4db7-84b0-00d74b5da294 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:08.292007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d583a0-613f-4db7-84b0-00d74b5da294 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:08.312014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 624/1254] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Aug 24 07:54:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:08.314365 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9b1e4-470c-48f3-9cc7-db39b767794b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:08.418328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9b1e4-470c-48f3-9cc7-db39b767794b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:08.450606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224a5a4-a46d-4375-b1e9-8d4dea6e805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:08.451206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224a5a4-a46d-4375-b1e9-8d4dea6e805c None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:08.451483 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224a5a4-a46d-4375-b1e9-8d4dea6e805c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:08.451751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224a5a4-a46d-4375-b1e9-8d4dea6e805c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:08.504699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:08.516180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224a5a4-a46d-4375-b1e9-8d4dea6e805c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:08.517592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224a5a4-a46d-4375-b1e9-8d4dea6e805c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:08.613175 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 631/1255] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:54:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:54:08.619191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d583a0-613f-4db7-84b0-00d74b5da294 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:08.714814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d583a0-613f-4db7-84b0-00d74b5da294 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:08.727441 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:08.748335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca9362-c0f6-41c0-aade-3e2e08155dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:08.748950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca9362-c0f6-41c0-aade-3e2e08155dd1 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:08.749225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca9362-c0f6-41c0-aade-3e2e08155dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:08.749491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca9362-c0f6-41c0-aade-3e2e08155dd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:08.759070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca9362-c0f6-41c0-aade-3e2e08155dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:08.760496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ca9362-c0f6-41c0-aade-3e2e08155dd1 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-b7ca9362-c0f6-41c0-aade-3e2e08155dd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:54:08.775785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:08.776949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:54:08.778136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:54:08.778136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:08.778136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:08.778136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 625/1256] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:54:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:08.782589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224a5a4-a46d-4375-b1e9-8d4dea6e805c None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:08.871721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:08.883449 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224a5a4-a46d-4375-b1e9-8d4dea6e805c None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:08.917394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d967a09-6597-4e9e-8503-6c9eec864864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:08.918019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d967a09-6597-4e9e-8503-6c9eec864864 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:08.918296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d967a09-6597-4e9e-8503-6c9eec864864 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:08.918580 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d967a09-6597-4e9e-8503-6c9eec864864 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:08.919206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d967a09-6597-4e9e-8503-6c9eec864864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:08.919508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d967a09-6597-4e9e-8503-6c9eec864864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:08.920885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d967a09-6597-4e9e-8503-6c9eec864864 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:08.932549 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 632/1257] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:08.938379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca9362-c0f6-41c0-aade-3e2e08155dd1 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:09.037531 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ca9362-c0f6-41c0-aade-3e2e08155dd1 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:09.070251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10b058-8da9-4903-ad6e-4ed59205d8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:09.070867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10b058-8da9-4903-ad6e-4ed59205d8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:09.071141 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10b058-8da9-4903-ad6e-4ed59205d8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:09.071409 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10b058-8da9-4903-ad6e-4ed59205d8b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:09.078288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10b058-8da9-4903-ad6e-4ed59205d8b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:09.080002 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10b058-8da9-4903-ad6e-4ed59205d8b2 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-4a10b058-8da9-4903-ad6e-4ed59205d8b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:54:09.091527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:09.101829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:09.102802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:54:09.102802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:54:09.102802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:54:09.102802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:54:09.102802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:54:09.102802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:54:09.102802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:54:09.102802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:09.102802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 626/1258] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:54:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:09.103344 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d967a09-6597-4e9e-8503-6c9eec864864 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:09.194534 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d967a09-6597-4e9e-8503-6c9eec864864 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:09.228042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88beef-ec62-4562-b31f-22834ea03ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:09.228767 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88beef-ec62-4562-b31f-22834ea03ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:09.229044 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88beef-ec62-4562-b31f-22834ea03ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:09.229318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88beef-ec62-4562-b31f-22834ea03ec0 None admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:09.230002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88beef-ec62-4562-b31f-22834ea03ec0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:09.230310 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88beef-ec62-4562-b31f-22834ea03ec0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:09.231725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d88beef-ec62-4562-b31f-22834ea03ec0 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:09.243933 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 633/1259] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:54:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:09.250083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10b058-8da9-4903-ad6e-4ed59205d8b2 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:09.276804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:09.349861 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10b058-8da9-4903-ad6e-4ed59205d8b2 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:09.386401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fc81b-f839-44bd-a4ea-491a29e9845e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:09.387005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fc81b-f839-44bd-a4ea-491a29e9845e None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:09.387280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fc81b-f839-44bd-a4ea-491a29e9845e None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:09.387546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fc81b-f839-44bd-a4ea-491a29e9845e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:09.388311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fc81b-f839-44bd-a4ea-491a29e9845e None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=d213e29685f3402b804d4d8fbc88ba96) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:09.388612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fc81b-f839-44bd-a4ea-491a29e9845e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:09.390012 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74fc81b-f839-44bd-a4ea-491a29e9845e None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:09.395277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 627/1260] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:54:09 2022] GET /identity/v3/role_assignments?user.id=d213e29685f3402b804d4d8fbc88ba96&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=68b1888f7bb644a39938b8d41006a813 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:54:11.269585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726d49c-49d3-48bd-b251-9746ae9a27a9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:11.270141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726d49c-49d3-48bd-b251-9746ae9a27a9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:11.270141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726d49c-49d3-48bd-b251-9746ae9a27a9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:11.271447 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 634/1261] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:54:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:11.276778 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032495-cf86-408a-ab6d-975dd2a0fccd None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:11.277215 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032495-cf86-408a-ab6d-975dd2a0fccd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:11.277317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72032495-cf86-408a-ab6d-975dd2a0fccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:11.295332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-72032495-cf86-408a-ab6d-975dd2a0fccd None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:11.296537 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-72032495-cf86-408a-ab6d-975dd2a0fccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:11.362062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 628/1262] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:54:11.630201 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726d49c-49d3-48bd-b251-9746ae9a27a9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:11.641362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:11.733901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726d49c-49d3-48bd-b251-9746ae9a27a9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:11.765904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58ca08-5750-4c69-95bf-e271578e02f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:11.766520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58ca08-5750-4c69-95bf-e271578e02f3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:11.766801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58ca08-5750-4c69-95bf-e271578e02f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:11.767070 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b58ca08-5750-4c69-95bf-e271578e02f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:11.777425 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b58ca08-5750-4c69-95bf-e271578e02f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-5b58ca08-5750-4c69-95bf-e271578e02f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:54:11.782089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:11.786981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:11.787997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:11.787997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:11.787997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:11.787997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:11.787997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:54:11.787997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:54:11.787997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:54:11.787997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:54:11.787997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:54:11.787997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:54:11.787997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:54:11.787997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:54:11.787997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 635/1263] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:54:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:11.789231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72032495-cf86-408a-ab6d-975dd2a0fccd None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:11.807646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:11.885662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72032495-cf86-408a-ab6d-975dd2a0fccd None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:11.918751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a7292-faf6-4beb-9e50-72ec5deebad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:11.919347 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7292-faf6-4beb-9e50-72ec5deebad0 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:11.919623 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7292-faf6-4beb-9e50-72ec5deebad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:11.919920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2a7292-faf6-4beb-9e50-72ec5deebad0 None admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:11.920578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a7292-faf6-4beb-9e50-72ec5deebad0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:11.920878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a7292-faf6-4beb-9e50-72ec5deebad0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:11.922221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2a7292-faf6-4beb-9e50-72ec5deebad0 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:11.929969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 629/1264] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:54:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:11.936130 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58ca08-5750-4c69-95bf-e271578e02f3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:12.004238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:12.036929 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b58ca08-5750-4c69-95bf-e271578e02f3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:12.069469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abd23f-0a7a-4f80-9393-8a0a5cb4f84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:12.070093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abd23f-0a7a-4f80-9393-8a0a5cb4f84e None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:12.070371 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abd23f-0a7a-4f80-9393-8a0a5cb4f84e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:12.070643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abd23f-0a7a-4f80-9393-8a0a5cb4f84e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:12.081610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abd23f-0a7a-4f80-9393-8a0a5cb4f84e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:12.083075 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abd23f-0a7a-4f80-9393-8a0a5cb4f84e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-63abd23f-0a7a-4f80-9393-8a0a5cb4f84e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:54:12.097489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:12.098815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:54:12.099725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:54:12.099725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:12.099725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:54:12.099725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 636/1265] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:12.104471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a7292-faf6-4beb-9e50-72ec5deebad0 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:12.187131 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:12.206776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2a7292-faf6-4beb-9e50-72ec5deebad0 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:12.246917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd61ed-00c4-4b5c-ade0-d275ed74f45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:12.247523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd61ed-00c4-4b5c-ade0-d275ed74f45a None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:12.247804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd61ed-00c4-4b5c-ade0-d275ed74f45a None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:12.248115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd61ed-00c4-4b5c-ade0-d275ed74f45a None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:12.248757 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd61ed-00c4-4b5c-ade0-d275ed74f45a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:12.249060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd61ed-00c4-4b5c-ade0-d275ed74f45a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:12.250412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd61ed-00c4-4b5c-ade0-d275ed74f45a None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:12.262252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 630/1266] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:12.268097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abd23f-0a7a-4f80-9393-8a0a5cb4f84e None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:12.368345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abd23f-0a7a-4f80-9393-8a0a5cb4f84e None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:12.388455 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:12.402057 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f1487-405b-44c4-b778-753657f6d393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:12.402680 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f1487-405b-44c4-b778-753657f6d393 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:12.402989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f1487-405b-44c4-b778-753657f6d393 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:12.403258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8f1487-405b-44c4-b778-753657f6d393 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:12.410540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f1487-405b-44c4-b778-753657f6d393 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:12.411994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8f1487-405b-44c4-b778-753657f6d393 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-4d8f1487-405b-44c4-b778-753657f6d393 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:54:12.422835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:12.424032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:12.425347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:12.425347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:12.425347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:54:12.425347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:54:12.425347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:54:12.425347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:54:12.425347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:54:12.425347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:54:12.425347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:54:12.425347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:54:12.425347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 637/1267] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:54:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:12.429846 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd61ed-00c4-4b5c-ade0-d275ed74f45a None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:12.530074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd61ed-00c4-4b5c-ade0-d275ed74f45a None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:12.563712 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf6621-6608-42fe-a7b3-bcd6b6d974e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:12.564345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf6621-6608-42fe-a7b3-bcd6b6d974e6 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:12.564626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf6621-6608-42fe-a7b3-bcd6b6d974e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:12.564898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf6621-6608-42fe-a7b3-bcd6b6d974e6 None admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:12.565617 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf6621-6608-42fe-a7b3-bcd6b6d974e6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:12.565924 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf6621-6608-42fe-a7b3-bcd6b6d974e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:12.567358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf6621-6608-42fe-a7b3-bcd6b6d974e6 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:12.577167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:12.585251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 631/1268] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Aug 24 07:54:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:12.591513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f1487-405b-44c4-b778-753657f6d393 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:12.691525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8f1487-405b-44c4-b778-753657f6d393 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:12.724810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c8a61-2ba9-4d70-8b5e-f9504d412f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:12.725424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c8a61-2ba9-4d70-8b5e-f9504d412f7b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:12.725700 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c8a61-2ba9-4d70-8b5e-f9504d412f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:12.725967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c8a61-2ba9-4d70-8b5e-f9504d412f7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:12.737898 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c8a61-2ba9-4d70-8b5e-f9504d412f7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:12.739341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c8a61-2ba9-4d70-8b5e-f9504d412f7b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-3a6c8a61-2ba9-4d70-8b5e-f9504d412f7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:54:12.753233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:12.756950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:54:12.758156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:54:12.758156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:12.758156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:54:12.758156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 638/1269] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:12.760339 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf6621-6608-42fe-a7b3-bcd6b6d974e6 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:12.860598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf6621-6608-42fe-a7b3-bcd6b6d974e6 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:12.893841 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf0143-219e-4b90-a8cf-2136032107fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:12.894446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0143-219e-4b90-a8cf-2136032107fb None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:12.894725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0143-219e-4b90-a8cf-2136032107fb None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:12.895003 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf0143-219e-4b90-a8cf-2136032107fb None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:12.895633 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf0143-219e-4b90-a8cf-2136032107fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:12.895972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf0143-219e-4b90-a8cf-2136032107fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:12.897318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf0143-219e-4b90-a8cf-2136032107fb None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:12.909356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 632/1270] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:12.915030 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c8a61-2ba9-4d70-8b5e-f9504d412f7b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:12.945888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:13.012388 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c8a61-2ba9-4d70-8b5e-f9504d412f7b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:13.045925 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632508c0-1846-49b7-837e-3d99df7f0611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:13.046549 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632508c0-1846-49b7-837e-3d99df7f0611 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:13.046825 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632508c0-1846-49b7-837e-3d99df7f0611 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:13.047092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632508c0-1846-49b7-837e-3d99df7f0611 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:13.053658 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632508c0-1846-49b7-837e-3d99df7f0611 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:13.055101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632508c0-1846-49b7-837e-3d99df7f0611 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-632508c0-1846-49b7-837e-3d99df7f0611 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:54:13.067018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:13.068135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:13.069165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:54:13.069165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:54:13.069165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:54:13.069165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:54:13.069165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:54:13.069165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:54:13.069165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:54:13.069165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:54:13.069165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 639/1271] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:54:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:13.074806 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf0143-219e-4b90-a8cf-2136032107fb None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:13.132393 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:13.173748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf0143-219e-4b90-a8cf-2136032107fb None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:13.208275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ed3c4-41f1-47e7-b538-9bffd5b7338f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:13.208878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ed3c4-41f1-47e7-b538-9bffd5b7338f None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:13.209159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ed3c4-41f1-47e7-b538-9bffd5b7338f None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:13.209431 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ed3c4-41f1-47e7-b538-9bffd5b7338f None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:13.210113 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ed3c4-41f1-47e7-b538-9bffd5b7338f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:13.210419 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ed3c4-41f1-47e7-b538-9bffd5b7338f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:13.211828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ed3c4-41f1-47e7-b538-9bffd5b7338f None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:13.223825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 633/1272] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:54:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:13.230086 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632508c0-1846-49b7-837e-3d99df7f0611 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:13.323541 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:13.332338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632508c0-1846-49b7-837e-3d99df7f0611 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:13.365697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8201e-9458-4417-92c8-017a241f072c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:13.366355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8201e-9458-4417-92c8-017a241f072c None admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:13.366637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8201e-9458-4417-92c8-017a241f072c None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:13.366914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8201e-9458-4417-92c8-017a241f072c None admin] PATH_INFO: `/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/d213e29685f3402b804d4d8fbc88ba96/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:13.369553 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8201e-9458-4417-92c8-017a241f072c None admin] RBAC: Authorizing `identity:create_grant(project_id=1c1074e261454981a85d02b4b0f75ec5, user_id=d213e29685f3402b804d4d8fbc88ba96, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:13.370984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8201e-9458-4417-92c8-017a241f072c None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:13.467273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 640/1273] 10.222.0.62 () {58 vars in 1439 bytes} [Wed Aug 24 07:54:13 2022] PUT /identity/v3/projects/1c1074e261454981a85d02b4b0f75ec5/users/d213e29685f3402b804d4d8fbc88ba96/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:54:15.350805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685df5a4-af43-4bc5-ab94-427267579f3c None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:15.351356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685df5a4-af43-4bc5-ab94-427267579f3c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:15.351356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685df5a4-af43-4bc5-ab94-427267579f3c None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:15.352717 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 634/1274] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:15.358683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031879f-419d-4340-836a-43b23f7b9621 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:15.359138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031879f-419d-4340-836a-43b23f7b9621 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:15.359242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031879f-419d-4340-836a-43b23f7b9621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:15.378412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c031879f-419d-4340-836a-43b23f7b9621 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:15.379306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c031879f-419d-4340-836a-43b23f7b9621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:15.445039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 641/1275] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:54:15.710392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685df5a4-af43-4bc5-ab94-427267579f3c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:15.810494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685df5a4-af43-4bc5-ab94-427267579f3c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:15.827900 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:15.847162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b05202-d288-4dfa-97e6-f7879eb86d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:15.847875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b05202-d288-4dfa-97e6-f7879eb86d96 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:15.848232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b05202-d288-4dfa-97e6-f7879eb86d96 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:15.848508 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b05202-d288-4dfa-97e6-f7879eb86d96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:15.858534 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b05202-d288-4dfa-97e6-f7879eb86d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-f4b05202-d288-4dfa-97e6-f7879eb86d96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 07:54:15.863226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:15.864390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:15.865465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:15.865465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:15.865465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:15.865465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:15.865465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 07:54:15.865465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 07:54:15.865465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 07:54:15.865465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 07:54:15.865465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 07:54:15.865465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 07:54:15.865465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 07:54:15.865465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:15.865465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 635/1276] 10.222.0.62 () {56 vars in 1096 bytes} [Wed Aug 24 07:54:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 07:54:15.870573 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031879f-419d-4340-836a-43b23f7b9621 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:15.950102 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:15.968661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031879f-419d-4340-836a-43b23f7b9621 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:16.000755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02b9fa-4da0-4538-a5c8-31f99589e150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:16.001347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02b9fa-4da0-4538-a5c8-31f99589e150 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:16.001620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02b9fa-4da0-4538-a5c8-31f99589e150 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:16.001886 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d02b9fa-4da0-4538-a5c8-31f99589e150 None admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:16.002591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02b9fa-4da0-4538-a5c8-31f99589e150 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:16.002890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02b9fa-4da0-4538-a5c8-31f99589e150 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:16.004282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d02b9fa-4da0-4538-a5c8-31f99589e150 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:16.013279 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 642/1277] 10.222.0.62 () {56 vars in 1099 bytes} [Wed Aug 24 07:54:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:16.019001 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b05202-d288-4dfa-97e6-f7879eb86d96 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:16.125304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b05202-d288-4dfa-97e6-f7879eb86d96 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:16.159737 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537f306-0bb5-49cf-b2cc-f68ef62da963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:16.160412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537f306-0bb5-49cf-b2cc-f68ef62da963 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:16.160690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537f306-0bb5-49cf-b2cc-f68ef62da963 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:16.160957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6537f306-0bb5-49cf-b2cc-f68ef62da963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:16.171182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537f306-0bb5-49cf-b2cc-f68ef62da963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:16.172625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6537f306-0bb5-49cf-b2cc-f68ef62da963 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-6537f306-0bb5-49cf-b2cc-f68ef62da963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:54:16.187560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:16.188702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:54:16.190013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:54:16.190013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:16.190013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:16.190013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 636/1278] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:16.194585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02b9fa-4da0-4538-a5c8-31f99589e150 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:16.292858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d02b9fa-4da0-4538-a5c8-31f99589e150 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:16.325658 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1fde7-15cf-49ce-8fbb-f2ae3927fc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:16.326293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1fde7-15cf-49ce-8fbb-f2ae3927fc37 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:16.326567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1fde7-15cf-49ce-8fbb-f2ae3927fc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:16.326838 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1fde7-15cf-49ce-8fbb-f2ae3927fc37 None admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:16.327467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1fde7-15cf-49ce-8fbb-f2ae3927fc37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:16.327764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1fde7-15cf-49ce-8fbb-f2ae3927fc37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:16.329439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c1fde7-15cf-49ce-8fbb-f2ae3927fc37 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:16.340797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 643/1279] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:16.347114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537f306-0bb5-49cf-b2cc-f68ef62da963 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:16.379532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:16.450101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6537f306-0bb5-49cf-b2cc-f68ef62da963 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:16.483900 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98190b68-89fc-4944-aff5-0e479bfd5613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:16.484547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98190b68-89fc-4944-aff5-0e479bfd5613 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:16.484863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98190b68-89fc-4944-aff5-0e479bfd5613 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:16.485170 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98190b68-89fc-4944-aff5-0e479bfd5613 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:16.492711 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98190b68-89fc-4944-aff5-0e479bfd5613 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:16.494931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98190b68-89fc-4944-aff5-0e479bfd5613 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-98190b68-89fc-4944-aff5-0e479bfd5613 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 07:54:16.505982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:16.507072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:16.508525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:16.508525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:16.508525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 07:54:16.508525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 07:54:16.508525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 07:54:16.508525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 07:54:16.508525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 07:54:16.508525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 07:54:16.508525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 07:54:16.508525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:16.508525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 637/1280] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:54:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:16.513434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1fde7-15cf-49ce-8fbb-f2ae3927fc37 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:16.517433 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:16.613335 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1fde7-15cf-49ce-8fbb-f2ae3927fc37 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:16.646467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781c5c-dc73-4a4f-ad66-a02d6f22078b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:16.647079 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781c5c-dc73-4a4f-ad66-a02d6f22078b None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:16.647355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781c5c-dc73-4a4f-ad66-a02d6f22078b None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:16.647630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b781c5c-dc73-4a4f-ad66-a02d6f22078b None admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:16.648380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b781c5c-dc73-4a4f-ad66-a02d6f22078b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:16.648687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b781c5c-dc73-4a4f-ad66-a02d6f22078b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:16.650193 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b781c5c-dc73-4a4f-ad66-a02d6f22078b None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:16.667219 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 644/1281] 10.222.0.62 () {56 vars in 1143 bytes} [Wed Aug 24 07:54:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:16.673070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98190b68-89fc-4944-aff5-0e479bfd5613 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:16.762120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:16.771585 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98190b68-89fc-4944-aff5-0e479bfd5613 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:16.809143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23657a-fe47-427e-9a3a-e39be18097ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:16.809820 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23657a-fe47-427e-9a3a-e39be18097ed None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:16.810098 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23657a-fe47-427e-9a3a-e39be18097ed None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:16.810370 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23657a-fe47-427e-9a3a-e39be18097ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:16.883263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23657a-fe47-427e-9a3a-e39be18097ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:16.884731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23657a-fe47-427e-9a3a-e39be18097ed None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:16.983162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:16.999278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 638/1282] 10.222.0.62 () {58 vars in 1282 bytes} [Wed Aug 24 07:54:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 07:54:17.000608 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781c5c-dc73-4a4f-ad66-a02d6f22078b None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:17.065544 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:17.105984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b781c5c-dc73-4a4f-ad66-a02d6f22078b None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:17.139720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85556b0-26c5-494f-b484-f447ffd50ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:17.140332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85556b0-26c5-494f-b484-f447ffd50ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:17.140613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85556b0-26c5-494f-b484-f447ffd50ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:17.140880 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85556b0-26c5-494f-b484-f447ffd50ed3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:17.152334 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85556b0-26c5-494f-b484-f447ffd50ed3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:17.153755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85556b0-26c5-494f-b484-f447ffd50ed3 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-b85556b0-26c5-494f-b484-f447ffd50ed3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 07:54:17.169203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:17.175565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 07:54:17.176564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 07:54:17.176564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 07:54:17.176564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:54:17.176564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 645/1283] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 07:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:17.176842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23657a-fe47-427e-9a3a-e39be18097ed None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:17.279583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23657a-fe47-427e-9a3a-e39be18097ed None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:17.313623 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a7761-d389-4568-af7c-7fd0df60f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:17.314223 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a7761-d389-4568-af7c-7fd0df60f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:17.314526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a7761-d389-4568-af7c-7fd0df60f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:17.314792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a7761-d389-4568-af7c-7fd0df60f9c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:17.315419 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a7761-d389-4568-af7c-7fd0df60f9c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:17.315715 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a7761-d389-4568-af7c-7fd0df60f9c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:17.317092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a7761-d389-4568-af7c-7fd0df60f9c5 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:17.327958 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 639/1284] 10.222.0.62 () {56 vars in 1109 bytes} [Wed Aug 24 07:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:17.333900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85556b0-26c5-494f-b484-f447ffd50ed3 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:17.430671 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85556b0-26c5-494f-b484-f447ffd50ed3 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:17.443995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:17.463119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75913c23-324f-415c-9968-58e2367b8699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:17.463737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75913c23-324f-415c-9968-58e2367b8699 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:17.466999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75913c23-324f-415c-9968-58e2367b8699 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:17.466999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75913c23-324f-415c-9968-58e2367b8699 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:17.470562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75913c23-324f-415c-9968-58e2367b8699 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:17.472018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75913c23-324f-415c-9968-58e2367b8699 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application [None req-75913c23-324f-415c-9968-58e2367b8699 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 07:54:17.483324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:17.491140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:17.492316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 07:54:17.492316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 07:54:17.492316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 07:54:17.492316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 07:54:17.492316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 07:54:17.492316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 07:54:17.492316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 07:54:17.492316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: ERROR keystone.server.flask.application Aug 24 07:54:17.492316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 646/1285] 10.222.0.62 () {56 vars in 1111 bytes} [Wed Aug 24 07:54:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:17.493000 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a7761-d389-4568-af7c-7fd0df60f9c5 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:17.539043 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:17.588604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a7761-d389-4568-af7c-7fd0df60f9c5 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:17.622915 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b217a-2d93-46ba-b1cd-5420eaf0a718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:17.623518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b217a-2d93-46ba-b1cd-5420eaf0a718 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:17.623804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b217a-2d93-46ba-b1cd-5420eaf0a718 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:17.624114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b217a-2d93-46ba-b1cd-5420eaf0a718 None admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:17.624802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b217a-2d93-46ba-b1cd-5420eaf0a718 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:17.625110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b217a-2d93-46ba-b1cd-5420eaf0a718 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:17.626556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b217a-2d93-46ba-b1cd-5420eaf0a718 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:17.638181 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 640/1286] 10.222.0.62 () {56 vars in 1148 bytes} [Wed Aug 24 07:54:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:17.644298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75913c23-324f-415c-9968-58e2367b8699 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:17.742983 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75913c23-324f-415c-9968-58e2367b8699 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:17.775660 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ec77d-63b1-4b1d-8b4d-aa32f235ba66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:17.776171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec77d-63b1-4b1d-8b4d-aa32f235ba66 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:17.776462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec77d-63b1-4b1d-8b4d-aa32f235ba66 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:17.776727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec77d-63b1-4b1d-8b4d-aa32f235ba66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:17.777440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ec77d-63b1-4b1d-8b4d-aa32f235ba66 None admin] RBAC: Adding query filter params (role.id=68b1888f7bb644a39938b8d41006a813, scope.project.id=1c1074e261454981a85d02b4b0f75ec5, user.id=d213e29685f3402b804d4d8fbc88ba96) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:17.777747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ec77d-63b1-4b1d-8b4d-aa32f235ba66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:17.779166 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ec77d-63b1-4b1d-8b4d-aa32f235ba66 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:17.784759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 647/1287] 10.222.0.62 () {56 vars in 1374 bytes} [Wed Aug 24 07:54:17 2022] GET /identity/v3/role_assignments?user.id=d213e29685f3402b804d4d8fbc88ba96&scope.project.id=1c1074e261454981a85d02b4b0f75ec5&role.id=68b1888f7bb644a39938b8d41006a813 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:19.901088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0059d9a-a7a9-45c1-b2f8-f13276b62220 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:19.901639 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0059d9a-a7a9-45c1-b2f8-f13276b62220 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:19.901639 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0059d9a-a7a9-45c1-b2f8-f13276b62220 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:19.902940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 641/1288] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:54:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:19.908388 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c037d9-dc0f-4512-9357-b50f8d692fb9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:19.912208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c037d9-dc0f-4512-9357-b50f8d692fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:19.912208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c037d9-dc0f-4512-9357-b50f8d692fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:19.926835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-73c037d9-dc0f-4512-9357-b50f8d692fb9 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:19.928079 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-73c037d9-dc0f-4512-9357-b50f8d692fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:19.959054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:19.995487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 648/1289] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:54:20.271159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0059d9a-a7a9-45c1-b2f8-f13276b62220 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:20.371411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0059d9a-a7a9-45c1-b2f8-f13276b62220 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:20.383741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:20.406595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35898f-034a-41c3-876c-39d457484062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:20.407213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35898f-034a-41c3-876c-39d457484062 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:20.407489 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35898f-034a-41c3-876c-39d457484062 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:20.414913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35898f-034a-41c3-876c-39d457484062 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:20.414913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35898f-034a-41c3-876c-39d457484062 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:20.414913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db35898f-034a-41c3-876c-39d457484062 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-db35898f-034a-41c3-876c-39d457484062 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:20.418624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:20.419866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:20.420978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 642/1290] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 24 07:54:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:20.425756 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c037d9-dc0f-4512-9357-b50f8d692fb9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:20.528845 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c037d9-dc0f-4512-9357-b50f8d692fb9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:20.562175 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cfd14-80e6-4dd0-a08f-bb02f088df46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:20.562776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cfd14-80e6-4dd0-a08f-bb02f088df46 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:20.563052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cfd14-80e6-4dd0-a08f-bb02f088df46 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:20.563335 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cfd14-80e6-4dd0-a08f-bb02f088df46 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:20.563966 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cfd14-80e6-4dd0-a08f-bb02f088df46 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:20.564301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cfd14-80e6-4dd0-a08f-bb02f088df46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:20.565651 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cfd14-80e6-4dd0-a08f-bb02f088df46 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:20.571206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 649/1291] 10.222.0.62 () {56 vars in 1116 bytes} [Wed Aug 24 07:54:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:20.577603 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35898f-034a-41c3-876c-39d457484062 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:20.680533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35898f-034a-41c3-876c-39d457484062 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:20.713194 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87d6a17-563f-41ad-8108-18c1fe682408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:20.713792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d6a17-563f-41ad-8108-18c1fe682408 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:20.714065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d6a17-563f-41ad-8108-18c1fe682408 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:20.714331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87d6a17-563f-41ad-8108-18c1fe682408 None admin] PATH_INFO: `/v3/services` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:20.714945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d6a17-563f-41ad-8108-18c1fe682408 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:20.715245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d6a17-563f-41ad-8108-18c1fe682408 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:20.716611 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87d6a17-563f-41ad-8108-18c1fe682408 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:20.720851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 643/1292] 10.222.0.62 () {56 vars in 1116 bytes} [Wed Aug 24 07:54:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:22.612795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ebd5b-c5f6-4399-9dd8-71cc6bc29652 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:22.613365 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ebd5b-c5f6-4399-9dd8-71cc6bc29652 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:22.613365 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ebd5b-c5f6-4399-9dd8-71cc6bc29652 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:22.614673 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 650/1293] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:54:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:22.620312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4813540-5a78-4102-bcc0-fd99cf7dc038 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:22.620693 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4813540-5a78-4102-bcc0-fd99cf7dc038 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:22.620866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4813540-5a78-4102-bcc0-fd99cf7dc038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:22.640265 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f4813540-5a78-4102-bcc0-fd99cf7dc038 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:22.640433 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f4813540-5a78-4102-bcc0-fd99cf7dc038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:22.670052 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:22.707940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 644/1294] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:54:22.978524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ebd5b-c5f6-4399-9dd8-71cc6bc29652 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:23.010042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:23.079516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ebd5b-c5f6-4399-9dd8-71cc6bc29652 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:23.113408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc55499-65f7-4c5b-918c-ec7d689c264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:23.114009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc55499-65f7-4c5b-918c-ec7d689c264e None admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:23.114290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc55499-65f7-4c5b-918c-ec7d689c264e None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:23.114562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc55499-65f7-4c5b-918c-ec7d689c264e None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:23.115208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc55499-65f7-4c5b-918c-ec7d689c264e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:23.116630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc55499-65f7-4c5b-918c-ec7d689c264e None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:23.187266 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 651/1295] 10.222.0.62 () {60 vars in 1141 bytes} [Wed Aug 24 07:54:22 2022] POST /identity/v3/services => generated 246 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:25.104208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15c245-2cbc-4cf5-8a7b-d380bc3d0d0a None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:25.104763 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15c245-2cbc-4cf5-8a7b-d380bc3d0d0a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:25.104888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15c245-2cbc-4cf5-8a7b-d380bc3d0d0a None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:25.106258 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 645/1296] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:25.111550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c50f3-0b47-4fc7-b145-d65050cfc806 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:25.112019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c50f3-0b47-4fc7-b145-d65050cfc806 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:25.112130 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c50f3-0b47-4fc7-b145-d65050cfc806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:25.129922 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4c2c50f3-0b47-4fc7-b145-d65050cfc806 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:25.131096 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4c2c50f3-0b47-4fc7-b145-d65050cfc806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:25.204651 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 652/1297] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 07:54:25.475387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15c245-2cbc-4cf5-8a7b-d380bc3d0d0a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:25.573789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15c245-2cbc-4cf5-8a7b-d380bc3d0d0a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:25.606965 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a55f08-8748-425c-8d36-eb667121f1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:25.607581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a55f08-8748-425c-8d36-eb667121f1c8 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:25.607888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a55f08-8748-425c-8d36-eb667121f1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:25.608151 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a55f08-8748-425c-8d36-eb667121f1c8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:25.608725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a55f08-8748-425c-8d36-eb667121f1c8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:25.610084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a55f08-8748-425c-8d36-eb667121f1c8 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-39a55f08-8748-425c-8d36-eb667121f1c8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:25.619226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:25.624969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:25.626243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 646/1298] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 24 07:54:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:25.627238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c50f3-0b47-4fc7-b145-d65050cfc806 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:25.647675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:25.722291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c50f3-0b47-4fc7-b145-d65050cfc806 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:25.756975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87a731-872b-4d6e-987a-5dbacf2c12e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:25.757578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87a731-872b-4d6e-987a-5dbacf2c12e4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:25.757861 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87a731-872b-4d6e-987a-5dbacf2c12e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:25.758139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87a731-872b-4d6e-987a-5dbacf2c12e4 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:25.758875 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87a731-872b-4d6e-987a-5dbacf2c12e4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:25.759243 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87a731-872b-4d6e-987a-5dbacf2c12e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:25.760626 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87a731-872b-4d6e-987a-5dbacf2c12e4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:25.765593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 653/1299] 10.222.0.62 () {56 vars in 1116 bytes} [Wed Aug 24 07:54:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:25.771605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a55f08-8748-425c-8d36-eb667121f1c8 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:25.803452 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:25.870902 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a55f08-8748-425c-8d36-eb667121f1c8 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:25.905041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbede2-ecd3-4326-90fd-c06037b61c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:25.905573 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbede2-ecd3-4326-90fd-c06037b61c61 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:25.905848 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbede2-ecd3-4326-90fd-c06037b61c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:25.906115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbede2-ecd3-4326-90fd-c06037b61c61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:25.906799 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbede2-ecd3-4326-90fd-c06037b61c61 None admin] RBAC: Adding query filter params (interface=public, service_id=d339796764fd4b7bb026bc17fbefa048, region_id=RegionOne) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:25.907102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbede2-ecd3-4326-90fd-c06037b61c61 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:25.908476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbede2-ecd3-4326-90fd-c06037b61c61 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:25.913275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 647/1300] 10.222.0.62 () {56 vars in 1251 bytes} [Wed Aug 24 07:54:25 2022] GET /identity/v3/endpoints?service_id=d339796764fd4b7bb026bc17fbefa048&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:25.919788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87a731-872b-4d6e-987a-5dbacf2c12e4 None admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:25.997321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:26.014202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87a731-872b-4d6e-987a-5dbacf2c12e4 None admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:26.047170 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce05b85-3880-44a5-9b52-bc578dacfb12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:26.047763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce05b85-3880-44a5-9b52-bc578dacfb12 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:26.048063 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce05b85-3880-44a5-9b52-bc578dacfb12 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:26.048332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce05b85-3880-44a5-9b52-bc578dacfb12 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:26.048971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce05b85-3880-44a5-9b52-bc578dacfb12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:26.050306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce05b85-3880-44a5-9b52-bc578dacfb12 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:26.056945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 654/1301] 10.222.0.62 () {56 vars in 1087 bytes} [Wed Aug 24 07:54:25 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:54:27.956531 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b484d-9552-4b9c-93af-ad7d5f1376e2 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:27.957088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b484d-9552-4b9c-93af-ad7d5f1376e2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:27.957088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187b484d-9552-4b9c-93af-ad7d5f1376e2 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:27.958384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 648/1302] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 07:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:54:27.964359 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb8ab7-611e-47dd-81fe-f428452ff701 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:27.964790 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb8ab7-611e-47dd-81fe-f428452ff701 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:27.964930 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb8ab7-611e-47dd-81fe-f428452ff701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:27.982642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3cbb8ab7-611e-47dd-81fe-f428452ff701 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:54:27.983818 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3cbb8ab7-611e-47dd-81fe-f428452ff701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:54:28.048592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 655/1303] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 07:54:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 07:54:28.318166 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b484d-9552-4b9c-93af-ad7d5f1376e2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:28.416730 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:28.423318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187b484d-9552-4b9c-93af-ad7d5f1376e2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:28.457516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ebf80-81c2-49c6-a280-467403b36e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:28.458142 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ebf80-81c2-49c6-a280-467403b36e75 None admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:28.458421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ebf80-81c2-49c6-a280-467403b36e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:28.458692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ebf80-81c2-49c6-a280-467403b36e75 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:28.459275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ebf80-81c2-49c6-a280-467403b36e75 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:28.460654 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ebf80-81c2-49c6-a280-467403b36e75 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application [None req-c46ebf80-81c2-49c6-a280-467403b36e75 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 07:54:28.470056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 07:54:28.471284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application with Lock( Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self._enter() Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application return self.creator() Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application created_value = creator( Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: ERROR keystone.server.flask.application Aug 24 07:54:28.472478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 649/1304] 10.222.0.62 () {56 vars in 1117 bytes} [Wed Aug 24 07:54:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 07:54:28.477242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb8ab7-611e-47dd-81fe-f428452ff701 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:28.552346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:28.574645 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb8ab7-611e-47dd-81fe-f428452ff701 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:28.607890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb73640-8acd-453d-bf7c-2c3cbfd7f3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:28.608487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb73640-8acd-453d-bf7c-2c3cbfd7f3c4 None admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:28.608764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb73640-8acd-453d-bf7c-2c3cbfd7f3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:28.609035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb73640-8acd-453d-bf7c-2c3cbfd7f3c4 None admin] PATH_INFO: `/v3/services` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:28.609650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb73640-8acd-453d-bf7c-2c3cbfd7f3c4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:54:28.609950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb73640-8acd-453d-bf7c-2c3cbfd7f3c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:28.611298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb73640-8acd-453d-bf7c-2c3cbfd7f3c4 None admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:28.616272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 656/1305] 10.222.0.62 () {56 vars in 1116 bytes} [Wed Aug 24 07:54:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:54:28.622962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ebf80-81c2-49c6-a280-467403b36e75 None admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:54:28.720172 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ebf80-81c2-49c6-a280-467403b36e75 None admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:54:28.753498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117f22ea-ae14-4f67-a038-74a21d93c981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:54:28.754094 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f22ea-ae14-4f67-a038-74a21d93c981 None admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:54:28.754372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f22ea-ae14-4f67-a038-74a21d93c981 None admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:54:28.754640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117f22ea-ae14-4f67-a038-74a21d93c981 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:54:28.755286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f22ea-ae14-4f67-a038-74a21d93c981 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:54:28.756735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117f22ea-ae14-4f67-a038-74a21d93c981 None admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:54:28.907019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 650/1306] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 07:54:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:54:38.613297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=30 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:54:38.902660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:16.950085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76715042-c688-4ce6-a330-495d34079530 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:16.950554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76715042-c688-4ce6-a330-495d34079530 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:16.950790 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76715042-c688-4ce6-a330-495d34079530 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:16.951986 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 657/1307] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:00:16.958716 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90319752-5efd-4dbf-8e08-bfea39d9dd65 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:16.959150 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90319752-5efd-4dbf-8e08-bfea39d9dd65 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:16.959574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90319752-5efd-4dbf-8e08-bfea39d9dd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:17.056743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-90319752-5efd-4dbf-8e08-bfea39d9dd65 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:17.058261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-90319752-5efd-4dbf-8e08-bfea39d9dd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:17.179274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 651/1308] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:17.479475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e165b6b-ea4d-43a1-b452-e349fed0eb79 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:17.479765 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e165b6b-ea4d-43a1-b452-e349fed0eb79 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:17.480378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e165b6b-ea4d-43a1-b452-e349fed0eb79 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:17.482028 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 658/1309] 10.222.0.62 () {54 vars in 965 bytes} [Wed Aug 24 08:00:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:17.488440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27380e-c7d1-4311-ad67-3ff7514021ec None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:17.488803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27380e-c7d1-4311-ad67-3ff7514021ec None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:17.489130 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a27380e-c7d1-4311-ad67-3ff7514021ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:17.569161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5a27380e-c7d1-4311-ad67-3ff7514021ec None None] MFA Rules not processed for user `f49116f202774e4da0c96875ffa08288`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:17.570365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5a27380e-c7d1-4311-ad67-3ff7514021ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:17.592237 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:17.651588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 652/1310] 10.222.0.62 () {58 vars in 1062 bytes} [Wed Aug 24 08:00:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:17.661716 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e165b6b-ea4d-43a1-b452-e349fed0eb79 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:17.663768 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0e165b6b-ea4d-43a1-b452-e349fed0eb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:17.798282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e165b6b-ea4d-43a1-b452-e349fed0eb79 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:17.879951 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a9339-9f68-4195-a340-4fe89727e602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:17.880928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a9339-9f68-4195-a340-4fe89727e602 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:17.881275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a9339-9f68-4195-a340-4fe89727e602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:17.881616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a9339-9f68-4195-a340-4fe89727e602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:17.883338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a45a9339-9f68-4195-a340-4fe89727e602 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:17.942537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:17.997860 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a9339-9f68-4195-a340-4fe89727e602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:17.999296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a9339-9f68-4195-a340-4fe89727e602 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:18.018886 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 659/1311] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:20.233277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ac2a6-6f2c-417f-a548-3978400d43f2 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.233766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ac2a6-6f2c-417f-a548-3978400d43f2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.233862 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551ac2a6-6f2c-417f-a548-3978400d43f2 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.235727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 653/1312] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:00:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:20.241049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56c743-ed63-43e9-a1ef-2aa46751c872 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.241445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56c743-ed63-43e9-a1ef-2aa46751c872 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.241598 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56c743-ed63-43e9-a1ef-2aa46751c872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.324186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ce56c743-ed63-43e9-a1ef-2aa46751c872 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:20.325395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ce56c743-ed63-43e9-a1ef-2aa46751c872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:20.427459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 660/1313] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:00:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:20.711667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ac2a6-6f2c-417f-a548-3978400d43f2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:20.713225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-551ac2a6-6f2c-417f-a548-3978400d43f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:20.814131 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551ac2a6-6f2c-417f-a548-3978400d43f2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:20.884612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:20.887186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a04b40-16aa-4e87-bd00-3bd54bcb3adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:20.887796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a04b40-16aa-4e87-bd00-3bd54bcb3adb service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:20.888123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a04b40-16aa-4e87-bd00-3bd54bcb3adb service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:20.888388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a04b40-16aa-4e87-bd00-3bd54bcb3adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:20.889963 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d3a04b40-16aa-4e87-bd00-3bd54bcb3adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:20.997363 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a04b40-16aa-4e87-bd00-3bd54bcb3adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:20.998699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a04b40-16aa-4e87-bd00-3bd54bcb3adb service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:21.017037 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 654/1314] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:23.441037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc700202-c8fc-414b-ad8e-8fc93cc177fc None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:23.441555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc700202-c8fc-414b-ad8e-8fc93cc177fc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:23.441667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc700202-c8fc-414b-ad8e-8fc93cc177fc None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:23.442982 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 661/1315] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:23.448320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee1225-5a02-4600-9b97-be26265cbd79 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:23.448756 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee1225-5a02-4600-9b97-be26265cbd79 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:23.448853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee1225-5a02-4600-9b97-be26265cbd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:23.513663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-88ee1225-5a02-4600-9b97-be26265cbd79 None None] MFA Rules not processed for user `c72dab1e64e3435cbf22437d73cbf5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:23.514787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-88ee1225-5a02-4600-9b97-be26265cbd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:23.566088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:23.610602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 655/1316] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:00:23 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:23.897153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc700202-c8fc-414b-ad8e-8fc93cc177fc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:23.898714 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cc700202-c8fc-414b-ad8e-8fc93cc177fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:23.909123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:24.001992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc700202-c8fc-414b-ad8e-8fc93cc177fc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:24.072747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a2e9b7-5252-48a4-9d50-d27e71bd4729 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:24.073356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2e9b7-5252-48a4-9d50-d27e71bd4729 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:24.073632 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2e9b7-5252-48a4-9d50-d27e71bd4729 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:24.073898 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a2e9b7-5252-48a4-9d50-d27e71bd4729 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:24.075494 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-06a2e9b7-5252-48a4-9d50-d27e71bd4729 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:24.138806 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:24.302874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2e9b7-5252-48a4-9d50-d27e71bd4729 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:24.304331 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a2e9b7-5252-48a4-9d50-d27e71bd4729 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:24.321915 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 662/1317] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:23 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:27.171026 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263703-7621-40d2-b0bf-2b343568e2cd None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:27.171608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263703-7621-40d2-b0bf-2b343568e2cd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:27.171608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68263703-7621-40d2-b0bf-2b343568e2cd None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:27.172927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 656/1318] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:27.178001 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88408-967c-4306-8eba-6b935902329a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:27.178420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88408-967c-4306-8eba-6b935902329a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:27.178523 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb88408-967c-4306-8eba-6b935902329a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:27.242015 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5eb88408-967c-4306-8eba-6b935902329a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:27.243204 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5eb88408-967c-4306-8eba-6b935902329a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:27.336873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 663/1319] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:00:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:00:27.620256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68263703-7621-40d2-b0bf-2b343568e2cd None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:27.621841 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-68263703-7621-40d2-b0bf-2b343568e2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:27.724440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68263703-7621-40d2-b0bf-2b343568e2cd None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:27.797035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658afabc-44c7-4ce9-8ef7-2d38e4d8527e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:27.797633 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658afabc-44c7-4ce9-8ef7-2d38e4d8527e service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:27.797907 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658afabc-44c7-4ce9-8ef7-2d38e4d8527e service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:27.798168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658afabc-44c7-4ce9-8ef7-2d38e4d8527e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:27.799738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-658afabc-44c7-4ce9-8ef7-2d38e4d8527e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:27.808132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:27.908608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658afabc-44c7-4ce9-8ef7-2d38e4d8527e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:27.909946 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658afabc-44c7-4ce9-8ef7-2d38e4d8527e service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:27.927476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 657/1320] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:30.775026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf06f6c-414f-41b3-a31d-0cf247293256 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:30.775570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf06f6c-414f-41b3-a31d-0cf247293256 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:30.775570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf06f6c-414f-41b3-a31d-0cf247293256 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:30.776943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 664/1321] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:30.782486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0edb8c-a480-48c5-be2f-0b09f92f31cd None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:30.782969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0edb8c-a480-48c5-be2f-0b09f92f31cd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:30.783254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0edb8c-a480-48c5-be2f-0b09f92f31cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:30.849829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8a0edb8c-a480-48c5-be2f-0b09f92f31cd None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:30.851011 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8a0edb8c-a480-48c5-be2f-0b09f92f31cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:30.908932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:30.948150 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 658/1322] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:31.245400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffeace-becc-4898-9597-4d4ceda379e7 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:31.245694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffeace-becc-4898-9597-4d4ceda379e7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:31.245973 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffeace-becc-4898-9597-4d4ceda379e7 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:31.247382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 665/1323] 10.222.0.62 () {54 vars in 965 bytes} [Wed Aug 24 08:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:31.254552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9ce39-dfb6-45d6-9ad5-69e9d168ae07 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:31.254840 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9ce39-dfb6-45d6-9ad5-69e9d168ae07 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:31.255115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e9ce39-dfb6-45d6-9ad5-69e9d168ae07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:31.337515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b2e9ce39-dfb6-45d6-9ad5-69e9d168ae07 None None] MFA Rules not processed for user `f49116f202774e4da0c96875ffa08288`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:31.338716 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b2e9ce39-dfb6-45d6-9ad5-69e9d168ae07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:31.419081 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 659/1324] 10.222.0.62 () {58 vars in 1062 bytes} [Wed Aug 24 08:00:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:31.428237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffeace-becc-4898-9597-4d4ceda379e7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:31.429763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8fffeace-becc-4898-9597-4d4ceda379e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:31.448788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:31.534048 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffeace-becc-4898-9597-4d4ceda379e7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:31.607736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ce69e-f30a-4c6d-9c24-de1f624e458f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:31.608390 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce69e-f30a-4c6d-9c24-de1f624e458f service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:31.608667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce69e-f30a-4c6d-9c24-de1f624e458f service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:31.608937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ce69e-f30a-4c6d-9c24-de1f624e458f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:31.611151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c49ce69e-f30a-4c6d-9c24-de1f624e458f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:31.682548 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:31.720733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ce69e-f30a-4c6d-9c24-de1f624e458f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:31.722171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ce69e-f30a-4c6d-9c24-de1f624e458f service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:31.741269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 666/1325] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:33.903443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf1d4-5942-4bd3-89e3-90aceb891185 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:33.903992 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf1d4-5942-4bd3-89e3-90aceb891185 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:33.904100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6bf1d4-5942-4bd3-89e3-90aceb891185 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:33.905486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 660/1326] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:33.910684 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2500ae-6fba-4c89-a5a4-72da2dfcd12c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:33.911155 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2500ae-6fba-4c89-a5a4-72da2dfcd12c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:33.911236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2500ae-6fba-4c89-a5a4-72da2dfcd12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:33.980100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7d2500ae-6fba-4c89-a5a4-72da2dfcd12c None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:33.981345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7d2500ae-6fba-4c89-a5a4-72da2dfcd12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:34.078410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 667/1327] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:34.358614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bf1d4-5942-4bd3-89e3-90aceb891185 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:34.361096 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1c6bf1d4-5942-4bd3-89e3-90aceb891185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:34.423127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:34.466908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6bf1d4-5942-4bd3-89e3-90aceb891185 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:34.540971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921ca06-c908-4842-8aa0-fafbea95a167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:34.541598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ca06-c908-4842-8aa0-fafbea95a167 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:34.541869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ca06-c908-4842-8aa0-fafbea95a167 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:34.542135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921ca06-c908-4842-8aa0-fafbea95a167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:34.543703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6921ca06-c908-4842-8aa0-fafbea95a167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:34.651461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:34.653834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921ca06-c908-4842-8aa0-fafbea95a167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:34.655257 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921ca06-c908-4842-8aa0-fafbea95a167 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:34.674251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 661/1328] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:36.647209 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ae8b-e308-4468-9125-8bae811f17c2 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:36.647683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ae8b-e308-4468-9125-8bae811f17c2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:36.647913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ae8b-e308-4468-9125-8bae811f17c2 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:36.649240 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 668/1329] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:36.654506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17e518-be1d-4dc9-9d77-a79a81a2d2d1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:36.654925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17e518-be1d-4dc9-9d77-a79a81a2d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:36.655177 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17e518-be1d-4dc9-9d77-a79a81a2d2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:36.721286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-eb17e518-be1d-4dc9-9d77-a79a81a2d2d1 None None] MFA Rules not processed for user `c72dab1e64e3435cbf22437d73cbf5a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:36.722495 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-eb17e518-be1d-4dc9-9d77-a79a81a2d2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:36.847185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 662/1330] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:00:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:37.133330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ae8b-e308-4468-9125-8bae811f17c2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:37.134871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a855ae8b-e308-4468-9125-8bae811f17c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:37.167815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:37.241623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ae8b-e308-4468-9125-8bae811f17c2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:37.313896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231ad238-23b2-4a06-ba28-4a3cdcc83440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:37.314495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ad238-23b2-4a06-ba28-4a3cdcc83440 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:37.314772 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ad238-23b2-4a06-ba28-4a3cdcc83440 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:37.315038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231ad238-23b2-4a06-ba28-4a3cdcc83440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:37.316650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-231ad238-23b2-4a06-ba28-4a3cdcc83440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:37.395986 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:37.429231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ad238-23b2-4a06-ba28-4a3cdcc83440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:37.430725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231ad238-23b2-4a06-ba28-4a3cdcc83440 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:37.450672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 669/1331] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:37 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:39.771529 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19497bfa-f7ba-4eac-9aa9-46cc509cde9a None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:39.772177 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19497bfa-f7ba-4eac-9aa9-46cc509cde9a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:39.772177 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19497bfa-f7ba-4eac-9aa9-46cc509cde9a None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:39.773474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 663/1332] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:39.778867 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b50d82-16f9-485a-9f4c-b4e7a541b9bc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:39.779280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b50d82-16f9-485a-9f4c-b4e7a541b9bc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:39.782471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b50d82-16f9-485a-9f4c-b4e7a541b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:39.845174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b7b50d82-16f9-485a-9f4c-b4e7a541b9bc None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:39.846578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b7b50d82-16f9-485a-9f4c-b4e7a541b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:39.941189 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 670/1333] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:40.224087 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19497bfa-f7ba-4eac-9aa9-46cc509cde9a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:40.225654 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-19497bfa-f7ba-4eac-9aa9-46cc509cde9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:40.294624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:40.328121 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19497bfa-f7ba-4eac-9aa9-46cc509cde9a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:40.401871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59c0ab5-084f-4800-ac44-9be165111c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:40.402464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c0ab5-084f-4800-ac44-9be165111c41 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:40.402736 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c0ab5-084f-4800-ac44-9be165111c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:40.402999 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59c0ab5-084f-4800-ac44-9be165111c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:40.404615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a59c0ab5-084f-4800-ac44-9be165111c41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:40.517463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c0ab5-084f-4800-ac44-9be165111c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:40.518927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59c0ab5-084f-4800-ac44-9be165111c41 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:40.529095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:40.538792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 664/1334] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:42.494579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894622f7-ab05-4a58-9489-9bb9e83dbaad None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:42.495072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894622f7-ab05-4a58-9489-9bb9e83dbaad None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:42.495188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894622f7-ab05-4a58-9489-9bb9e83dbaad None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:42.496501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 671/1335] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:00:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:42.502460 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd09ba-61fd-4f06-a050-6a2f4125b6bd None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:42.502854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd09ba-61fd-4f06-a050-6a2f4125b6bd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:42.503001 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd09ba-61fd-4f06-a050-6a2f4125b6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:42.567925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-14cd09ba-61fd-4f06-a050-6a2f4125b6bd None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:42.569140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-14cd09ba-61fd-4f06-a050-6a2f4125b6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:42.664841 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 665/1336] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:42.950759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894622f7-ab05-4a58-9489-9bb9e83dbaad None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:42.952352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-894622f7-ab05-4a58-9489-9bb9e83dbaad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:42.992451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:43.055139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894622f7-ab05-4a58-9489-9bb9e83dbaad None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:43.125822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ff520-a69c-4e31-99e0-86e4047eee2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:43.126421 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ff520-a69c-4e31-99e0-86e4047eee2c service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:43.126697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ff520-a69c-4e31-99e0-86e4047eee2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:43.126967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ff520-a69c-4e31-99e0-86e4047eee2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:43.128581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-590ff520-a69c-4e31-99e0-86e4047eee2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:43.210087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:43.236996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ff520-a69c-4e31-99e0-86e4047eee2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:43.238417 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590ff520-a69c-4e31-99e0-86e4047eee2c service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:43.256545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 672/1337] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:45.712382 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa947cad-e545-4565-ad7f-975256beecaa None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:45.712945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa947cad-e545-4565-ad7f-975256beecaa None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:45.712945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa947cad-e545-4565-ad7f-975256beecaa None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:45.714189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 666/1338] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:45.719295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737e584-fa17-4273-8658-b365ef66536f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:45.719759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737e584-fa17-4273-8658-b365ef66536f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:45.719886 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737e584-fa17-4273-8658-b365ef66536f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:45.784098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1737e584-fa17-4273-8658-b365ef66536f None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:45.785286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1737e584-fa17-4273-8658-b365ef66536f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:45.879516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 673/1339] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:00:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:46.165857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa947cad-e545-4565-ad7f-975256beecaa None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:46.167412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fa947cad-e545-4565-ad7f-975256beecaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:46.243170 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:46.270043 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa947cad-e545-4565-ad7f-975256beecaa None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:46.342582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd776c7-d617-4153-8d8b-0ff698511c23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:46.343182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd776c7-d617-4153-8d8b-0ff698511c23 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:46.343453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd776c7-d617-4153-8d8b-0ff698511c23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:46.343718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd776c7-d617-4153-8d8b-0ff698511c23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:46.345377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cfd776c7-d617-4153-8d8b-0ff698511c23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:46.452532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd776c7-d617-4153-8d8b-0ff698511c23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:46.454645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd776c7-d617-4153-8d8b-0ff698511c23 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:46.474419 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 667/1340] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:50.848447 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865252e1-98f7-4a96-aa3d-4353bc63cadc None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:50.848962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865252e1-98f7-4a96-aa3d-4353bc63cadc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:50.849076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865252e1-98f7-4a96-aa3d-4353bc63cadc None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:50.850392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 674/1341] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:50.855957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0a226-d712-4e4c-9d8d-61fb5cd06983 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:50.857043 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0a226-d712-4e4c-9d8d-61fb5cd06983 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:50.857333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0a226-d712-4e4c-9d8d-61fb5cd06983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:50.864254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:50.928742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-66f0a226-d712-4e4c-9d8d-61fb5cd06983 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:50.929939 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-66f0a226-d712-4e4c-9d8d-61fb5cd06983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:51.027427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 668/1342] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:51.313433 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865252e1-98f7-4a96-aa3d-4353bc63cadc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:51.315013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-865252e1-98f7-4a96-aa3d-4353bc63cadc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:51.363672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:51.424339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865252e1-98f7-4a96-aa3d-4353bc63cadc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:51.496650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b593e0-43da-489b-a7e6-2226e79e4a2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:51.497258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b593e0-43da-489b-a7e6-2226e79e4a2c service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:51.497534 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b593e0-43da-489b-a7e6-2226e79e4a2c service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:51.497800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b593e0-43da-489b-a7e6-2226e79e4a2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:51.499381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-39b593e0-43da-489b-a7e6-2226e79e4a2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:51.593500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:51.610639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b593e0-43da-489b-a7e6-2226e79e4a2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:51.612089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b593e0-43da-489b-a7e6-2226e79e4a2c service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:51.630678 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 675/1343] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:54.555191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91151b1e-55ae-4cc6-b843-b964ad9987df None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:54.555747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91151b1e-55ae-4cc6-b843-b964ad9987df None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:54.555747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91151b1e-55ae-4cc6-b843-b964ad9987df None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:54.557112 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 669/1344] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:00:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:54.562453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45f414-da9b-4b0e-b7c9-619f01c5a190 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:54.562902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45f414-da9b-4b0e-b7c9-619f01c5a190 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:54.563320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb45f414-da9b-4b0e-b7c9-619f01c5a190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:54.630321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fb45f414-da9b-4b0e-b7c9-619f01c5a190 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:54.631526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fb45f414-da9b-4b0e-b7c9-619f01c5a190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:54.727691 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 676/1345] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:00:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:55.009795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91151b1e-55ae-4cc6-b843-b964ad9987df None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:55.011516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-91151b1e-55ae-4cc6-b843-b964ad9987df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:55.099876 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:55.130754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91151b1e-55ae-4cc6-b843-b964ad9987df None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:00:55.191959 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b226d18-306d-409d-a616-93fc2813d810 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:00:55.192575 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b226d18-306d-409d-a616-93fc2813d810 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:55.192855 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b226d18-306d-409d-a616-93fc2813d810 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:55.193125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b226d18-306d-409d-a616-93fc2813d810 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:55.194737 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1b226d18-306d-409d-a616-93fc2813d810 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:55.316365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b226d18-306d-409d-a616-93fc2813d810 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:00:55.317809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b226d18-306d-409d-a616-93fc2813d810 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:00:55.337670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 670/1346] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:00:59.395384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d80040-b86d-4e8a-9765-afc4b5d83ef9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:59.395953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d80040-b86d-4e8a-9765-afc4b5d83ef9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:59.395953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d80040-b86d-4e8a-9765-afc4b5d83ef9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:59.397852 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 677/1347] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:00:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:00:59.403579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f9c6d-37e7-4e14-add4-fe2a1c16e045 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:00:59.404102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f9c6d-37e7-4e14-add4-fe2a1c16e045 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:00:59.404195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f9c6d-37e7-4e14-add4-fe2a1c16e045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:00:59.420704 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:59.476675 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0f4f9c6d-37e7-4e14-add4-fe2a1c16e045 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:00:59.477907 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0f4f9c6d-37e7-4e14-add4-fe2a1c16e045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:59.580514 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 671/1348] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:00:59.862572 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d80040-b86d-4e8a-9765-afc4b5d83ef9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:00:59.864119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d7d80040-b86d-4e8a-9765-afc4b5d83ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:00:59.920817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:00:59.966472 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d80040-b86d-4e8a-9765-afc4b5d83ef9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:00.039743 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76de6d38-9f44-43ab-9cfa-77e6a659a782 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:00.040370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de6d38-9f44-43ab-9cfa-77e6a659a782 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:00.040646 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de6d38-9f44-43ab-9cfa-77e6a659a782 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:00.040912 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76de6d38-9f44-43ab-9cfa-77e6a659a782 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:00.042493 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-76de6d38-9f44-43ab-9cfa-77e6a659a782 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:00.145721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:00.149210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de6d38-9f44-43ab-9cfa-77e6a659a782 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:00.150634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76de6d38-9f44-43ab-9cfa-77e6a659a782 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:00.168958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 678/1349] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:00:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:05.072589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8000ed-ab8e-42db-8737-0382036a3863 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:05.073142 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8000ed-ab8e-42db-8737-0382036a3863 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:05.073398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8000ed-ab8e-42db-8737-0382036a3863 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:05.075256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 672/1350] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 24 08:01:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:05.080569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eed5cb-ecdb-4cb2-a61a-055c752a22d5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:05.081799 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eed5cb-ecdb-4cb2-a61a-055c752a22d5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:05.082736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eed5cb-ecdb-4cb2-a61a-055c752a22d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:05.176872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a3eed5cb-ecdb-4cb2-a61a-055c752a22d5 None None] MFA Rules not processed for user `d213e29685f3402b804d4d8fbc88ba96`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:05.178196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a3eed5cb-ecdb-4cb2-a61a-055c752a22d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:05.350165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 679/1351] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 24 08:01:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:09.562161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40060d38-9aaa-4a9a-a743-5604d572935f None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:09.562711 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40060d38-9aaa-4a9a-a743-5604d572935f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:09.562916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40060d38-9aaa-4a9a-a743-5604d572935f None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:09.564503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 673/1352] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 24 08:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:09.569636 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d72a65-f64a-494e-bf9e-e59217de2b0b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:09.570083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d72a65-f64a-494e-bf9e-e59217de2b0b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:09.570167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d72a65-f64a-494e-bf9e-e59217de2b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:09.578721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=59 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:09.626841 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:09.649829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-45d72a65-f64a-494e-bf9e-e59217de2b0b None None] MFA Rules not processed for user `d213e29685f3402b804d4d8fbc88ba96`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:09.650966 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-45d72a65-f64a-494e-bf9e-e59217de2b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:09.763110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 680/1353] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 24 08:01:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:11.101283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a4d3c-0b5d-4acb-8c57-e622c2632614 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:11.101837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a4d3c-0b5d-4acb-8c57-e622c2632614 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:11.101837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04a4d3c-0b5d-4acb-8c57-e622c2632614 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:11.103383 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 674/1354] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 24 08:01:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:11.108167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3972b-3910-46b2-b437-10ce1f53ce79 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:11.108578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3972b-3910-46b2-b437-10ce1f53ce79 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:11.108736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3972b-3910-46b2-b437-10ce1f53ce79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:11.185769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-25f3972b-3910-46b2-b437-10ce1f53ce79 None None] MFA Rules not processed for user `d213e29685f3402b804d4d8fbc88ba96`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:11.187638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-25f3972b-3910-46b2-b437-10ce1f53ce79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:11.235055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:11.303690 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 681/1355] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 24 08:01:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:01:14.614231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc72167-2879-401d-9b7b-460eb5203b1b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:14.615108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc72167-2879-401d-9b7b-460eb5203b1b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:14.615514 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc72167-2879-401d-9b7b-460eb5203b1b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:14.617054 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 675/1356] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:01:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:14.622299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c52af-8fa5-43ba-b688-8da15f993b70 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:14.623086 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c52af-8fa5-43ba-b688-8da15f993b70 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:14.623361 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19c52af-8fa5-43ba-b688-8da15f993b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:14.704913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e19c52af-8fa5-43ba-b688-8da15f993b70 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:14.707253 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e19c52af-8fa5-43ba-b688-8da15f993b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:14.838407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 682/1357] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:15.137857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d75896-6334-425a-94ac-119932ae3374 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:15.138128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d75896-6334-425a-94ac-119932ae3374 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:15.138554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d75896-6334-425a-94ac-119932ae3374 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:15.141011 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 676/1358] 10.222.0.62 () {54 vars in 962 bytes} [Wed Aug 24 08:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:15.152150 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b7993-beb6-4e03-a89f-eb2e6f116a02 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:15.152829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b7993-beb6-4e03-a89f-eb2e6f116a02 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:15.153247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b7993-beb6-4e03-a89f-eb2e6f116a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:15.171974 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:15.234008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-275b7993-beb6-4e03-a89f-eb2e6f116a02 None None] MFA Rules not processed for user `9b99cff7a5f549adadee002f8ab1f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:15.235380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-275b7993-beb6-4e03-a89f-eb2e6f116a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:15.373687 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d75896-6334-425a-94ac-119932ae3374 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:15.376157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c2d75896-6334-425a-94ac-119932ae3374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:15.398032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 683/1359] 10.222.0.62 () {58 vars in 1059 bytes} [Wed Aug 24 08:01:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:15.537810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d75896-6334-425a-94ac-119932ae3374 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:15.620706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:15.663078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a20350-537e-40a5-97cb-b0754aa18a36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:15.663763 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a20350-537e-40a5-97cb-b0754aa18a36 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:15.664167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a20350-537e-40a5-97cb-b0754aa18a36 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:15.664538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a20350-537e-40a5-97cb-b0754aa18a36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:15.666231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e2a20350-537e-40a5-97cb-b0754aa18a36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:15.759993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a20350-537e-40a5-97cb-b0754aa18a36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:15.762184 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a20350-537e-40a5-97cb-b0754aa18a36 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:15.781800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 677/1360] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:17.949726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f6be2-7957-4f7a-bdfe-d63557130a39 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:17.950289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f6be2-7957-4f7a-bdfe-d63557130a39 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:17.950289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f6be2-7957-4f7a-bdfe-d63557130a39 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:17.951812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 684/1361] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:17.957440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd16d7-d5c6-4bf3-a62e-944ff9d3718c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:17.957900 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd16d7-d5c6-4bf3-a62e-944ff9d3718c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:17.957984 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd16d7-d5c6-4bf3-a62e-944ff9d3718c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:18.027594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fafd16d7-d5c6-4bf3-a62e-944ff9d3718c None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:18.028818 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fafd16d7-d5c6-4bf3-a62e-944ff9d3718c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:18.069776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:18.139266 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 678/1362] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:18.453427 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f6be2-7957-4f7a-bdfe-d63557130a39 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:18.454944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a90f6be2-7957-4f7a-bdfe-d63557130a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:18.532604 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:18.618721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f6be2-7957-4f7a-bdfe-d63557130a39 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:18.737919 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0831c51-806d-408d-b441-2db5194395ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:18.738653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831c51-806d-408d-b441-2db5194395ae service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:18.738809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831c51-806d-408d-b441-2db5194395ae service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:18.739275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831c51-806d-408d-b441-2db5194395ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:18.740941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a0831c51-806d-408d-b441-2db5194395ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:18.771790 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:18.850980 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0831c51-806d-408d-b441-2db5194395ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:18.852602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0831c51-806d-408d-b441-2db5194395ae service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:18.872688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 685/1363] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:21.251648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b89a5-94e6-4cb0-8f0a-74154826d069 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:21.252261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b89a5-94e6-4cb0-8f0a-74154826d069 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:21.252261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b89a5-94e6-4cb0-8f0a-74154826d069 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:21.253992 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 679/1364] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:01:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:21.259578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326837c-31bf-4319-bc3c-99df803142da None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:21.260481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326837c-31bf-4319-bc3c-99df803142da None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:21.261010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8326837c-31bf-4319-bc3c-99df803142da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:21.333519 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8326837c-31bf-4319-bc3c-99df803142da None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:21.335113 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8326837c-31bf-4319-bc3c-99df803142da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:21.437926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:21.440737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 686/1365] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:21.736964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2b10e-f73d-4c23-995b-ba7ed18243cd None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:21.737861 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2b10e-f73d-4c23-995b-ba7ed18243cd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:21.737861 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2b10e-f73d-4c23-995b-ba7ed18243cd None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:21.738808 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 680/1366] 10.222.0.62 () {54 vars in 962 bytes} [Wed Aug 24 08:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:21.744549 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170c5f4-6ee7-4c43-b6d4-25f085ab9704 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:21.745041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170c5f4-6ee7-4c43-b6d4-25f085ab9704 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:21.745382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e170c5f4-6ee7-4c43-b6d4-25f085ab9704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:21.833952 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e170c5f4-6ee7-4c43-b6d4-25f085ab9704 None None] MFA Rules not processed for user `9b99cff7a5f549adadee002f8ab1f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:21.835090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e170c5f4-6ee7-4c43-b6d4-25f085ab9704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:21.960138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 687/1367] 10.222.0.62 () {58 vars in 1059 bytes} [Wed Aug 24 08:01:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:21.969550 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2b10e-f73d-4c23-995b-ba7ed18243cd None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:21.971162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f6c2b10e-f73d-4c23-995b-ba7ed18243cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:22.130711 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2b10e-f73d-4c23-995b-ba7ed18243cd None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:22.151997 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:22.249108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b75e8-15ee-4d5e-b224-70320f559bf5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:22.249795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b75e8-15ee-4d5e-b224-70320f559bf5 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:22.250088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b75e8-15ee-4d5e-b224-70320f559bf5 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:22.250348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b75e8-15ee-4d5e-b224-70320f559bf5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:22.251968 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0f5b75e8-15ee-4d5e-b224-70320f559bf5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:22.350460 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b75e8-15ee-4d5e-b224-70320f559bf5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:22.352617 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b75e8-15ee-4d5e-b224-70320f559bf5 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:22.375543 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 681/1368] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:01:22.868133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5a51a-e195-4c5b-9377-90abb5668968 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:22.868693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5a51a-e195-4c5b-9377-90abb5668968 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:22.868693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5a51a-e195-4c5b-9377-90abb5668968 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:22.870296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 688/1369] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:22.876187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd12bd-bfaa-40ea-830e-025c2b8ce20b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:22.876702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd12bd-bfaa-40ea-830e-025c2b8ce20b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:22.876978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd12bd-bfaa-40ea-830e-025c2b8ce20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:22.909871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:22.948652 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a4cd12bd-bfaa-40ea-830e-025c2b8ce20b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:22.950230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a4cd12bd-bfaa-40ea-830e-025c2b8ce20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:23.068273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 682/1370] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:23.660249 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a23f06-204e-4a5f-858b-e2d21f03895c None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:23.660653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a23f06-204e-4a5f-858b-e2d21f03895c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:23.661024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a23f06-204e-4a5f-858b-e2d21f03895c None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:23.662612 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 689/1371] 10.222.0.62 () {54 vars in 964 bytes} [Wed Aug 24 08:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:23.667635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3127a-1017-4cd4-aef6-986e21577790 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:23.668153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3127a-1017-4cd4-aef6-986e21577790 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:23.668240 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3127a-1017-4cd4-aef6-986e21577790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:23.750737 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-faf3127a-1017-4cd4-aef6-986e21577790 None None] MFA Rules not processed for user `c33f1237eb614223a062bafb7a49eac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:23.751971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-faf3127a-1017-4cd4-aef6-986e21577790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:23.802277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:23.833230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 683/1372] 10.222.0.62 () {58 vars in 1061 bytes} [Wed Aug 24 08:01:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:23.840805 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a23f06-204e-4a5f-858b-e2d21f03895c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:23.842326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f0a23f06-204e-4a5f-858b-e2d21f03895c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:23.894557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:23.950839 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a23f06-204e-4a5f-858b-e2d21f03895c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:24.032325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fa20e-593e-4d5c-857c-6d3fa347cf1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:24.033204 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fa20e-593e-4d5c-857c-6d3fa347cf1e service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:24.033514 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fa20e-593e-4d5c-857c-6d3fa347cf1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:24.033915 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fa20e-593e-4d5c-857c-6d3fa347cf1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:24.035637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e97fa20e-593e-4d5c-857c-6d3fa347cf1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:24.141045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:24.158666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fa20e-593e-4d5c-857c-6d3fa347cf1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:24.160873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fa20e-593e-4d5c-857c-6d3fa347cf1e service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:24.187576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 690/1373] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:24.552050 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169174f2-4623-4c94-a8f3-7232509b2b4a None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:24.552346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169174f2-4623-4c94-a8f3-7232509b2b4a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:24.552622 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169174f2-4623-4c94-a8f3-7232509b2b4a None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:24.553975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 684/1374] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:24.559476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931eea8-7aa9-4328-a7a3-db35398bb5d4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:24.559770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931eea8-7aa9-4328-a7a3-db35398bb5d4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:24.560093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931eea8-7aa9-4328-a7a3-db35398bb5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:24.628414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8931eea8-7aa9-4328-a7a3-db35398bb5d4 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:24.629642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8931eea8-7aa9-4328-a7a3-db35398bb5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:24.724833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 691/1375] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:25.012258 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169174f2-4623-4c94-a8f3-7232509b2b4a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:25.013871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-169174f2-4623-4c94-a8f3-7232509b2b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:25.161199 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169174f2-4623-4c94-a8f3-7232509b2b4a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:25.212971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:25.274987 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c899bf4-0c0b-4c35-9a4a-400baadd5e5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:25.275597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899bf4-0c0b-4c35-9a4a-400baadd5e5d service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:25.275897 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899bf4-0c0b-4c35-9a4a-400baadd5e5d service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:25.276173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c899bf4-0c0b-4c35-9a4a-400baadd5e5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:25.277819 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9c899bf4-0c0b-4c35-9a4a-400baadd5e5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:25.369434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c899bf4-0c0b-4c35-9a4a-400baadd5e5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:25.371014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c899bf4-0c0b-4c35-9a4a-400baadd5e5d service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:25.393468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 685/1376] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:27.670595 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe5c54-70c0-4130-8009-f6fcd2214db8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:27.672005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe5c54-70c0-4130-8009-f6fcd2214db8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:27.672290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fe5c54-70c0-4130-8009-f6fcd2214db8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:27.673672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 692/1377] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:01:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:27.679005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc129e5e-648e-4671-a19c-db12cd3562a0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:27.679479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc129e5e-648e-4671-a19c-db12cd3562a0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:27.679591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc129e5e-648e-4671-a19c-db12cd3562a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:27.745506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cc129e5e-648e-4671-a19c-db12cd3562a0 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:27.746884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cc129e5e-648e-4671-a19c-db12cd3562a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:27.754996 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:27.847458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 686/1378] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:28.149901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe5c54-70c0-4130-8009-f6fcd2214db8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:28.151475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-49fe5c54-70c0-4130-8009-f6fcd2214db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:28.216638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:28.305856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fe5c54-70c0-4130-8009-f6fcd2214db8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:28.424814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae089f07-d194-4e7a-8491-8b92825ffa90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:28.425342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae089f07-d194-4e7a-8491-8b92825ffa90 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:28.425618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae089f07-d194-4e7a-8491-8b92825ffa90 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:28.425886 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae089f07-d194-4e7a-8491-8b92825ffa90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:28.427465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ae089f07-d194-4e7a-8491-8b92825ffa90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:28.447528 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:28.523637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae089f07-d194-4e7a-8491-8b92825ffa90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:28.525255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae089f07-d194-4e7a-8491-8b92825ffa90 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:28.544747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 693/1379] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:30.614196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d6e5b-0064-41a8-9da3-f67a9ca5f36d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:30.614780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d6e5b-0064-41a8-9da3-f67a9ca5f36d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:30.614780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d6e5b-0064-41a8-9da3-f67a9ca5f36d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:30.616100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 687/1380] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:30.621516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d78c53-f23e-41ee-8071-96f0cdb7cace None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:30.621937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d78c53-f23e-41ee-8071-96f0cdb7cace None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:30.622162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d78c53-f23e-41ee-8071-96f0cdb7cace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:30.694075 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-35d78c53-f23e-41ee-8071-96f0cdb7cace None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:30.695475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-35d78c53-f23e-41ee-8071-96f0cdb7cace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:30.801460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:30.809446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 694/1381] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:31.106021 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d6e5b-0064-41a8-9da3-f67a9ca5f36d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:31.107551 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-595d6e5b-0064-41a8-9da3-f67a9ca5f36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:31.251601 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:31.262395 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d6e5b-0064-41a8-9da3-f67a9ca5f36d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:31.384238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7e815-cce0-4e77-974e-c5a373b318c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:31.384779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7e815-cce0-4e77-974e-c5a373b318c0 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:31.385067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7e815-cce0-4e77-974e-c5a373b318c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:31.385493 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7e815-cce0-4e77-974e-c5a373b318c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:31.387929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-69b7e815-cce0-4e77-974e-c5a373b318c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:31.484590 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7e815-cce0-4e77-974e-c5a373b318c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:31.485752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7e815-cce0-4e77-974e-c5a373b318c0 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:31.497260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:31.506936 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 688/1382] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:33.679630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3e42b-640f-41ea-b6b3-b234f0f9df1f None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:33.680320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3e42b-640f-41ea-b6b3-b234f0f9df1f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:33.680320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3e42b-640f-41ea-b6b3-b234f0f9df1f None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:33.681438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 695/1383] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:01:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:33.687829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cdf8b-bfbe-4141-848e-90afc52342cf None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:33.688325 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cdf8b-bfbe-4141-848e-90afc52342cf None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:33.688626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2cdf8b-bfbe-4141-848e-90afc52342cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:33.775959 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ef2cdf8b-bfbe-4141-848e-90afc52342cf None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:33.777576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ef2cdf8b-bfbe-4141-848e-90afc52342cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:33.884777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 689/1384] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:34.258261 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3e42b-640f-41ea-b6b3-b234f0f9df1f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:34.259941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8ef3e42b-640f-41ea-b6b3-b234f0f9df1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:34.415720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3e42b-640f-41ea-b6b3-b234f0f9df1f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:34.485349 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:34.534345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa46be-ca5a-4ec9-a4dc-a6c596102cfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:34.534960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa46be-ca5a-4ec9-a4dc-a6c596102cfa service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:34.535239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa46be-ca5a-4ec9-a4dc-a6c596102cfa service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:34.535508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa46be-ca5a-4ec9-a4dc-a6c596102cfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:34.537149 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1afa46be-ca5a-4ec9-a4dc-a6c596102cfa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:34.629783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa46be-ca5a-4ec9-a4dc-a6c596102cfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:34.631363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afa46be-ca5a-4ec9-a4dc-a6c596102cfa service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:34.654492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 696/1385] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:37.120670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471ee01-816e-4c09-bb0f-9f5ed9e3993e None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:37.121343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471ee01-816e-4c09-bb0f-9f5ed9e3993e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:37.121446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471ee01-816e-4c09-bb0f-9f5ed9e3993e None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:37.123148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 690/1386] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:01:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:37.130901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96936d7e-556b-484b-9bc6-2e93fe366e1b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:37.131377 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96936d7e-556b-484b-9bc6-2e93fe366e1b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:37.131618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96936d7e-556b-484b-9bc6-2e93fe366e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:37.216585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-96936d7e-556b-484b-9bc6-2e93fe366e1b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:37.219101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-96936d7e-556b-484b-9bc6-2e93fe366e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:37.258077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:37.332871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 697/1387] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:37.623066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471ee01-816e-4c09-bb0f-9f5ed9e3993e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:37.625569 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c471ee01-816e-4c09-bb0f-9f5ed9e3993e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:37.705144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:37.778065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471ee01-816e-4c09-bb0f-9f5ed9e3993e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:37.895750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3df5044-72f4-416f-971c-85b80b0013d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:37.896385 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df5044-72f4-416f-971c-85b80b0013d4 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:37.896663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df5044-72f4-416f-971c-85b80b0013d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:37.896929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df5044-72f4-416f-971c-85b80b0013d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:37.898510 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f3df5044-72f4-416f-971c-85b80b0013d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:37.937221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:37.990706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df5044-72f4-416f-971c-85b80b0013d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:37.992393 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3df5044-72f4-416f-971c-85b80b0013d4 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:38.011413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 691/1388] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:39.562874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4326f-cec9-4bdc-a534-9b1809f7c620 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:39.563443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4326f-cec9-4bdc-a534-9b1809f7c620 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:39.563443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df4326f-cec9-4bdc-a534-9b1809f7c620 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:39.564825 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 698/1389] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:01:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:39.570090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0018-34da-4045-a0ff-892affb9174a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:39.570532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0018-34da-4045-a0ff-892affb9174a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:39.570649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf0018-34da-4045-a0ff-892affb9174a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:39.637757 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-bdcf0018-34da-4045-a0ff-892affb9174a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:39.638971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bdcf0018-34da-4045-a0ff-892affb9174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:39.735758 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 692/1390] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:01:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:40.039383 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3104aa-0997-4f3f-aebe-7e64f22eee1b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:40.039671 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3104aa-0997-4f3f-aebe-7e64f22eee1b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:40.039977 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3104aa-0997-4f3f-aebe-7e64f22eee1b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:40.041322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 699/1391] 10.222.0.62 () {54 vars in 967 bytes} [Wed Aug 24 08:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:40.047163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b20d5-d1b5-4ee7-b6a6-6e1d0c78408e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:40.047446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b20d5-d1b5-4ee7-b6a6-6e1d0c78408e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:40.047717 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39b20d5-d1b5-4ee7-b6a6-6e1d0c78408e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:40.064151 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:40.069632 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396e202-a35e-4f01-b3b3-b46cc41d8bf0 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:40.069918 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396e202-a35e-4f01-b3b3-b46cc41d8bf0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:40.070191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396e202-a35e-4f01-b3b3-b46cc41d8bf0 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:40.071526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 700/1392] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:40.077135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf1dfb-915e-4fcf-ae6c-104eeaa8dfea None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:40.087813 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf1dfb-915e-4fcf-ae6c-104eeaa8dfea None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:40.087813 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf1dfb-915e-4fcf-ae6c-104eeaa8dfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:40.127527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c39b20d5-d1b5-4ee7-b6a6-6e1d0c78408e None None] MFA Rules not processed for user `6c83e30a9fd04385b44ee3a3b72e5099`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:40.128776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c39b20d5-d1b5-4ee7-b6a6-6e1d0c78408e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:40.142797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-71bf1dfb-915e-4fcf-ae6c-104eeaa8dfea None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:40.144011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-71bf1dfb-915e-4fcf-ae6c-104eeaa8dfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:40.207978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 693/1393] 10.222.0.62 () {58 vars in 1064 bytes} [Wed Aug 24 08:01:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:40.215618 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b20d5-d1b5-4ee7-b6a6-6e1d0c78408e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:40.223559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39b20d5-d1b5-4ee7-b6a6-6e1d0c78408e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:40.242851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 701/1394] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:01:40.297530 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501536d-66e1-4889-9bc1-5e8081a2a773 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c83e30a9fd04385b44ee3a3b72e5099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:40.298135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501536d-66e1-4889-9bc1-5e8081a2a773 service glance] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:40.298411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501536d-66e1-4889-9bc1-5e8081a2a773 service glance] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:40.298678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501536d-66e1-4889-9bc1-5e8081a2a773 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:40.300276 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0501536d-66e1-4889-9bc1-5e8081a2a773 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:40.330591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:40.414423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501536d-66e1-4889-9bc1-5e8081a2a773 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:40.415858 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501536d-66e1-4889-9bc1-5e8081a2a773 service glance] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:40.435290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 694/1395] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:01:40.535671 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf1dfb-915e-4fcf-ae6c-104eeaa8dfea None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:40.537011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-71bf1dfb-915e-4fcf-ae6c-104eeaa8dfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:40.551869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:40.656178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf1dfb-915e-4fcf-ae6c-104eeaa8dfea None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:40.777840 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04995840-8f47-4546-bf50-229dc47ddbbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:40.778478 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04995840-8f47-4546-bf50-229dc47ddbbd service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:40.778759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04995840-8f47-4546-bf50-229dc47ddbbd service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:40.779031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04995840-8f47-4546-bf50-229dc47ddbbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:40.780785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-04995840-8f47-4546-bf50-229dc47ddbbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:40.789285 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:40.871934 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04995840-8f47-4546-bf50-229dc47ddbbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:40.873595 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04995840-8f47-4546-bf50-229dc47ddbbd service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:40.902947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 702/1396] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:41.344063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc6309-6317-4b88-8424-ed0b01a780ca None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:41.344549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc6309-6317-4b88-8424-ed0b01a780ca None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:41.344642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc6309-6317-4b88-8424-ed0b01a780ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:41.416225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5bdc6309-6317-4b88-8424-ed0b01a780ca None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:41.417420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5bdc6309-6317-4b88-8424-ed0b01a780ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:41.505998 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:41.511649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 695/1397] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:01:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:41.555522 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2f623-5779-4e0e-ae82-cb8044bb38af None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:41.555814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2f623-5779-4e0e-ae82-cb8044bb38af None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:41.556150 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a2f623-5779-4e0e-ae82-cb8044bb38af None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:41.557523 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 703/1398] 10.222.0.62 () {54 vars in 943 bytes} [Wed Aug 24 08:01:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:41.564981 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237eeb1-d27a-46fe-8096-7719e7cd202c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:41.565331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237eeb1-d27a-46fe-8096-7719e7cd202c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:41.565694 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237eeb1-d27a-46fe-8096-7719e7cd202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:41.640934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e237eeb1-d27a-46fe-8096-7719e7cd202c None None] MFA Rules not processed for user `8255043f01fd46e4a8a5fde8e81c2bed`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:41.642045 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e237eeb1-d27a-46fe-8096-7719e7cd202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:41.748123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 696/1399] 10.222.0.62 () {58 vars in 1040 bytes} [Wed Aug 24 08:01:41 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:41.758191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2f623-5779-4e0e-ae82-cb8044bb38af None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:41.759748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-59a2f623-5779-4e0e-ae82-cb8044bb38af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:41.898204 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:41.899743 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a2f623-5779-4e0e-ae82-cb8044bb38af None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:42.003200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c13ded5-5d4f-4d6d-8e06-a5225a9b5687 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:42.003801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13ded5-5d4f-4d6d-8e06-a5225a9b5687 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:42.004102 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13ded5-5d4f-4d6d-8e06-a5225a9b5687 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:42.004366 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c13ded5-5d4f-4d6d-8e06-a5225a9b5687 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:42.005978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0c13ded5-5d4f-4d6d-8e06-a5225a9b5687 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:42.088203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13ded5-5d4f-4d6d-8e06-a5225a9b5687 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:42.089784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c13ded5-5d4f-4d6d-8e06-a5225a9b5687 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:42.098289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 704/1400] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:01:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:01:43.038676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99821a5c-530d-4af0-bbc1-fbfd5edc419b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:43.039226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99821a5c-530d-4af0-bbc1-fbfd5edc419b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:43.039226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99821a5c-530d-4af0-bbc1-fbfd5edc419b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:43.040740 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 697/1401] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:43.046672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797d138-6582-4dc7-847e-73082211f57d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:43.047140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797d138-6582-4dc7-847e-73082211f57d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:43.047243 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797d138-6582-4dc7-847e-73082211f57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:43.091984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:43.124866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d797d138-6582-4dc7-847e-73082211f57d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:43.126202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d797d138-6582-4dc7-847e-73082211f57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:43.233181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 705/1402] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:43.527961 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99821a5c-530d-4af0-bbc1-fbfd5edc419b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:43.529499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-99821a5c-530d-4af0-bbc1-fbfd5edc419b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:43.594603 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:43.697477 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99821a5c-530d-4af0-bbc1-fbfd5edc419b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:43.958695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b26db7-a7cc-4979-8ac8-e113462b7566 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:43.959212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b26db7-a7cc-4979-8ac8-e113462b7566 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:43.959486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b26db7-a7cc-4979-8ac8-e113462b7566 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:43.959751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b26db7-a7cc-4979-8ac8-e113462b7566 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:43.961542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-03b26db7-a7cc-4979-8ac8-e113462b7566 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:43.983526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:44.086906 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b26db7-a7cc-4979-8ac8-e113462b7566 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:44.089721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b26db7-a7cc-4979-8ac8-e113462b7566 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:44.124322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 698/1403] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:46.253381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a072b8e-3e60-4ea5-8897-6a51ab9686d1 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:46.253987 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a072b8e-3e60-4ea5-8897-6a51ab9686d1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:46.253987 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a072b8e-3e60-4ea5-8897-6a51ab9686d1 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:46.259009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 706/1404] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:01:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:46.260567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27df4eb-ee65-491c-96b2-f358377c4b52 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:46.260993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27df4eb-ee65-491c-96b2-f358377c4b52 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:46.261093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27df4eb-ee65-491c-96b2-f358377c4b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:46.332109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a27df4eb-ee65-491c-96b2-f358377c4b52 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:46.333699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a27df4eb-ee65-491c-96b2-f358377c4b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:46.440925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:46.448670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 699/1405] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:01:46.738061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a072b8e-3e60-4ea5-8897-6a51ab9686d1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:46.739599 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9a072b8e-3e60-4ea5-8897-6a51ab9686d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:46.866767 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:46.914316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a072b8e-3e60-4ea5-8897-6a51ab9686d1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:47.043496 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca637ac4-8a3a-46eb-a8fe-cd9cb1bc28d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:47.044308 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca637ac4-8a3a-46eb-a8fe-cd9cb1bc28d1 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:47.044653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca637ac4-8a3a-46eb-a8fe-cd9cb1bc28d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:47.044994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca637ac4-8a3a-46eb-a8fe-cd9cb1bc28d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:47.047300 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ca637ac4-8a3a-46eb-a8fe-cd9cb1bc28d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:47.125627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:47.143229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca637ac4-8a3a-46eb-a8fe-cd9cb1bc28d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:47.144848 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca637ac4-8a3a-46eb-a8fe-cd9cb1bc28d1 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:47.169220 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 707/1406] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:49.300239 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1df8e-27a4-4870-9840-21d20b0a9f3b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:49.300802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1df8e-27a4-4870-9840-21d20b0a9f3b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:49.300802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d1df8e-27a4-4870-9840-21d20b0a9f3b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:49.302392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 700/1407] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:01:49.307687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03495be-5867-49a9-b65d-7bc2b7203b5a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:49.308163 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03495be-5867-49a9-b65d-7bc2b7203b5a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:49.308256 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03495be-5867-49a9-b65d-7bc2b7203b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:49.383540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a03495be-5867-49a9-b65d-7bc2b7203b5a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:01:49.385039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a03495be-5867-49a9-b65d-7bc2b7203b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:49.494751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 708/1408] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:01:49.793672 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1df8e-27a4-4870-9840-21d20b0a9f3b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:01:49.795937 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-85d1df8e-27a4-4870-9840-21d20b0a9f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:49.978309 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d1df8e-27a4-4870-9840-21d20b0a9f3b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:01:50.080922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:01:50.162026 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b5c258-986b-45ff-8eba-41f8769e3a97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:01:50.162692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5c258-986b-45ff-8eba-41f8769e3a97 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:01:50.162972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5c258-986b-45ff-8eba-41f8769e3a97 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:01:50.163358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b5c258-986b-45ff-8eba-41f8769e3a97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:01:50.165092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-95b5c258-986b-45ff-8eba-41f8769e3a97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:01:50.282803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5c258-986b-45ff-8eba-41f8769e3a97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:01:50.284449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b5c258-986b-45ff-8eba-41f8769e3a97 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:01:50.303504 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 701/1409] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:01:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:01:59.492854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=78 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:00.301077 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=65 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:05.596858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afec2d-4bf9-40fc-92a4-3c7f45943a58 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:05.597405 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afec2d-4bf9-40fc-92a4-3c7f45943a58 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:05.597405 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afec2d-4bf9-40fc-92a4-3c7f45943a58 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:05.598753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 709/1410] 10.222.0.62 () {54 vars in 918 bytes} [Wed Aug 24 08:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:05.604002 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d40ed-9129-4fa6-adf8-67abce4ee5db None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:05.604443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d40ed-9129-4fa6-adf8-67abce4ee5db None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:05.604581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d40ed-9129-4fa6-adf8-67abce4ee5db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:05.679697 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b53d40ed-9129-4fa6-adf8-67abce4ee5db None None] MFA Rules not processed for user `d213e29685f3402b804d4d8fbc88ba96`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:05.680855 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b53d40ed-9129-4fa6-adf8-67abce4ee5db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:05.786945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 702/1411] 10.222.0.62 () {58 vars in 1015 bytes} [Wed Aug 24 08:02:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:05.801500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45110209-4611-41cc-bcef-02e01e35a5cd None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:05.801788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45110209-4611-41cc-bcef-02e01e35a5cd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:05.802062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45110209-4611-41cc-bcef-02e01e35a5cd None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:05.803390 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 710/1412] 10.222.0.62 () {54 vars in 918 bytes} [Wed Aug 24 08:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:05.807995 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d5124-73e0-471f-b726-5232de054eab None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:05.808283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d5124-73e0-471f-b726-5232de054eab None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:05.808557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d5124-73e0-471f-b726-5232de054eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:05.880547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:05.883083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-621d5124-73e0-471f-b726-5232de054eab None None] MFA Rules not processed for user `9b99cff7a5f549adadee002f8ab1f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:05.884337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-621d5124-73e0-471f-b726-5232de054eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:06.000047 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 703/1413] 10.222.0.62 () {58 vars in 1015 bytes} [Wed Aug 24 08:02:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:08.384777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03505b75-9912-4694-aeca-a8a74807187b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:08.385225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03505b75-9912-4694-aeca-a8a74807187b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:08.385352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03505b75-9912-4694-aeca-a8a74807187b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:08.386747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 711/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:08.392937 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc537-9ed7-47f0-8985-6bd4817ba015 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:08.393410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc537-9ed7-47f0-8985-6bd4817ba015 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:08.393516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575dc537-9ed7-47f0-8985-6bd4817ba015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:08.458158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-575dc537-9ed7-47f0-8985-6bd4817ba015 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:08.459362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-575dc537-9ed7-47f0-8985-6bd4817ba015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:08.514125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:08.556255 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 704/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:08.845501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03505b75-9912-4694-aeca-a8a74807187b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:08.846923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-03505b75-9912-4694-aeca-a8a74807187b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:08.992084 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03505b75-9912-4694-aeca-a8a74807187b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:09.063315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:09.103226 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9099c44-916a-4186-9881-36d7be96b092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:09.103763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9099c44-916a-4186-9881-36d7be96b092 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:09.104072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9099c44-916a-4186-9881-36d7be96b092 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:09.104347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9099c44-916a-4186-9881-36d7be96b092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:09.105940 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a9099c44-916a-4186-9881-36d7be96b092 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:09.193187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9099c44-916a-4186-9881-36d7be96b092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:09.194766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9099c44-916a-4186-9881-36d7be96b092 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:09.212651 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 712/1416] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:10.111030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d656-dca9-45c9-bf45-54055da04e77 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:10.111604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d656-dca9-45c9-bf45-54055da04e77 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:10.111604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2527d656-dca9-45c9-bf45-54055da04e77 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:10.112936 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 705/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:02:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:10.117792 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7db278-7721-4096-90d0-9fee358a7a1a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:10.118241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7db278-7721-4096-90d0-9fee358a7a1a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:10.118347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7db278-7721-4096-90d0-9fee358a7a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:10.193471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9c7db278-7721-4096-90d0-9fee358a7a1a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:10.194688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9c7db278-7721-4096-90d0-9fee358a7a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:10.221180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:10.290610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 713/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:10.442362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527d656-dca9-45c9-bf45-54055da04e77 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:10.443911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2527d656-dca9-45c9-bf45-54055da04e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:10.587605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2527d656-dca9-45c9-bf45-54055da04e77 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:10.628471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:10.700116 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18940cd-3076-4491-8740-4153e00691d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:10.700664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18940cd-3076-4491-8740-4153e00691d7 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:10.700957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18940cd-3076-4491-8740-4153e00691d7 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:10.701222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18940cd-3076-4491-8740-4153e00691d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:10.702787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f18940cd-3076-4491-8740-4153e00691d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:10.791525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18940cd-3076-4491-8740-4153e00691d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:10.793146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18940cd-3076-4491-8740-4153e00691d7 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:10.811961 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 706/1419] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:11.695012 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7689af0-648b-4d83-9584-3331f863fcd8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:11.695557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7689af0-648b-4d83-9584-3331f863fcd8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:11.695557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7689af0-648b-4d83-9584-3331f863fcd8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:11.696843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 714/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:11.702232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe77879-ab34-45aa-b1fb-6f1b6963df60 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:11.702646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe77879-ab34-45aa-b1fb-6f1b6963df60 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:11.702766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe77879-ab34-45aa-b1fb-6f1b6963df60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:11.756041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:11.777256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-bfe77879-ab34-45aa-b1fb-6f1b6963df60 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:11.778458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bfe77879-ab34-45aa-b1fb-6f1b6963df60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:11.880450 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 707/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:12.031613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7689af0-648b-4d83-9584-3331f863fcd8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:12.033168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e7689af0-648b-4d83-9584-3331f863fcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:12.178554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7689af0-648b-4d83-9584-3331f863fcd8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:12.191286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:12.291820 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee711b-7c05-4274-a986-8889688566ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:12.292385 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee711b-7c05-4274-a986-8889688566ba service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:12.292665 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee711b-7c05-4274-a986-8889688566ba service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:12.292938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee711b-7c05-4274-a986-8889688566ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:12.295077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ecee711b-7c05-4274-a986-8889688566ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:12.383799 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee711b-7c05-4274-a986-8889688566ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:12.385442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee711b-7c05-4274-a986-8889688566ba service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:12.403317 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 715/1422] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:13.284233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e890ed-b6c3-48da-a575-3a988aa935ac None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:13.284803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e890ed-b6c3-48da-a575-3a988aa935ac None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:13.284803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e890ed-b6c3-48da-a575-3a988aa935ac None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:13.286105 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 708/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:02:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:13.291123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66e74-c05b-4ed3-a999-4b64f8a0d375 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:13.291555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66e74-c05b-4ed3-a999-4b64f8a0d375 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:13.291669 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af66e74-c05b-4ed3-a999-4b64f8a0d375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:13.312260 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:13.368029 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4af66e74-c05b-4ed3-a999-4b64f8a0d375 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:13.369233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4af66e74-c05b-4ed3-a999-4b64f8a0d375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:13.464832 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 716/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:13.616510 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e890ed-b6c3-48da-a575-3a988aa935ac None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:13.617937 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-10e890ed-b6c3-48da-a575-3a988aa935ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:13.726622 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:13.764403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e890ed-b6c3-48da-a575-3a988aa935ac None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:13.881590 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ac9c68-0d57-4465-88eb-58ac5ae25eeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:13.882118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9c68-0d57-4465-88eb-58ac5ae25eeb service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:13.882392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9c68-0d57-4465-88eb-58ac5ae25eeb service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:13.882659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ac9c68-0d57-4465-88eb-58ac5ae25eeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:13.884292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b2ac9c68-0d57-4465-88eb-58ac5ae25eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:13.960663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:13.974542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac9c68-0d57-4465-88eb-58ac5ae25eeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:13.976184 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ac9c68-0d57-4465-88eb-58ac5ae25eeb service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:13.994771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 709/1425] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:14.848658 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19836ac9-f235-4bff-aced-6abb9a27c4db None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:14.849202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19836ac9-f235-4bff-aced-6abb9a27c4db None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:14.849202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19836ac9-f235-4bff-aced-6abb9a27c4db None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:14.850628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 717/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:14.855778 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af90164-e26d-4511-99ee-c55d156940bb None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:14.856209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af90164-e26d-4511-99ee-c55d156940bb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:14.856370 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af90164-e26d-4511-99ee-c55d156940bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:14.932327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1af90164-e26d-4511-99ee-c55d156940bb None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:14.933535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1af90164-e26d-4511-99ee-c55d156940bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:15.031330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 710/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:15.182092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19836ac9-f235-4bff-aced-6abb9a27c4db None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:15.183580 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-19836ac9-f235-4bff-aced-6abb9a27c4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:15.266581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:15.328480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19836ac9-f235-4bff-aced-6abb9a27c4db None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:15.440797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b2027-d67e-4400-a161-3ae0a1ec274f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:15.441326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2027-d67e-4400-a161-3ae0a1ec274f service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:15.441605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2027-d67e-4400-a161-3ae0a1ec274f service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:15.441877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b2027-d67e-4400-a161-3ae0a1ec274f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:15.443474 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f41b2027-d67e-4400-a161-3ae0a1ec274f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:15.491348 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:15.532470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b2027-d67e-4400-a161-3ae0a1ec274f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:15.534042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b2027-d67e-4400-a161-3ae0a1ec274f service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:15.551533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 718/1428] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:16.393920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee2009-3252-40c1-82db-e9dd64849a69 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:16.394453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee2009-3252-40c1-82db-e9dd64849a69 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:16.394453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ee2009-3252-40c1-82db-e9dd64849a69 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:16.405019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 711/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:16.405204 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4ed8e-87a5-493d-baeb-a6c19f344522 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:16.405204 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4ed8e-87a5-493d-baeb-a6c19f344522 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:16.405204 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f4ed8e-87a5-493d-baeb-a6c19f344522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:16.478540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-18f4ed8e-87a5-493d-baeb-a6c19f344522 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:16.479750 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-18f4ed8e-87a5-493d-baeb-a6c19f344522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:16.576147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 719/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:16.727601 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee2009-3252-40c1-82db-e9dd64849a69 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:16.733527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-57ee2009-3252-40c1-82db-e9dd64849a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:16.777493 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:16.875129 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ee2009-3252-40c1-82db-e9dd64849a69 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:16.988659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438565cf-b85b-48f2-acf1-ad0acc397c12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:16.989183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438565cf-b85b-48f2-acf1-ad0acc397c12 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:16.989458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438565cf-b85b-48f2-acf1-ad0acc397c12 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:16.989724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438565cf-b85b-48f2-acf1-ad0acc397c12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:16.991308 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-438565cf-b85b-48f2-acf1-ad0acc397c12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:16.998710 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:17.080459 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438565cf-b85b-48f2-acf1-ad0acc397c12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:17.082049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438565cf-b85b-48f2-acf1-ad0acc397c12 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:17.100108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 712/1431] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:17.953884 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b42da3-fd57-4121-b846-70bf37f97b9b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:17.954769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b42da3-fd57-4121-b846-70bf37f97b9b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:17.954769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b42da3-fd57-4121-b846-70bf37f97b9b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:17.956086 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 720/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:17.961046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d456fe-bc1e-4ec0-8e0c-0cc240239228 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:17.961460 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d456fe-bc1e-4ec0-8e0c-0cc240239228 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:17.961677 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d456fe-bc1e-4ec0-8e0c-0cc240239228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:18.035213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-16d456fe-bc1e-4ec0-8e0c-0cc240239228 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:18.036452 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-16d456fe-bc1e-4ec0-8e0c-0cc240239228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:18.103137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:18.131990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 713/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:02:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:18.283349 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b42da3-fd57-4121-b846-70bf37f97b9b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:18.284897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-87b42da3-fd57-4121-b846-70bf37f97b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:18.302498 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:18.430459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b42da3-fd57-4121-b846-70bf37f97b9b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:18.517082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:18.542674 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e1002d-27a1-4443-a68d-341a664bb182 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:18.543207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1002d-27a1-4443-a68d-341a664bb182 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:18.543522 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1002d-27a1-4443-a68d-341a664bb182 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:18.543791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e1002d-27a1-4443-a68d-341a664bb182 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:18.546030 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-20e1002d-27a1-4443-a68d-341a664bb182 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:18.633535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1002d-27a1-4443-a68d-341a664bb182 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:18.635093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e1002d-27a1-4443-a68d-341a664bb182 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:18.653068 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 721/1434] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:19.494526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efa0e1-b677-4e41-8f5f-9f08707906e9 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:19.495064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efa0e1-b677-4e41-8f5f-9f08707906e9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:19.495247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4efa0e1-b677-4e41-8f5f-9f08707906e9 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:19.496664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 714/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:19.502285 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a219f8-b7c0-4054-9a1b-9136248d9e84 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:19.502739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a219f8-b7c0-4054-9a1b-9136248d9e84 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:19.502851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a219f8-b7c0-4054-9a1b-9136248d9e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:19.577826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-08a219f8-b7c0-4054-9a1b-9136248d9e84 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:19.579060 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-08a219f8-b7c0-4054-9a1b-9136248d9e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:19.619866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:19.674479 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 722/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:02:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:19.824667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efa0e1-b677-4e41-8f5f-9f08707906e9 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:19.826228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e4efa0e1-b677-4e41-8f5f-9f08707906e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:19.970236 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4efa0e1-b677-4e41-8f5f-9f08707906e9 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:20.023049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:20.083305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f662ac-f17b-4683-889b-a00c64fbaf78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:20.084063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f662ac-f17b-4683-889b-a00c64fbaf78 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:20.084348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f662ac-f17b-4683-889b-a00c64fbaf78 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:20.084616 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f662ac-f17b-4683-889b-a00c64fbaf78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:20.086194 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-85f662ac-f17b-4683-889b-a00c64fbaf78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:20.173420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f662ac-f17b-4683-889b-a00c64fbaf78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:20.174990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f662ac-f17b-4683-889b-a00c64fbaf78 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:20.192978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 715/1437] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:21.063329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a9624-c3c2-44e5-8e8e-debbe05b4857 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:21.063944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a9624-c3c2-44e5-8e8e-debbe05b4857 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:21.063944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a9624-c3c2-44e5-8e8e-debbe05b4857 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:21.065330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 723/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:21.070213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1056c-d2d4-4b94-8751-8ab2e0eb3832 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:21.070624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1056c-d2d4-4b94-8751-8ab2e0eb3832 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:21.070756 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1056c-d2d4-4b94-8751-8ab2e0eb3832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:21.146025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d6c1056c-d2d4-4b94-8751-8ab2e0eb3832 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:21.147221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d6c1056c-d2d4-4b94-8751-8ab2e0eb3832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:21.149225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:21.244696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 716/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:21.395202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a9624-c3c2-44e5-8e8e-debbe05b4857 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:21.396815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bb2a9624-c3c2-44e5-8e8e-debbe05b4857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:21.543483 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a9624-c3c2-44e5-8e8e-debbe05b4857 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:21.568777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:21.653050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bbad66-0e24-4672-ae12-9f131702179d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:21.654304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbad66-0e24-4672-ae12-9f131702179d service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:21.654581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbad66-0e24-4672-ae12-9f131702179d service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:21.654848 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bbad66-0e24-4672-ae12-9f131702179d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:21.656495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-68bbad66-0e24-4672-ae12-9f131702179d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:21.748717 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbad66-0e24-4672-ae12-9f131702179d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:21.750289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bbad66-0e24-4672-ae12-9f131702179d service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:21.768545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 724/1440] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:23.579935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11692f-561e-4769-a869-5fb814437e42 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:23.580517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11692f-561e-4769-a869-5fb814437e42 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:23.580517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af11692f-561e-4769-a869-5fb814437e42 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:23.581884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 717/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 08:02:23.587432 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd4f46-2eb0-4555-895c-675c5201bc96 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:23.587860 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd4f46-2eb0-4555-895c-675c5201bc96 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:23.588045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd4f46-2eb0-4555-895c-675c5201bc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:23.629485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:23.653091 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d9dd4f46-2eb0-4555-895c-675c5201bc96 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:23.654389 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d9dd4f46-2eb0-4555-895c-675c5201bc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:23.751233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 725/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:02:24.038560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11692f-561e-4769-a869-5fb814437e42 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:24.040391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-af11692f-561e-4769-a869-5fb814437e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:24.145831 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af11692f-561e-4769-a869-5fb814437e42 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:24.178015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:24.218458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d2cd5-d713-488b-94d6-2fdf6013339f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:24.219287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d2cd5-d713-488b-94d6-2fdf6013339f service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:24.219720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d2cd5-d713-488b-94d6-2fdf6013339f service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:24.220343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d2cd5-d713-488b-94d6-2fdf6013339f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:24.221957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7b0d2cd5-d713-488b-94d6-2fdf6013339f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:24.330004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d2cd5-d713-488b-94d6-2fdf6013339f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:24.331331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d2cd5-d713-488b-94d6-2fdf6013339f service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:24.349799 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 718/1443] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:26.397085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56721e8-c7fb-4dad-9fd1-8fbecccb545a None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:26.397597 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56721e8-c7fb-4dad-9fd1-8fbecccb545a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:26.397709 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56721e8-c7fb-4dad-9fd1-8fbecccb545a None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:26.399002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 726/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:02:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:26.404802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52c23-442b-41d3-86df-47193d2685de None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:26.405250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52c23-442b-41d3-86df-47193d2685de None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:26.405351 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca52c23-442b-41d3-86df-47193d2685de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:26.470180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7ca52c23-442b-41d3-86df-47193d2685de None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:26.471384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7ca52c23-442b-41d3-86df-47193d2685de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:26.485109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:26.572300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 719/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:26.884285 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56721e8-c7fb-4dad-9fd1-8fbecccb545a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:26.885876 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b56721e8-c7fb-4dad-9fd1-8fbecccb545a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:27.010167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56721e8-c7fb-4dad-9fd1-8fbecccb545a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:27.024433 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:27.098108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b813ee-1e9d-420b-a1b7-a6067349eb42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:27.098943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b813ee-1e9d-420b-a1b7-a6067349eb42 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:27.099459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b813ee-1e9d-420b-a1b7-a6067349eb42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:27.099942 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b813ee-1e9d-420b-a1b7-a6067349eb42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:27.102226 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-36b813ee-1e9d-420b-a1b7-a6067349eb42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:27.226837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b813ee-1e9d-420b-a1b7-a6067349eb42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:27.228381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b813ee-1e9d-420b-a1b7-a6067349eb42 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:27.247132 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 727/1446] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:29.496397 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e892f8-cdec-4d6d-b762-e5e10c0ed926 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:29.497543 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e892f8-cdec-4d6d-b762-e5e10c0ed926 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:29.497687 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e892f8-cdec-4d6d-b762-e5e10c0ed926 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:29.499030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 720/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:02:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:29.504559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ebe9c-0ba1-4240-a4c4-9588da430854 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:29.504983 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ebe9c-0ba1-4240-a4c4-9588da430854 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:29.505152 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ebe9c-0ba1-4240-a4c4-9588da430854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:29.553305 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:29.570526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e12ebe9c-0ba1-4240-a4c4-9588da430854 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:29.571734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e12ebe9c-0ba1-4240-a4c4-9588da430854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:29.667145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 728/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:02:29.951337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e892f8-cdec-4d6d-b762-e5e10c0ed926 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:29.952919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-80e892f8-cdec-4d6d-b762-e5e10c0ed926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:30.055686 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e892f8-cdec-4d6d-b762-e5e10c0ed926 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:30.095984 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:30.129284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae75b84-d05f-4bad-9ad8-17b231993368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:30.129888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae75b84-d05f-4bad-9ad8-17b231993368 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:30.130166 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae75b84-d05f-4bad-9ad8-17b231993368 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:30.130526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae75b84-d05f-4bad-9ad8-17b231993368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:30.132164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8ae75b84-d05f-4bad-9ad8-17b231993368 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:30.240396 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae75b84-d05f-4bad-9ad8-17b231993368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:30.241736 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae75b84-d05f-4bad-9ad8-17b231993368 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:30.260485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 721/1449] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:32.287864 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0d5bd-8c2f-4aba-810c-4c770d1a30e7 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:32.288440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0d5bd-8c2f-4aba-810c-4c770d1a30e7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:32.288440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d0d5bd-8c2f-4aba-810c-4c770d1a30e7 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:32.289757 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 729/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:32.295132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36314d6d-d650-46d1-b61e-a6be89c30162 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:32.295582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36314d6d-d650-46d1-b61e-a6be89c30162 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:32.295704 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36314d6d-d650-46d1-b61e-a6be89c30162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:32.361536 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-36314d6d-d650-46d1-b61e-a6be89c30162 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:32.362821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-36314d6d-d650-46d1-b61e-a6be89c30162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:32.383445 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:32.458058 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 722/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:02:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:32.746712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0d5bd-8c2f-4aba-810c-4c770d1a30e7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:32.748386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c1d0d5bd-8c2f-4aba-810c-4c770d1a30e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:32.852006 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d0d5bd-8c2f-4aba-810c-4c770d1a30e7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:32.872398 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:32.925712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad2704-760d-41d6-bf5b-a5d609786d9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:32.926323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad2704-760d-41d6-bf5b-a5d609786d9d service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:32.926606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad2704-760d-41d6-bf5b-a5d609786d9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:32.926881 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad2704-760d-41d6-bf5b-a5d609786d9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:32.928539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-11ad2704-760d-41d6-bf5b-a5d609786d9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:33.036866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad2704-760d-41d6-bf5b-a5d609786d9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:33.038284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad2704-760d-41d6-bf5b-a5d609786d9d service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:33.056903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 730/1452] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:35.022664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8fea8-1688-4d28-a81c-bce08d6d4f63 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:35.023214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8fea8-1688-4d28-a81c-bce08d6d4f63 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:35.023214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8fea8-1688-4d28-a81c-bce08d6d4f63 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:35.024588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 723/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:35.030125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215bc7-0efc-431c-bb21-f4c838b78d90 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:35.030546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215bc7-0efc-431c-bb21-f4c838b78d90 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:35.030675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34215bc7-0efc-431c-bb21-f4c838b78d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:35.095923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:35.098837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-34215bc7-0efc-431c-bb21-f4c838b78d90 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:35.100138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-34215bc7-0efc-431c-bb21-f4c838b78d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:35.196485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 731/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:02:35.480317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8fea8-1688-4d28-a81c-bce08d6d4f63 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:35.483010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f8c8fea8-1688-4d28-a81c-bce08d6d4f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:35.585420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8fea8-1688-4d28-a81c-bce08d6d4f63 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:35.633893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:35.659521 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e592a7-6d6f-4846-84d3-37933c33f41a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:35.660158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e592a7-6d6f-4846-84d3-37933c33f41a service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:35.660470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e592a7-6d6f-4846-84d3-37933c33f41a service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:35.660743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e592a7-6d6f-4846-84d3-37933c33f41a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:35.662384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b1e592a7-6d6f-4846-84d3-37933c33f41a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:35.770196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e592a7-6d6f-4846-84d3-37933c33f41a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:35.771738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e592a7-6d6f-4846-84d3-37933c33f41a service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:35.792014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 724/1455] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:37.750056 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3ce4-c8e8-44dc-86dc-281221533c90 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:37.750604 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3ce4-c8e8-44dc-86dc-281221533c90 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:37.750604 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71c3ce4-c8e8-44dc-86dc-281221533c90 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:37.751929 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 732/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:37.757206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d3adf-f3d1-45ea-a64a-53cffe005c5d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:37.757641 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d3adf-f3d1-45ea-a64a-53cffe005c5d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:37.757750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d3adf-f3d1-45ea-a64a-53cffe005c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:37.822927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-123d3adf-f3d1-45ea-a64a-53cffe005c5d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:37.824164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-123d3adf-f3d1-45ea-a64a-53cffe005c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:37.854295 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:37.922057 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 725/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:38.207324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c3ce4-c8e8-44dc-86dc-281221533c90 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:38.208903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f71c3ce4-c8e8-44dc-86dc-281221533c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:38.310632 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71c3ce4-c8e8-44dc-86dc-281221533c90 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:38.338476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:38.384867 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54792650-8d80-46c1-b61c-6b4c53437f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:38.385480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54792650-8d80-46c1-b61c-6b4c53437f1c service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:38.385759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54792650-8d80-46c1-b61c-6b4c53437f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:38.386029 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54792650-8d80-46c1-b61c-6b4c53437f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:38.388376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-54792650-8d80-46c1-b61c-6b4c53437f1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:38.495648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54792650-8d80-46c1-b61c-6b4c53437f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:38.497602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54792650-8d80-46c1-b61c-6b4c53437f1c service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:38.516145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 733/1458] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:40.475075 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1599d-7bd4-4c9f-b7c6-4d9931a5e632 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:40.475625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1599d-7bd4-4c9f-b7c6-4d9931a5e632 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:40.475625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1599d-7bd4-4c9f-b7c6-4d9931a5e632 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:40.477001 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 726/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:40.482591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08a38f-8ee7-4c04-8e84-cdf70149bf2d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:40.483026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08a38f-8ee7-4c04-8e84-cdf70149bf2d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:40.483124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a08a38f-8ee7-4c04-8e84-cdf70149bf2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:40.548393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7a08a38f-8ee7-4c04-8e84-cdf70149bf2d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:40.549598 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7a08a38f-8ee7-4c04-8e84-cdf70149bf2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:40.557715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:40.644894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 734/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:02:40.928474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1599d-7bd4-4c9f-b7c6-4d9931a5e632 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:40.932787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5dd1599d-7bd4-4c9f-b7c6-4d9931a5e632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.035526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1599d-7bd4-4c9f-b7c6-4d9931a5e632 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:41.090190 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:41.108727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c0615a-2d99-498c-85b4-bdbc454fc9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:41.109535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0615a-2d99-498c-85b4-bdbc454fc9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:41.109996 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0615a-2d99-498c-85b4-bdbc454fc9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:41.110518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c0615a-2d99-498c-85b4-bdbc454fc9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:41.112156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-73c0615a-2d99-498c-85b4-bdbc454fc9d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:41.221026 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0615a-2d99-498c-85b4-bdbc454fc9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:41.222378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c0615a-2d99-498c-85b4-bdbc454fc9d2 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:41.242934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 727/1461] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:43.314311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f477bae-13e6-46be-92b0-f6c520df0499 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.314907 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f477bae-13e6-46be-92b0-f6c520df0499 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.314907 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f477bae-13e6-46be-92b0-f6c520df0499 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.316261 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 735/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:43.321608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6eaaf2-59df-4ea7-905f-552eb95bfd17 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.322018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6eaaf2-59df-4ea7-905f-552eb95bfd17 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.322185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6eaaf2-59df-4ea7-905f-552eb95bfd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.388959 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3f6eaaf2-59df-4ea7-905f-552eb95bfd17 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:43.390100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3f6eaaf2-59df-4ea7-905f-552eb95bfd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:43.427668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:43.485961 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 728/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:43.766282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f477bae-13e6-46be-92b0-f6c520df0499 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:43.767817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6f477bae-13e6-46be-92b0-f6c520df0499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:43.872775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f477bae-13e6-46be-92b0-f6c520df0499 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:43.909800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:43.944863 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8808b6d-27f9-434d-9629-5ddf6acf0683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:43.945469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808b6d-27f9-434d-9629-5ddf6acf0683 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:43.945746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808b6d-27f9-434d-9629-5ddf6acf0683 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:43.946014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8808b6d-27f9-434d-9629-5ddf6acf0683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:43.947603 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a8808b6d-27f9-434d-9629-5ddf6acf0683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:44.055407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8808b6d-27f9-434d-9629-5ddf6acf0683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:44.056858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8808b6d-27f9-434d-9629-5ddf6acf0683 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:44.075753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 736/1464] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:46.001705 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caa005-6379-4371-ba8f-c7ac0ffbcc44 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:46.002279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caa005-6379-4371-ba8f-c7ac0ffbcc44 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:46.002279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caa005-6379-4371-ba8f-c7ac0ffbcc44 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.003630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 729/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:46.009090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445edfd-041f-4e56-8f62-1097f219afcd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:46.009522 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445edfd-041f-4e56-8f62-1097f219afcd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:46.009619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e445edfd-041f-4e56-8f62-1097f219afcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.078740 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e445edfd-041f-4e56-8f62-1097f219afcd None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:46.079999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e445edfd-041f-4e56-8f62-1097f219afcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:46.098008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:46.176349 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 737/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:46.458328 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caa005-6379-4371-ba8f-c7ac0ffbcc44 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:46.459889 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-54caa005-6379-4371-ba8f-c7ac0ffbcc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:46.563208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caa005-6379-4371-ba8f-c7ac0ffbcc44 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:46.628787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:46.635192 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb7a489-922d-43e4-a0de-4a876662e353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:46.635790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7a489-922d-43e4-a0de-4a876662e353 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:46.636141 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7a489-922d-43e4-a0de-4a876662e353 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:46.636363 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb7a489-922d-43e4-a0de-4a876662e353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:46.638074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4eb7a489-922d-43e4-a0de-4a876662e353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:46.746655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7a489-922d-43e4-a0de-4a876662e353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:46.748152 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb7a489-922d-43e4-a0de-4a876662e353 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:46.766637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 730/1467] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:48.675022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f9548-d36f-44f4-9c93-fa5671676b64 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:48.675585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f9548-d36f-44f4-9c93-fa5671676b64 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:48.675585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727f9548-d36f-44f4-9c93-fa5671676b64 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:48.676925 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 738/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:02:48.682201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb052a6-1ce3-4aab-be2a-12937679c7d4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:48.682648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb052a6-1ce3-4aab-be2a-12937679c7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:48.682781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb052a6-1ce3-4aab-be2a-12937679c7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:48.749355 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-bdb052a6-1ce3-4aab-be2a-12937679c7d4 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:02:48.750567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bdb052a6-1ce3-4aab-be2a-12937679c7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:48.801000 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:48.851290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 731/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:02:49.133487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f9548-d36f-44f4-9c93-fa5671676b64 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:02:49.135039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-727f9548-d36f-44f4-9c93-fa5671676b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:49.237806 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727f9548-d36f-44f4-9c93-fa5671676b64 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:02:49.284716 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:49.310807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25f136-497a-498e-a1f5-6920495fe5c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:02:49.311443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f136-497a-498e-a1f5-6920495fe5c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:02:49.311722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f136-497a-498e-a1f5-6920495fe5c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:02:49.312037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25f136-497a-498e-a1f5-6920495fe5c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:02:49.313647 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ca25f136-497a-498e-a1f5-6920495fe5c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:02:49.422975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25f136-497a-498e-a1f5-6920495fe5c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:02:49.424444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25f136-497a-498e-a1f5-6920495fe5c4 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:02:49.443941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 739/1470] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:02:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:02:58.849483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=22 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:02:59.441697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=66 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:09.100955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35570979-c176-4496-837b-d67e2167a937 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:09.101523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35570979-c176-4496-837b-d67e2167a937 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:09.101523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35570979-c176-4496-837b-d67e2167a937 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:09.102896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 732/1471] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:03:09.109075 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8852ed-2d90-432b-9411-8ece8eb98bae None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:09.109569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8852ed-2d90-432b-9411-8ece8eb98bae None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:09.109708 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8852ed-2d90-432b-9411-8ece8eb98bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:09.173424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2d8852ed-2d90-432b-9411-8ece8eb98bae None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:09.174617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2d8852ed-2d90-432b-9411-8ece8eb98bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:09.271983 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 740/1472] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:03:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:09.566278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255b51b-d74c-4f0c-9659-6949f5085f17 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:09.566563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255b51b-d74c-4f0c-9659-6949f5085f17 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:09.566837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b255b51b-d74c-4f0c-9659-6949f5085f17 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:09.568218 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 733/1473] 10.222.0.62 () {54 vars in 967 bytes} [Wed Aug 24 08:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:03:09.573655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169afd-42e6-417f-a17c-464663119de7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:09.573932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169afd-42e6-417f-a17c-464663119de7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:09.574380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f169afd-42e6-417f-a17c-464663119de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:09.648631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9f169afd-42e6-417f-a17c-464663119de7 None None] MFA Rules not processed for user `6c83e30a9fd04385b44ee3a3b72e5099`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:09.649761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9f169afd-42e6-417f-a17c-464663119de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:09.670946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:09.726397 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 741/1474] 10.222.0.62 () {58 vars in 1064 bytes} [Wed Aug 24 08:03:09 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:09.734701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255b51b-d74c-4f0c-9659-6949f5085f17 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:09.736286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b255b51b-d74c-4f0c-9659-6949f5085f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:09.837593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b255b51b-d74c-4f0c-9659-6949f5085f17 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:09.910130 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214971d5-b179-4cda-b7e3-ac6b81f73d11 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c83e30a9fd04385b44ee3a3b72e5099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:09.910657 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214971d5-b179-4cda-b7e3-ac6b81f73d11 service glance] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:09.910934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214971d5-b179-4cda-b7e3-ac6b81f73d11 service glance] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:09.911204 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214971d5-b179-4cda-b7e3-ac6b81f73d11 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:09.912832 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-214971d5-b179-4cda-b7e3-ac6b81f73d11 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:09.965879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:10.020162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214971d5-b179-4cda-b7e3-ac6b81f73d11 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:10.021594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214971d5-b179-4cda-b7e3-ac6b81f73d11 service glance] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:10.039820 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 734/1475] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:12.027590 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5f152-c188-445c-93a3-864e3b2240b2 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:12.028181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5f152-c188-445c-93a3-864e3b2240b2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:12.028181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde5f152-c188-445c-93a3-864e3b2240b2 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:12.029555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 742/1476] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:03:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:03:12.034871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477f7d1-18e4-416b-a9a4-8e3be047ab6b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:12.035273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477f7d1-18e4-416b-a9a4-8e3be047ab6b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:12.035439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477f7d1-18e4-416b-a9a4-8e3be047ab6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:12.100250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a477f7d1-18e4-416b-a9a4-8e3be047ab6b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:12.101455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a477f7d1-18e4-416b-a9a4-8e3be047ab6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:12.197224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 735/1477] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:12.475339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5f152-c188-445c-93a3-864e3b2240b2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:12.476925 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cde5f152-c188-445c-93a3-864e3b2240b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:12.601303 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde5f152-c188-445c-93a3-864e3b2240b2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:12.648857 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:12.692595 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06aab7e-330e-44e1-8cb1-78992b1016e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:12.693196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aab7e-330e-44e1-8cb1-78992b1016e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:12.693476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aab7e-330e-44e1-8cb1-78992b1016e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:12.693744 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06aab7e-330e-44e1-8cb1-78992b1016e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:12.694375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06aab7e-330e-44e1-8cb1-78992b1016e2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:12.696125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-f06aab7e-330e-44e1-8cb1-78992b1016e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:03:12.696125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: warnings.warn(msg) Aug 24 08:03:12.696125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: Aug 24 08:03:12.697239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06aab7e-330e-44e1-8cb1-78992b1016e2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:12.716364 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 743/1478] 10.222.0.62 () {56 vars in 1108 bytes} [Wed Aug 24 08:03:12 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:03:14.637207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26e8a6-8ce0-4e83-ad6e-f2594e76ba18 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:14.637728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26e8a6-8ce0-4e83-ad6e-f2594e76ba18 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:14.637728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26e8a6-8ce0-4e83-ad6e-f2594e76ba18 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:14.639019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 736/1479] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:03:14.644365 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ac08a-f68f-493b-90ad-05d42f04a58a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:14.644818 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ac08a-f68f-493b-90ad-05d42f04a58a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:14.644933 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89ac08a-f68f-493b-90ad-05d42f04a58a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:14.710116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d89ac08a-f68f-493b-90ad-05d42f04a58a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:14.711326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d89ac08a-f68f-493b-90ad-05d42f04a58a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:14.808062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 744/1480] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:15.102426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26e8a6-8ce0-4e83-ad6e-f2594e76ba18 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:15.104795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0f26e8a6-8ce0-4e83-ad6e-f2594e76ba18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:15.115128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:15.250225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26e8a6-8ce0-4e83-ad6e-f2594e76ba18 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:15.331189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:15.364291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a6d17-9e8f-4703-8eba-9c9e52e9faff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:15.364832 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a6d17-9e8f-4703-8eba-9c9e52e9faff service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:15.365101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a6d17-9e8f-4703-8eba-9c9e52e9faff service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:15.365368 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a6d17-9e8f-4703-8eba-9c9e52e9faff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:15.366947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-970a6d17-9e8f-4703-8eba-9c9e52e9faff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:15.456722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a6d17-9e8f-4703-8eba-9c9e52e9faff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:15.458297 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970a6d17-9e8f-4703-8eba-9c9e52e9faff service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:15.475909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 737/1481] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:17.574855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c22d41-5d09-457e-b49c-3d8d09e95560 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:17.575528 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c22d41-5d09-457e-b49c-3d8d09e95560 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:17.575528 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c22d41-5d09-457e-b49c-3d8d09e95560 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:17.576788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 745/1482] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:03:17.582565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff793b94-e606-4244-8c1a-d1e61f5c398f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:17.582959 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff793b94-e606-4244-8c1a-d1e61f5c398f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:17.583099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff793b94-e606-4244-8c1a-d1e61f5c398f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:17.647213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ff793b94-e606-4244-8c1a-d1e61f5c398f None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:17.648363 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ff793b94-e606-4244-8c1a-d1e61f5c398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:17.693622 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:17.743966 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 738/1483] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:18.033829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c22d41-5d09-457e-b49c-3d8d09e95560 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:18.035395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-06c22d41-5d09-457e-b49c-3d8d09e95560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:18.059185 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:18.143923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c22d41-5d09-457e-b49c-3d8d09e95560 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:18.217360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0761071-3240-43d8-beda-04e525abb4e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:18.217966 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0761071-3240-43d8-beda-04e525abb4e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:18.218242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0761071-3240-43d8-beda-04e525abb4e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:18.218507 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0761071-3240-43d8-beda-04e525abb4e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:18.220123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f0761071-3240-43d8-beda-04e525abb4e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:18.294953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:18.329337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0761071-3240-43d8-beda-04e525abb4e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:18.330755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0761071-3240-43d8-beda-04e525abb4e2 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:18.348135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 746/1484] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:20.316872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776528a3-baf4-45d0-8cb2-4d96dd1a8235 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:20.317415 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776528a3-baf4-45d0-8cb2-4d96dd1a8235 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:20.317415 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776528a3-baf4-45d0-8cb2-4d96dd1a8235 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:20.318653 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 739/1485] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:03:20.324835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb24634-28a1-4858-afac-2f8f899b3c01 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:20.325278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb24634-28a1-4858-afac-2f8f899b3c01 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:20.325388 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb24634-28a1-4858-afac-2f8f899b3c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:20.391458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8fb24634-28a1-4858-afac-2f8f899b3c01 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:20.392711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8fb24634-28a1-4858-afac-2f8f899b3c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:20.487368 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 747/1486] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:20.781962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776528a3-baf4-45d0-8cb2-4d96dd1a8235 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:20.783496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-776528a3-baf4-45d0-8cb2-4d96dd1a8235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:20.887073 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776528a3-baf4-45d0-8cb2-4d96dd1a8235 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:20.959726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:20.960816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d2877-2c05-4602-b49e-aac6ba6f0075 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:20.961436 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d2877-2c05-4602-b49e-aac6ba6f0075 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:20.961771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d2877-2c05-4602-b49e-aac6ba6f0075 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:20.962042 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d2877-2c05-4602-b49e-aac6ba6f0075 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:20.964287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4a7d2877-2c05-4602-b49e-aac6ba6f0075 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:21.072058 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d2877-2c05-4602-b49e-aac6ba6f0075 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:21.073456 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d2877-2c05-4602-b49e-aac6ba6f0075 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:21.092047 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 740/1487] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:23.150255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f9dc2-4437-43c6-b9d7-97cefc273f04 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.151032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f9dc2-4437-43c6-b9d7-97cefc273f04 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.151032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f9dc2-4437-43c6-b9d7-97cefc273f04 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.152195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 748/1488] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:03:23.157383 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d823a1-f997-4017-a530-0350efa28cbc None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.157793 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d823a1-f997-4017-a530-0350efa28cbc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.157933 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d823a1-f997-4017-a530-0350efa28cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.225331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f5d823a1-f997-4017-a530-0350efa28cbc None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:23.226536 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f5d823a1-f997-4017-a530-0350efa28cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:23.279037 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:23.322452 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 741/1489] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:03:23.620620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f9dc2-4437-43c6-b9d7-97cefc273f04 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:23.622167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-289f9dc2-4437-43c6-b9d7-97cefc273f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:23.657489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:23.724967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f9dc2-4437-43c6-b9d7-97cefc273f04 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:23.797450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb294d7-6297-4e8f-8aa3-719584e18f7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:23.798057 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb294d7-6297-4e8f-8aa3-719584e18f7d service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:23.798337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb294d7-6297-4e8f-8aa3-719584e18f7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:23.798607 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb294d7-6297-4e8f-8aa3-719584e18f7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:23.800272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dbb294d7-6297-4e8f-8aa3-719584e18f7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:23.879114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:23.909207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb294d7-6297-4e8f-8aa3-719584e18f7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:23.910629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb294d7-6297-4e8f-8aa3-719584e18f7d service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:23.928943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 749/1490] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:26.196577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb0bf-c22c-4b9c-86ad-d52c713bc6d3 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:26.197146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb0bf-c22c-4b9c-86ad-d52c713bc6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:26.197146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cdb0bf-c22c-4b9c-86ad-d52c713bc6d3 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:26.198541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 742/1491] 10.222.0.62 () {54 vars in 927 bytes} [Wed Aug 24 08:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:03:26.204090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02e405-d113-4991-a830-31a3b62fa1c2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:26.204559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02e405-d113-4991-a830-31a3b62fa1c2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:26.204659 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc02e405-d113-4991-a830-31a3b62fa1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:26.268766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cc02e405-d113-4991-a830-31a3b62fa1c2 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:03:26.269978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cc02e405-d113-4991-a830-31a3b62fa1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:26.365030 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 750/1492] 10.222.0.62 () {58 vars in 1024 bytes} [Wed Aug 24 08:03:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:03:26.654405 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdb0bf-c22c-4b9c-86ad-d52c713bc6d3 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:03:26.656269 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e0cdb0bf-c22c-4b9c-86ad-d52c713bc6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:26.759114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cdb0bf-c22c-4b9c-86ad-d52c713bc6d3 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:03:26.834712 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70109f3a-8b10-4285-a61e-38eace0f96a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:03:26.835223 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70109f3a-8b10-4285-a61e-38eace0f96a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:03:26.835501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70109f3a-8b10-4285-a61e-38eace0f96a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:03:26.835769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70109f3a-8b10-4285-a61e-38eace0f96a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:03:26.837442 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-70109f3a-8b10-4285-a61e-38eace0f96a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:03:26.847186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:26.945585 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70109f3a-8b10-4285-a61e-38eace0f96a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:03:26.947011 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70109f3a-8b10-4285-a61e-38eace0f96a3 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:03:26.966378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 743/1493] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:03:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:03:36.363256 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=82 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:03:36.963913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=50 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:45.677472 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f07b-3ebb-4845-9c94-38512d63f27a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:45.678054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f07b-3ebb-4845-9c94-38512d63f27a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:45.678054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022f07b-3ebb-4845-9c94-38512d63f27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:45.752054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6022f07b-3ebb-4845-9c94-38512d63f27a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:45.753258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6022f07b-3ebb-4845-9c94-38512d63f27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:45.847346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 751/1494] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:45.857114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a5ca1-5932-47b6-a7ef-37a487aab44d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:45.857639 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a5ca1-5932-47b6-a7ef-37a487aab44d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:45.857639 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a5ca1-5932-47b6-a7ef-37a487aab44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:45.933161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a92a5ca1-5932-47b6-a7ef-37a487aab44d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:45.934282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a92a5ca1-5932-47b6-a7ef-37a487aab44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:46.028001 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 744/1495] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:46.032650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f07b-3ebb-4845-9c94-38512d63f27a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:46.033844 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6022f07b-3ebb-4845-9c94-38512d63f27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:46.045890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022f07b-3ebb-4845-9c94-38512d63f27a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:46.108452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:46.141044 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6de94-1097-42bf-8a62-d1e667b88abe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:46.146949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6de94-1097-42bf-8a62-d1e667b88abe admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.146949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6de94-1097-42bf-8a62-d1e667b88abe admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.146949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea6de94-1097-42bf-8a62-d1e667b88abe admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.146949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6de94-1097-42bf-8a62-d1e667b88abe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:04:46.146949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6de94-1097-42bf-8a62-d1e667b88abe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:46.147428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-fea6de94-1097-42bf-8a62-d1e667b88abe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:04:46.147428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: warnings.warn(msg) Aug 24 08:04:46.147428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: Aug 24 08:04:46.147428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea6de94-1097-42bf-8a62-d1e667b88abe admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:46.157494 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 752/1496] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:04:46.166535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a5ca1-5932-47b6-a7ef-37a487aab44d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:46.175776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92a5ca1-5932-47b6-a7ef-37a487aab44d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:46.237708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:46.271127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64187188-0dd1-4751-8b46-7a574080df51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:46.271725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64187188-0dd1-4751-8b46-7a574080df51 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.272030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64187188-0dd1-4751-8b46-7a574080df51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.272296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64187188-0dd1-4751-8b46-7a574080df51 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.272903 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64187188-0dd1-4751-8b46-7a574080df51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:46.275120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-64187188-0dd1-4751-8b46-7a574080df51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:04:46.275120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: warnings.warn(msg) Aug 24 08:04:46.275120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: Aug 24 08:04:46.276334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64187188-0dd1-4751-8b46-7a574080df51 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:46.386682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 745/1497] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:04:46 2022] POST /identity/v3/projects => generated 373 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:04:46.390842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6de94-1097-42bf-8a62-d1e667b88abe admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:46.392502 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fea6de94-1097-42bf-8a62-d1e667b88abe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:46.427124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea6de94-1097-42bf-8a62-d1e667b88abe admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:46.517765 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2f632-1f9d-4064-99f7-5918c9a277cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:46.518371 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2f632-1f9d-4064-99f7-5918c9a277cc admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.518647 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2f632-1f9d-4064-99f7-5918c9a277cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.518916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2f632-1f9d-4064-99f7-5918c9a277cc admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.519538 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2f632-1f9d-4064-99f7-5918c9a277cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:46.520569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-5ca2f632-1f9d-4064-99f7-5918c9a277cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:04:46.520569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: warnings.warn(msg) Aug 24 08:04:46.520569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: Aug 24 08:04:46.521753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2f632-1f9d-4064-99f7-5918c9a277cc admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:46.597043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 753/1498] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:04:46 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:04:46.601224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64187188-0dd1-4751-8b46-7a574080df51 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:46.602965 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-64187188-0dd1-4751-8b46-7a574080df51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:46.664591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64187188-0dd1-4751-8b46-7a574080df51 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:46.746604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:46.756753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ddb9d-fd38-4d34-92b1-0d316c759fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:46.757944 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ddb9d-fd38-4d34-92b1-0d316c759fcd admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.758217 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ddb9d-fd38-4d34-92b1-0d316c759fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.758558 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840ddb9d-fd38-4d34-92b1-0d316c759fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.759102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ddb9d-fd38-4d34-92b1-0d316c759fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:46.760126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-840ddb9d-fd38-4d34-92b1-0d316c759fcd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:04:46.760126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: warnings.warn(msg) Aug 24 08:04:46.760126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: Aug 24 08:04:46.761043 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840ddb9d-fd38-4d34-92b1-0d316c759fcd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:46.774030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 746/1499] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:46.778368 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2f632-1f9d-4064-99f7-5918c9a277cc admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:46.779896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5ca2f632-1f9d-4064-99f7-5918c9a277cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:46.791291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2f632-1f9d-4064-99f7-5918c9a277cc admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:46.817518 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:46.887266 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f717a28-6927-405c-9e16-3469a1922c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:46.887897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f717a28-6927-405c-9e16-3469a1922c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:46.888242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f717a28-6927-405c-9e16-3469a1922c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:46.888516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f717a28-6927-405c-9e16-3469a1922c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:46.889164 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f717a28-6927-405c-9e16-3469a1922c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:46.890168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-0f717a28-6927-405c-9e16-3469a1922c35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:04:46.890168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: warnings.warn(msg) Aug 24 08:04:46.890168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: Aug 24 08:04:46.891050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f717a28-6927-405c-9e16-3469a1922c35 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:46.903782 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 754/1500] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:04:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:04:46.908015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ddb9d-fd38-4d34-92b1-0d316c759fcd admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:46.909535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-840ddb9d-fd38-4d34-92b1-0d316c759fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:46.943825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840ddb9d-fd38-4d34-92b1-0d316c759fcd admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.037043 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479f2e8a-c8de-4a00-b3df-7df5f3036071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.037613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f2e8a-c8de-4a00-b3df-7df5f3036071 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.037888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f2e8a-c8de-4a00-b3df-7df5f3036071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.038156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479f2e8a-c8de-4a00-b3df-7df5f3036071 admin admin] PATH_INFO: `/v3/projects/38d4214ddc8f4bd1a87df09ece3742d1/users/6170c1180e90474fbe5949e64633a778/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.060455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f2e8a-c8de-4a00-b3df-7df5f3036071 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38d4214ddc8f4bd1a87df09ece3742d1, user_id=6170c1180e90474fbe5949e64633a778, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.061456 dv-cinder-852211-5-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-479f2e8a-c8de-4a00-b3df-7df5f3036071 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:04:47.061456 dv-cinder-852211-5-smb devstack@keystone.service[81602]: warnings.warn(msg) Aug 24 08:04:47.061456 dv-cinder-852211-5-smb devstack@keystone.service[81602]: Aug 24 08:04:47.063370 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479f2e8a-c8de-4a00-b3df-7df5f3036071 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.127970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 747/1501] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:04:46 2022] PUT /identity/v3/projects/38d4214ddc8f4bd1a87df09ece3742d1/users/6170c1180e90474fbe5949e64633a778/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:47.140684 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301c19f-4df9-4413-b9f1-4c4d195ee3ca None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.140980 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301c19f-4df9-4413-b9f1-4c4d195ee3ca None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.141282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301c19f-4df9-4413-b9f1-4c4d195ee3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.198015 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2301c19f-4df9-4413-b9f1-4c4d195ee3ca None None] MFA Rules not processed for user `6170c1180e90474fbe5949e64633a778`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:47.199482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2301c19f-4df9-4413-b9f1-4c4d195ee3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.276461 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 755/1502] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:47.297216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f299c-5f90-4bce-a827-11ad7188766f None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.297216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f299c-5f90-4bce-a827-11ad7188766f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.297216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f299c-5f90-4bce-a827-11ad7188766f None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.297216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 748/1503] 10.222.0.62 () {54 vars in 964 bytes} [Wed Aug 24 08:04:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:04:47.297627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dbf7c-6a71-4042-b0de-03f45b8d66e0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.297627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dbf7c-6a71-4042-b0de-03f45b8d66e0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.297627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008dbf7c-6a71-4042-b0de-03f45b8d66e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.328837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:47.373832 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-008dbf7c-6a71-4042-b0de-03f45b8d66e0 None None] MFA Rules not processed for user `c33f1237eb614223a062bafb7a49eac6`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:47.375055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-008dbf7c-6a71-4042-b0de-03f45b8d66e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.450487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 756/1504] 10.222.0.62 () {58 vars in 1061 bytes} [Wed Aug 24 08:04:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:47.458421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f299c-5f90-4bce-a827-11ad7188766f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.460009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3b4f299c-5f90-4bce-a827-11ad7188766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.509670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:47.563326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f299c-5f90-4bce-a827-11ad7188766f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:47.637175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba696b1-2b67-4f00-aeb1-84ec98c750b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:47.637769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba696b1-2b67-4f00-aeb1-84ec98c750b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.638042 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba696b1-2b67-4f00-aeb1-84ec98c750b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.638304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba696b1-2b67-4f00-aeb1-84ec98c750b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.639894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8ba696b1-2b67-4f00-aeb1-84ec98c750b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.738450 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba696b1-2b67-4f00-aeb1-84ec98c750b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:47.740011 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba696b1-2b67-4f00-aeb1-84ec98c750b9 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:47.743786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:47.757740 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 749/1505] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:47.802567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cf0e1-f672-4621-a1c5-d39cbeb6ae8b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:47.802990 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cf0e1-f672-4621-a1c5-d39cbeb6ae8b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:47.803126 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cf0e1-f672-4621-a1c5-d39cbeb6ae8b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:47.804530 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 757/1506] 10.222.0.62 () {52 vars in 830 bytes} [Wed Aug 24 08:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:04:47.808080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba696b1-2b67-4f00-aeb1-84ec98c750b9 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:47.809315 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8ba696b1-2b67-4f00-aeb1-84ec98c750b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:47.907735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba696b1-2b67-4f00-aeb1-84ec98c750b9 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.001686 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.002355 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.002574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.002850 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] PATH_INFO: `/v3/users/6170c1180e90474fbe5949e64633a778` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.015750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6170c1180e90474fbe5949e64633a778)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.016804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:04:48.016804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: warnings.warn(msg) Aug 24 08:04:48.016804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: Aug 24 08:04:48.018015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.028248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:48.222109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6170c1180e90474fbe5949e64633a778'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:48.244735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6170c1180e90474fbe5949e64633a778'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:48.245296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6170c1180e90474fbe5949e64633a778'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:48.245721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6170c1180e90474fbe5949e64633a778'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:48.260161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6170c1180e90474fbe5949e64633a778'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:48.338350 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 750/1507] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:04:47 2022] DELETE /identity/v3/users/6170c1180e90474fbe5949e64633a778 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:48.342744 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478cc29-a620-4c76-9d76-7a7ef41514a2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.343030 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478cc29-a620-4c76-9d76-7a7ef41514a2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.343311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478cc29-a620-4c76-9d76-7a7ef41514a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.402116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8478cc29-a620-4c76-9d76-7a7ef41514a2 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:04:48.403380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8478cc29-a620-4c76-9d76-7a7ef41514a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:48.477326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:48.489384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 758/1508] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:04:48.499679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:48.500950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:48.604605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408b57a-8256-4fd7-a07d-35835be64a88 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:48.658510 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:48.677573 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b395e-f92f-433a-a2eb-ce4ac7819893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:48.678197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b395e-f92f-433a-a2eb-ce4ac7819893 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:48.678474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b395e-f92f-433a-a2eb-ce4ac7819893 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:48.678738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b395e-f92f-433a-a2eb-ce4ac7819893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:48.681132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-645b395e-f92f-433a-a2eb-ce4ac7819893 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:48.787103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b395e-f92f-433a-a2eb-ce4ac7819893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:48.789048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645b395e-f92f-433a-a2eb-ce4ac7819893 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:48.808403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 751/1509] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:04:49.271117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478cc29-a620-4c76-9d76-7a7ef41514a2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:04:49.272489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8478cc29-a620-4c76-9d76-7a7ef41514a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:04:49.288487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478cc29-a620-4c76-9d76-7a7ef41514a2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:04:49.386309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:04:49.386941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:04:49.387218 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:04:49.387488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b admin admin] PATH_INFO: `/v3/projects/38d4214ddc8f4bd1a87df09ece3742d1` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:04:49.397396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=38d4214ddc8f4bd1a87df09ece3742d1)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:04:49.398629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:04:49.398629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: warnings.warn(msg) Aug 24 08:04:49.398629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: Aug 24 08:04:49.399813 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:04:49.508327 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38d4214ddc8f4bd1a87df09ece3742d1', 'request_id': 'req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.522374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38d4214ddc8f4bd1a87df09ece3742d1', 'request_id': 'req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.607437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38d4214ddc8f4bd1a87df09ece3742d1', 'request_id': 'req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.630522 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b admin admin] The token cache is being invalidate because project 38d4214ddc8f4bd1a87df09ece3742d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:04:49.630809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.631229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0f26f05e-70b3-4b65-9dfd-d721f7129d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:04:49.633453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 759/1510] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:04:49 2022] DELETE /identity/v3/projects/38d4214ddc8f4bd1a87df09ece3742d1 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:04:58.806032 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=62 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:04:59.628497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:24.918453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f8d34-8b4a-4cc9-86d4-c17e4ebb3a93 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:24.919043 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f8d34-8b4a-4cc9-86d4-c17e4ebb3a93 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:24.919043 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40f8d34-8b4a-4cc9-86d4-c17e4ebb3a93 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:24.920366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 752/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:06:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:06:24.925233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ad9a2-8508-49e4-853c-c8773f785467 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:24.925656 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ad9a2-8508-49e4-853c-c8773f785467 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:24.925772 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ad9a2-8508-49e4-853c-c8773f785467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:25.005986 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9e0ad9a2-8508-49e4-853c-c8773f785467 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:25.007191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9e0ad9a2-8508-49e4-853c-c8773f785467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:25.110180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 760/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:25.266349 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f8d34-8b4a-4cc9-86d4-c17e4ebb3a93 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:25.268511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b40f8d34-8b4a-4cc9-86d4-c17e4ebb3a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:25.389035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40f8d34-8b4a-4cc9-86d4-c17e4ebb3a93 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:25.394686 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3a10c-8c3e-41db-8e69-904752a2bea5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:25.395299 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3a10c-8c3e-41db-8e69-904752a2bea5 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:25.395579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3a10c-8c3e-41db-8e69-904752a2bea5 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:25.396603 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3a10c-8c3e-41db-8e69-904752a2bea5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:25.405044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3a10c-8c3e-41db-8e69-904752a2bea5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:25.406604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3a10c-8c3e-41db-8e69-904752a2bea5 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:25.416652 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 753/1513] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:26.235664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252d145-0811-4e6d-bacd-28e0b6788eaf None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:26.236268 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252d145-0811-4e6d-bacd-28e0b6788eaf None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:26.236268 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252d145-0811-4e6d-bacd-28e0b6788eaf None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:26.237590 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 761/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:06:26.242871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c82f78-e6c9-412a-93af-adbe4d16a627 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:26.243321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c82f78-e6c9-412a-93af-adbe4d16a627 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:26.243443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c82f78-e6c9-412a-93af-adbe4d16a627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:26.262412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-89c82f78-e6c9-412a-93af-adbe4d16a627 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:26.263595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-89c82f78-e6c9-412a-93af-adbe4d16a627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:26.271522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 754/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:26.421197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252d145-0811-4e6d-bacd-28e0b6788eaf None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:26.436007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252d145-0811-4e6d-bacd-28e0b6788eaf None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:26.441374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d480a8b-def8-447d-a3e7-e9eef2d49816 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:26.441972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d480a8b-def8-447d-a3e7-e9eef2d49816 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:26.442251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d480a8b-def8-447d-a3e7-e9eef2d49816 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:26.442533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d480a8b-def8-447d-a3e7-e9eef2d49816 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:26.450794 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d480a8b-def8-447d-a3e7-e9eef2d49816 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:26.452403 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d480a8b-def8-447d-a3e7-e9eef2d49816 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:26.461751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 762/1516] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:27.195211 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abad088-8737-4b2e-aadd-49df367a32af None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:27.195496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abad088-8737-4b2e-aadd-49df367a32af None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:27.195769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abad088-8737-4b2e-aadd-49df367a32af None None] PATH_INFO: `/v3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:27.197113 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 755/1517] 10.222.0.52 () {54 vars in 925 bytes} [Wed Aug 24 08:06:27 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:06:27.217309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3d4f2-60d1-4cb1-8114-93addd8b735c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:27.217595 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3d4f2-60d1-4cb1-8114-93addd8b735c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:27.217866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3d4f2-60d1-4cb1-8114-93addd8b735c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:27.277825 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6af3d4f2-60d1-4cb1-8114-93addd8b735c None None] MFA Rules not processed for user `d213e29685f3402b804d4d8fbc88ba96`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:27.279011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6af3d4f2-60d1-4cb1-8114-93addd8b735c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:27.296112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:27.354656 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 763/1518] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Aug 24 08:06:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:36.257888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=56 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:36.818506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0d346-8a5d-4eb2-95ae-334d709d5b02 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:36.818711 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0d346-8a5d-4eb2-95ae-334d709d5b02 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:36.819776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d0d346-8a5d-4eb2-95ae-334d709d5b02 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:36.821130 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 756/1519] 10.222.0.62 () {54 vars in 961 bytes} [Wed Aug 24 08:06:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:06:36.826180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099299fa-722d-4304-b24b-3a6ecd459128 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:36.826659 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099299fa-722d-4304-b24b-3a6ecd459128 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:36.826817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099299fa-722d-4304-b24b-3a6ecd459128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:36.847089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-099299fa-722d-4304-b24b-3a6ecd459128 None None] MFA Rules not processed for user `d213e29685f3402b804d4d8fbc88ba96`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:36.848363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-099299fa-722d-4304-b24b-3a6ecd459128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:36.857301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 764/1520] 10.222.0.62 () {58 vars in 1058 bytes} [Wed Aug 24 08:06:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:36.864915 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0d346-8a5d-4eb2-95ae-334d709d5b02 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:36.878365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d0d346-8a5d-4eb2-95ae-334d709d5b02 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:36.883872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b763ee-701d-4f76-8417-8a8fe189b523 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213e29685f3402b804d4d8fbc88ba96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:36.884487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b763ee-701d-4f76-8417-8a8fe189b523 service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:36.884763 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b763ee-701d-4f76-8417-8a8fe189b523 service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:36.885035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b763ee-701d-4f76-8417-8a8fe189b523 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:36.893760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b763ee-701d-4f76-8417-8a8fe189b523 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:36.895359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b763ee-701d-4f76-8417-8a8fe189b523 service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:36.906371 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 757/1521] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:37.690384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d1c52-fcce-4f77-8bb3-7c5d84467289 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:37.690664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d1c52-fcce-4f77-8bb3-7c5d84467289 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:37.690941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0d1c52-fcce-4f77-8bb3-7c5d84467289 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:37.692359 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 765/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:06:37.697784 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33baf6-6382-4831-ab8e-345db1b1edd0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:37.698260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33baf6-6382-4831-ab8e-345db1b1edd0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:37.698367 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33baf6-6382-4831-ab8e-345db1b1edd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:37.718253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-df33baf6-6382-4831-ab8e-345db1b1edd0 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:37.719449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-df33baf6-6382-4831-ab8e-345db1b1edd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:37.728067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 758/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:06:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:37.881110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d1c52-fcce-4f77-8bb3-7c5d84467289 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:37.895588 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0d1c52-fcce-4f77-8bb3-7c5d84467289 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:37.902016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf9c22b-c7fd-4f48-9aa9-397df99cc90e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:37.903393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9c22b-c7fd-4f48-9aa9-397df99cc90e service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:37.903393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9c22b-c7fd-4f48-9aa9-397df99cc90e service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:37.903393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf9c22b-c7fd-4f48-9aa9-397df99cc90e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:37.911480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9c22b-c7fd-4f48-9aa9-397df99cc90e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:37.913087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf9c22b-c7fd-4f48-9aa9-397df99cc90e service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:37.923083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 766/1524] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:38.731915 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4c104-f249-4b4b-bd62-81fbb3960267 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:38.732451 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4c104-f249-4b4b-bd62-81fbb3960267 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:38.732451 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4c104-f249-4b4b-bd62-81fbb3960267 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:38.733834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 759/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 08:06:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:06:38.738565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21eb173-b432-4d03-942a-37491d7a0029 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:38.738852 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21eb173-b432-4d03-942a-37491d7a0029 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:38.739125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21eb173-b432-4d03-942a-37491d7a0029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:38.760459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e21eb173-b432-4d03-942a-37491d7a0029 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:38.761647 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e21eb173-b432-4d03-942a-37491d7a0029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:38.769504 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 767/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 08:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:38.925411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4c104-f249-4b4b-bd62-81fbb3960267 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:38.940054 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4c104-f249-4b4b-bd62-81fbb3960267 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:38.945692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1cb97-86e0-45ef-a309-79843b1b73ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:38.946280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1cb97-86e0-45ef-a309-79843b1b73ca service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:38.946553 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1cb97-86e0-45ef-a309-79843b1b73ca service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:38.946819 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1cb97-86e0-45ef-a309-79843b1b73ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:38.954722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1cb97-86e0-45ef-a309-79843b1b73ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:38.956318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1cb97-86e0-45ef-a309-79843b1b73ca service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:38.965685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 760/1527] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:42.671035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff802952-a581-48a7-af4d-7a132a210ad7 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:42.671505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff802952-a581-48a7-af4d-7a132a210ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:42.671621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff802952-a581-48a7-af4d-7a132a210ad7 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:42.672981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 768/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:06:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:06:42.678282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa6e33-c12c-4dba-b3e5-6e6246f8451d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:42.678702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa6e33-c12c-4dba-b3e5-6e6246f8451d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:42.678818 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa6e33-c12c-4dba-b3e5-6e6246f8451d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:42.699264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-94fa6e33-c12c-4dba-b3e5-6e6246f8451d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:42.700475 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-94fa6e33-c12c-4dba-b3e5-6e6246f8451d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:42.708117 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 761/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:42.991109 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff802952-a581-48a7-af4d-7a132a210ad7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:42.993004 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ff802952-a581-48a7-af4d-7a132a210ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:43.072824 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff802952-a581-48a7-af4d-7a132a210ad7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:43.076386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d410ca2-d5ac-4e9c-8074-0ce602dd3ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:43.077006 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d410ca2-d5ac-4e9c-8074-0ce602dd3ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:43.077286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d410ca2-d5ac-4e9c-8074-0ce602dd3ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:43.077564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d410ca2-d5ac-4e9c-8074-0ce602dd3ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:43.087180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d410ca2-d5ac-4e9c-8074-0ce602dd3ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:43.088645 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d410ca2-d5ac-4e9c-8074-0ce602dd3ef2 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:43.098799 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 769/1530] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:44.979633 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d76de-694d-40b0-95bd-b97e84d7d2fc None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:44.980290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d76de-694d-40b0-95bd-b97e84d7d2fc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:44.980290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872d76de-694d-40b0-95bd-b97e84d7d2fc None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:44.981440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 762/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:06:44.986576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fe2b0-aafa-46f8-8dcd-1ccf86c2f0ca None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:44.987022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fe2b0-aafa-46f8-8dcd-1ccf86c2f0ca None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:44.987136 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fe2b0-aafa-46f8-8dcd-1ccf86c2f0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:45.006106 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-331fe2b0-aafa-46f8-8dcd-1ccf86c2f0ca None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:45.008028 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-331fe2b0-aafa-46f8-8dcd-1ccf86c2f0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:45.016184 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 770/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:45.301470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d76de-694d-40b0-95bd-b97e84d7d2fc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:45.312672 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872d76de-694d-40b0-95bd-b97e84d7d2fc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:45.316119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a187c407-1b21-4157-b199-936066fc2aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:45.316715 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187c407-1b21-4157-b199-936066fc2aad service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:45.316985 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187c407-1b21-4157-b199-936066fc2aad service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:45.317250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a187c407-1b21-4157-b199-936066fc2aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:45.326816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187c407-1b21-4157-b199-936066fc2aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:45.328255 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a187c407-1b21-4157-b199-936066fc2aad service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:45.337418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 763/1533] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:48.940841 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e7ae2-d20b-4a98-9b46-8effa686fa9e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:48.941665 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e7ae2-d20b-4a98-9b46-8effa686fa9e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:48.941842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709e7ae2-d20b-4a98-9b46-8effa686fa9e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:48.943305 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:06:48.949076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c301737-5264-4469-97ac-ad85bea4c727 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:48.961410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c301737-5264-4469-97ac-ad85bea4c727 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:48.961410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c301737-5264-4469-97ac-ad85bea4c727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:48.968896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1c301737-5264-4469-97ac-ad85bea4c727 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:48.970083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1c301737-5264-4469-97ac-ad85bea4c727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:48.978521 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:49.527801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e7ae2-d20b-4a98-9b46-8effa686fa9e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:49.529533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-709e7ae2-d20b-4a98-9b46-8effa686fa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:49.593350 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:06:49.606213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709e7ae2-d20b-4a98-9b46-8effa686fa9e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:49.610172 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa6c6da-fc96-4720-ba89-8bd9c5640531 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:49.610321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6c6da-fc96-4720-ba89-8bd9c5640531 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:49.610594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6c6da-fc96-4720-ba89-8bd9c5640531 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:49.610871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa6c6da-fc96-4720-ba89-8bd9c5640531 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:49.619738 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6c6da-fc96-4720-ba89-8bd9c5640531 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:49.621187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa6c6da-fc96-4720-ba89-8bd9c5640531 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:49.630335 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 772/1536] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:06:51.570212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059595-31be-489d-91c3-db647e3352de None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:51.570790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059595-31be-489d-91c3-db647e3352de None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:51.570918 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059595-31be-489d-91c3-db647e3352de None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:51.572259 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 08:06:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:06:51.577384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683791a-e541-4671-b42b-f47e43523cfb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:51.577795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683791a-e541-4671-b42b-f47e43523cfb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:51.577948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683791a-e541-4671-b42b-f47e43523cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:51.596975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f683791a-e541-4671-b42b-f47e43523cfb None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:06:51.598177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f683791a-e541-4671-b42b-f47e43523cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:51.606459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 08:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:06:52.156299 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2059595-31be-489d-91c3-db647e3352de None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:06:52.158440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b2059595-31be-489d-91c3-db647e3352de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:06:52.172232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2059595-31be-489d-91c3-db647e3352de None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:06:52.175738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac45834-49e8-4bdb-9741-121b7d1212b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:06:52.176359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac45834-49e8-4bdb-9741-121b7d1212b8 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:06:52.176635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac45834-49e8-4bdb-9741-121b7d1212b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:06:52.176902 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac45834-49e8-4bdb-9741-121b7d1212b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:06:52.185854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac45834-49e8-4bdb-9741-121b7d1212b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:06:52.187261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac45834-49e8-4bdb-9741-121b7d1212b8 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:06:52.196873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 766/1539] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:06:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:07:01.592418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=11 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:07:02.192358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=33 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:20.594814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa526-89a1-4a7e-a6b0-8729996dc2a8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.596463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa526-89a1-4a7e-a6b0-8729996dc2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.596463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fa526-89a1-4a7e-a6b0-8729996dc2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.602207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33708c-859e-4921-9b3a-0dd269681a1a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.603164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33708c-859e-4921-9b3a-0dd269681a1a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.603673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33708c-859e-4921-9b3a-0dd269681a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.623796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ad33708c-859e-4921-9b3a-0dd269681a1a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:20.625225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c10fa526-89a1-4a7e-a6b0-8729996dc2a8 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:20.625723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ad33708c-859e-4921-9b3a-0dd269681a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:20.626662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c10fa526-89a1-4a7e-a6b0-8729996dc2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:20.649024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 774/1540] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:20.650386 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 767/1541] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:20.667608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f046a3-9c8a-4dea-a761-10c5167b569e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.668661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178e058-bf66-4b09-93ce-20f49e4d47bf None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.668941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178e058-bf66-4b09-93ce-20f49e4d47bf None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.669208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178e058-bf66-4b09-93ce-20f49e4d47bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.671863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f046a3-9c8a-4dea-a761-10c5167b569e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.672155 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f046a3-9c8a-4dea-a761-10c5167b569e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.713337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b178e058-bf66-4b09-93ce-20f49e4d47bf None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:20.714554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b178e058-bf66-4b09-93ce-20f49e4d47bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:20.716575 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d1f046a3-9c8a-4dea-a761-10c5167b569e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:20.718964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d1f046a3-9c8a-4dea-a761-10c5167b569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:20.734107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 768/1542] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:20.735391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefcf8c-be18-4406-8054-97c91dc8d60a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.735672 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefcf8c-be18-4406-8054-97c91dc8d60a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.735971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefcf8c-be18-4406-8054-97c91dc8d60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.738827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 775/1543] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:08:20.739786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178e058-bf66-4b09-93ce-20f49e4d47bf None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:20.754404 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178e058-bf66-4b09-93ce-20f49e4d47bf None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:20.764266 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d20a0e-65d9-45b0-b177-686a62bf33a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:20.764909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d20a0e-65d9-45b0-b177-686a62bf33a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.765191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d20a0e-65d9-45b0-b177-686a62bf33a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.765465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d20a0e-65d9-45b0-b177-686a62bf33a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.766135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d20a0e-65d9-45b0-b177-686a62bf33a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:20.766442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d20a0e-65d9-45b0-b177-686a62bf33a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:20.768114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d20a0e-65d9-45b0-b177-686a62bf33a5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:20.792964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-eaefcf8c-be18-4406-8054-97c91dc8d60a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:20.794216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-eaefcf8c-be18-4406-8054-97c91dc8d60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:20.806087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 776/1544] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:20.808246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800705a-bd67-4bf7-a5c3-f97db501194e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.808535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800705a-bd67-4bf7-a5c3-f97db501194e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.808817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800705a-bd67-4bf7-a5c3-f97db501194e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.811343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 769/1545] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:20.812450 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e792d7d-67b6-436b-97bf-1dbab603d91e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.812740 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e792d7d-67b6-436b-97bf-1dbab603d91e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.813008 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e792d7d-67b6-436b-97bf-1dbab603d91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.855276 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6e792d7d-67b6-436b-97bf-1dbab603d91e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:20.856637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8800705a-bd67-4bf7-a5c3-f97db501194e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:20.857887 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8800705a-bd67-4bf7-a5c3-f97db501194e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:20.859696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6e792d7d-67b6-436b-97bf-1dbab603d91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:20.877566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 777/1546] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:20.878360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 770/1547] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:20.879944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a100f-2e11-415f-878f-8dfac6a4fa53 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.880687 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e792d7d-67b6-436b-97bf-1dbab603d91e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:20.881286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a100f-2e11-415f-878f-8dfac6a4fa53 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.881570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a100f-2e11-415f-878f-8dfac6a4fa53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.912308 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e792d7d-67b6-436b-97bf-1dbab603d91e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:20.916695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc61f19-fce4-4c3e-9b0a-de9cf0eb01af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:20.917379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc61f19-fce4-4c3e-9b0a-de9cf0eb01af admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.917659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc61f19-fce4-4c3e-9b0a-de9cf0eb01af admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.917928 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc61f19-fce4-4c3e-9b0a-de9cf0eb01af admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.918579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc61f19-fce4-4c3e-9b0a-de9cf0eb01af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:20.918878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc61f19-fce4-4c3e-9b0a-de9cf0eb01af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:20.919909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-cfc61f19-fce4-4c3e-9b0a-de9cf0eb01af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:08:20.919909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: warnings.warn(msg) Aug 24 08:08:20.919909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: Aug 24 08:08:20.923639 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc61f19-fce4-4c3e-9b0a-de9cf0eb01af admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:20.926294 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ad2a100f-2e11-415f-878f-8dfac6a4fa53 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:20.929018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ad2a100f-2e11-415f-878f-8dfac6a4fa53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:20.954100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 771/1548] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:20.954100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc61f19-fce4-4c3e-9b0a-de9cf0eb01af admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:20.954417 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 778/1549] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:20.955056 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a100f-2e11-415f-878f-8dfac6a4fa53 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:20.970763 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc61f19-fce4-4c3e-9b0a-de9cf0eb01af admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:20.972127 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a100f-2e11-415f-878f-8dfac6a4fa53 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:20.976087 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63199564-3140-4513-bef6-b41030500d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:20.977480 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63199564-3140-4513-bef6-b41030500d25 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.977769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63199564-3140-4513-bef6-b41030500d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.978595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63199564-3140-4513-bef6-b41030500d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.979233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63199564-3140-4513-bef6-b41030500d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:20.981293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63199564-3140-4513-bef6-b41030500d25 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:20.981900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e37cb-1bf9-43b8-898a-1ec44587669b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:20.982621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e37cb-1bf9-43b8-898a-1ec44587669b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:20.983005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e37cb-1bf9-43b8-898a-1ec44587669b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:20.983395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e37cb-1bf9-43b8-898a-1ec44587669b admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:20.984448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e37cb-1bf9-43b8-898a-1ec44587669b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:20.984993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e37cb-1bf9-43b8-898a-1ec44587669b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:20.987162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e37cb-1bf9-43b8-898a-1ec44587669b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.002755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 779/1550] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:21.004540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512365dc-e9e1-4503-bb0e-f9c49c8eeace None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.005039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512365dc-e9e1-4503-bb0e-f9c49c8eeace None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.005513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512365dc-e9e1-4503-bb0e-f9c49c8eeace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.032999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-512365dc-e9e1-4503-bb0e-f9c49c8eeace None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:21.034319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-512365dc-e9e1-4503-bb0e-f9c49c8eeace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.043123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 780/1551] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:21.044998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b579919-d27c-40b9-ac1d-2237cec655e7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.044998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b579919-d27c-40b9-ac1d-2237cec655e7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.044998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b579919-d27c-40b9-ac1d-2237cec655e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.068343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 772/1552] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:20 2022] POST /identity/v3/projects => generated 393 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:21.069525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63199564-3140-4513-bef6-b41030500d25 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.069643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8b579919-d27c-40b9-ac1d-2237cec655e7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:21.071300 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8b579919-d27c-40b9-ac1d-2237cec655e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.133613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 781/1553] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:21.134744 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63199564-3140-4513-bef6-b41030500d25 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.134879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd9e7-360f-403c-a169-23827e5ab98f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.135129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd9e7-360f-403c-a169-23827e5ab98f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.135403 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cd9e7-360f-403c-a169-23827e5ab98f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.139998 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea705e33-57d8-4817-9370-5d31d070daea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.140880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea705e33-57d8-4817-9370-5d31d070daea admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.141322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea705e33-57d8-4817-9370-5d31d070daea admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.141593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea705e33-57d8-4817-9370-5d31d070daea admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.142216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea705e33-57d8-4817-9370-5d31d070daea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.144142 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea705e33-57d8-4817-9370-5d31d070daea admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.155376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a77cd9e7-360f-403c-a169-23827e5ab98f None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:21.156942 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a77cd9e7-360f-403c-a169-23827e5ab98f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.165478 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 782/1554] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:21.166267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cd9e7-360f-403c-a169-23827e5ab98f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.175611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77cd9e7-360f-403c-a169-23827e5ab98f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.181241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae43e9-c7b9-4db7-9551-2a1a99657af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.181818 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae43e9-c7b9-4db7-9551-2a1a99657af6 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.182098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae43e9-c7b9-4db7-9551-2a1a99657af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.182397 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae43e9-c7b9-4db7-9551-2a1a99657af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.183007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae43e9-c7b9-4db7-9551-2a1a99657af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.184134 dv-cinder-852211-5-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-caae43e9-c7b9-4db7-9551-2a1a99657af6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:08:21.184134 dv-cinder-852211-5-smb devstack@keystone.service[81603]: warnings.warn(msg) Aug 24 08:08:21.184134 dv-cinder-852211-5-smb devstack@keystone.service[81603]: Aug 24 08:08:21.185294 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caae43e9-c7b9-4db7-9551-2a1a99657af6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.255729 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 773/1555] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/projects => generated 371 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:21.257024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bb7e1-87f9-436a-8191-dbc1038525ea None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.257311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bb7e1-87f9-436a-8191-dbc1038525ea None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.258261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bb7e1-87f9-436a-8191-dbc1038525ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.277421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-888bb7e1-87f9-436a-8191-dbc1038525ea None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:21.278638 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-888bb7e1-87f9-436a-8191-dbc1038525ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.287209 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 783/1556] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:21.287209 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae43e9-c7b9-4db7-9551-2a1a99657af6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.339700 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 774/1557] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:21.341041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adddc5-6cbb-4052-83a6-1b7f6fe0cb35 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.341328 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adddc5-6cbb-4052-83a6-1b7f6fe0cb35 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.341602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37adddc5-6cbb-4052-83a6-1b7f6fe0cb35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.348898 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae43e9-c7b9-4db7-9551-2a1a99657af6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.354207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa461ea-ca15-4564-a1bb-b8a1f8be20d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.354817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa461ea-ca15-4564-a1bb-b8a1f8be20d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.355099 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa461ea-ca15-4564-a1bb-b8a1f8be20d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.355370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa461ea-ca15-4564-a1bb-b8a1f8be20d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.356050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa461ea-ca15-4564-a1bb-b8a1f8be20d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:21.356351 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa461ea-ca15-4564-a1bb-b8a1f8be20d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.357971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa461ea-ca15-4564-a1bb-b8a1f8be20d2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.364153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-37adddc5-6cbb-4052-83a6-1b7f6fe0cb35 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:21.365346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-37adddc5-6cbb-4052-83a6-1b7f6fe0cb35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.369801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 784/1558] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:21.370469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa461ea-ca15-4564-a1bb-b8a1f8be20d2 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.380067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 775/1559] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:21.381844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c615fa-b565-4b1b-917e-bb30a1089133 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.381844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c615fa-b565-4b1b-917e-bb30a1089133 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.381844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c615fa-b565-4b1b-917e-bb30a1089133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.387673 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa461ea-ca15-4564-a1bb-b8a1f8be20d2 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.392296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc81ff9-3290-49ec-833f-7b75a6281d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.392904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc81ff9-3290-49ec-833f-7b75a6281d92 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.393183 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc81ff9-3290-49ec-833f-7b75a6281d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.393452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc81ff9-3290-49ec-833f-7b75a6281d92 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.394075 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc81ff9-3290-49ec-833f-7b75a6281d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.396079 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc81ff9-3290-49ec-833f-7b75a6281d92 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.402998 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-12c615fa-b565-4b1b-917e-bb30a1089133 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:21.404222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-12c615fa-b565-4b1b-917e-bb30a1089133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.404879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:21.412806 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 776/1560] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:21.413560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c615fa-b565-4b1b-917e-bb30a1089133 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.418897 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:21.424059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c615fa-b565-4b1b-917e-bb30a1089133 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.428629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e2a9b-8915-4707-a98c-26b49be3eead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.429202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e2a9b-8915-4707-a98c-26b49be3eead admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.429511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e2a9b-8915-4707-a98c-26b49be3eead admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.429798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e2a9b-8915-4707-a98c-26b49be3eead admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.430411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e2a9b-8915-4707-a98c-26b49be3eead admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:21.430707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e2a9b-8915-4707-a98c-26b49be3eead admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.432317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e2a9b-8915-4707-a98c-26b49be3eead admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.443585 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 777/1561] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:21.451023 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e2a9b-8915-4707-a98c-26b49be3eead admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.454570 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e2a9b-8915-4707-a98c-26b49be3eead admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.459279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2391c-4c5e-426e-9d6c-4d156ae835b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.459866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2391c-4c5e-426e-9d6c-4d156ae835b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.460162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2391c-4c5e-426e-9d6c-4d156ae835b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.460465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2391c-4c5e-426e-9d6c-4d156ae835b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.461796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2391c-4c5e-426e-9d6c-4d156ae835b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.462788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-4db2391c-4c5e-426e-9d6c-4d156ae835b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:08:21.462788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: warnings.warn(msg) Aug 24 08:08:21.462788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: Aug 24 08:08:21.464017 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2391c-4c5e-426e-9d6c-4d156ae835b8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.502645 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 785/1562] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:21.502645 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc81ff9-3290-49ec-833f-7b75a6281d92 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.510773 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc81ff9-3290-49ec-833f-7b75a6281d92 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.515353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cdd5b-e01e-4b97-819b-459e04b754e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.516097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cdd5b-e01e-4b97-819b-459e04b754e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.516381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cdd5b-e01e-4b97-819b-459e04b754e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.516654 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cdd5b-e01e-4b97-819b-459e04b754e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.517258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cdd5b-e01e-4b97-819b-459e04b754e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.519141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595cdd5b-e01e-4b97-819b-459e04b754e4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.593753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 778/1563] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:21.594983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3740f-0ff0-431f-985e-7c6234db4ba7 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.595262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3740f-0ff0-431f-985e-7c6234db4ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.595572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3740f-0ff0-431f-985e-7c6234db4ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.614384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-45e3740f-0ff0-431f-985e-7c6234db4ba7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:21.615566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-45e3740f-0ff0-431f-985e-7c6234db4ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.624338 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 779/1564] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:21.624988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3740f-0ff0-431f-985e-7c6234db4ba7 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.634222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 786/1565] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:21.636273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5762669-cf15-4a25-a8e5-30c9c55e6134 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.636559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5762669-cf15-4a25-a8e5-30c9c55e6134 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.636836 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5762669-cf15-4a25-a8e5-30c9c55e6134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.639579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3740f-0ff0-431f-985e-7c6234db4ba7 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.644515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0126bbd-d9ce-4440-8776-2d95e40d8e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.645114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0126bbd-d9ce-4440-8776-2d95e40d8e75 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.645391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0126bbd-d9ce-4440-8776-2d95e40d8e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.645659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0126bbd-d9ce-4440-8776-2d95e40d8e75 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.646280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0126bbd-d9ce-4440-8776-2d95e40d8e75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.648794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0126bbd-d9ce-4440-8776-2d95e40d8e75 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.657044 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a5762669-cf15-4a25-a8e5-30c9c55e6134 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:21.658254 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a5762669-cf15-4a25-a8e5-30c9c55e6134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:21.666458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 787/1566] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:21.668700 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5762669-cf15-4a25-a8e5-30c9c55e6134 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.678087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5762669-cf15-4a25-a8e5-30c9c55e6134 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.682970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d615b-c76b-49ee-9164-469ed534e683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.686859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d615b-c76b-49ee-9164-469ed534e683 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.686859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d615b-c76b-49ee-9164-469ed534e683 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.686859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6d615b-c76b-49ee-9164-469ed534e683 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.686859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d615b-c76b-49ee-9164-469ed534e683 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:21.686859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d615b-c76b-49ee-9164-469ed534e683 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.686859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6d615b-c76b-49ee-9164-469ed534e683 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.698901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 788/1567] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:21.699782 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d615b-c76b-49ee-9164-469ed534e683 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.708914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6d615b-c76b-49ee-9164-469ed534e683 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.713774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea494ee-e191-4eef-890e-539168cc6ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.714333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea494ee-e191-4eef-890e-539168cc6ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.714615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea494ee-e191-4eef-890e-539168cc6ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.714890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea494ee-e191-4eef-890e-539168cc6ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.715493 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea494ee-e191-4eef-890e-539168cc6ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.717368 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea494ee-e191-4eef-890e-539168cc6ef4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.758531 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 780/1568] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:21.759364 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0126bbd-d9ce-4440-8776-2d95e40d8e75 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.816442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 789/1569] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:21.817277 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea494ee-e191-4eef-890e-539168cc6ef4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.823764 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0126bbd-d9ce-4440-8776-2d95e40d8e75 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.880310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa34c2e-43c0-420b-8fc7-8663579a71b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.880922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa34c2e-43c0-420b-8fc7-8663579a71b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.881199 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa34c2e-43c0-420b-8fc7-8663579a71b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.881469 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa34c2e-43c0-420b-8fc7-8663579a71b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.881846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea494ee-e191-4eef-890e-539168cc6ef4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.882107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa34c2e-43c0-420b-8fc7-8663579a71b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.885926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa34c2e-43c0-420b-8fc7-8663579a71b5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.887425 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9fb41-bdf4-4b18-8374-e5d40551d932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.888098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9fb41-bdf4-4b18-8374-e5d40551d932 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.888382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9fb41-bdf4-4b18-8374-e5d40551d932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.888659 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9fb41-bdf4-4b18-8374-e5d40551d932 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.889337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9fb41-bdf4-4b18-8374-e5d40551d932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.890924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9fb41-bdf4-4b18-8374-e5d40551d932 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.894263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 781/1570] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:21.897824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa34c2e-43c0-420b-8fc7-8663579a71b5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.904752 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 790/1571] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:21.904752 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9fb41-bdf4-4b18-8374-e5d40551d932 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.908734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa34c2e-43c0-420b-8fc7-8663579a71b5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.913556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d072b6-98c1-4d0a-9c12-f7dc4d94221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.914958 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d072b6-98c1-4d0a-9c12-f7dc4d94221d admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.915157 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9fb41-bdf4-4b18-8374-e5d40551d932 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.915280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d072b6-98c1-4d0a-9c12-f7dc4d94221d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.915498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d072b6-98c1-4d0a-9c12-f7dc4d94221d admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.916181 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d072b6-98c1-4d0a-9c12-f7dc4d94221d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:21.916486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d072b6-98c1-4d0a-9c12-f7dc4d94221d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.918111 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d072b6-98c1-4d0a-9c12-f7dc4d94221d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.920019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cd33c-351e-4d91-8c6a-47342b2da358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.920618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cd33c-351e-4d91-8c6a-47342b2da358 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.920900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cd33c-351e-4d91-8c6a-47342b2da358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.921172 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6cd33c-351e-4d91-8c6a-47342b2da358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.921850 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cd33c-351e-4d91-8c6a-47342b2da358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.923439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6cd33c-351e-4d91-8c6a-47342b2da358 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.930403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 782/1572] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:21.931291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d072b6-98c1-4d0a-9c12-f7dc4d94221d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.935320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 791/1573] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:21.936611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cd33c-351e-4d91-8c6a-47342b2da358 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.943405 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d072b6-98c1-4d0a-9c12-f7dc4d94221d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.947001 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6cd33c-351e-4d91-8c6a-47342b2da358 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.948460 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70463e82-bce1-4e76-818c-e53ca59668c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.949050 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70463e82-bce1-4e76-818c-e53ca59668c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.949328 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70463e82-bce1-4e76-818c-e53ca59668c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.949614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70463e82-bce1-4e76-818c-e53ca59668c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.950255 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70463e82-bce1-4e76-818c-e53ca59668c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:21.950556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70463e82-bce1-4e76-818c-e53ca59668c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.951726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3c9a6-5570-4cc0-b040-64777b378088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.952153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70463e82-bce1-4e76-818c-e53ca59668c9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.952488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3c9a6-5570-4cc0-b040-64777b378088 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.952832 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3c9a6-5570-4cc0-b040-64777b378088 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.953170 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3c9a6-5570-4cc0-b040-64777b378088 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.953873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3c9a6-5570-4cc0-b040-64777b378088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.955812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3c9a6-5570-4cc0-b040-64777b378088 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:21.964506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 783/1574] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:21.965268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70463e82-bce1-4e76-818c-e53ca59668c9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:21.976831 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70463e82-bce1-4e76-818c-e53ca59668c9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:21.981895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaac94-908e-4575-a363-4cce3fa83ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:21.982551 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaac94-908e-4575-a363-4cce3fa83ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:21.982834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaac94-908e-4575-a363-4cce3fa83ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:21.983105 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeaac94-908e-4575-a363-4cce3fa83ef4 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:21.983723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaac94-908e-4575-a363-4cce3fa83ef4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:21.985706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeaac94-908e-4575-a363-4cce3fa83ef4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.032982 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 792/1575] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/projects => generated 405 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:22.033848 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3c9a6-5570-4cc0-b040-64777b378088 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.056757 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 784/1576] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:21 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:22.057709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaac94-908e-4575-a363-4cce3fa83ef4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.063047 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:22.068409 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeaac94-908e-4575-a363-4cce3fa83ef4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.087348 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:22.097311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3c9a6-5570-4cc0-b040-64777b378088 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.102178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2807f0-616f-4ee6-aaad-d28fa471851f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.105548 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2807f0-616f-4ee6-aaad-d28fa471851f admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.105548 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2807f0-616f-4ee6-aaad-d28fa471851f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.105548 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2807f0-616f-4ee6-aaad-d28fa471851f admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.105548 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2807f0-616f-4ee6-aaad-d28fa471851f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.105945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2807f0-616f-4ee6-aaad-d28fa471851f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.126519 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c047853-58e7-440b-ab91-4a16fcd50ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.128879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c047853-58e7-440b-ab91-4a16fcd50ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.128879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c047853-58e7-440b-ab91-4a16fcd50ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.128879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c047853-58e7-440b-ab91-4a16fcd50ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.128879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c047853-58e7-440b-ab91-4a16fcd50ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.129890 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c047853-58e7-440b-ab91-4a16fcd50ef8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.140214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 785/1577] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:22.141165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c047853-58e7-440b-ab91-4a16fcd50ef8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.150941 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c047853-58e7-440b-ab91-4a16fcd50ef8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.155481 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a3158-ae63-4280-84ba-ecfaab312bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.156084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a3158-ae63-4280-84ba-ecfaab312bbb admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.156370 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a3158-ae63-4280-84ba-ecfaab312bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.156643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47a3158-ae63-4280-84ba-ecfaab312bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.157257 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a3158-ae63-4280-84ba-ecfaab312bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.158789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47a3158-ae63-4280-84ba-ecfaab312bbb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.168703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 786/1578] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:22.174715 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a3158-ae63-4280-84ba-ecfaab312bbb admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.178901 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47a3158-ae63-4280-84ba-ecfaab312bbb admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.184174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfbcff-3d48-4ead-8374-f02db9e5f7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.184673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfbcff-3d48-4ead-8374-f02db9e5f7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.184951 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfbcff-3d48-4ead-8374-f02db9e5f7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.185221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cfbcff-3d48-4ead-8374-f02db9e5f7e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.185817 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfbcff-3d48-4ead-8374-f02db9e5f7e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.187673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cfbcff-3d48-4ead-8374-f02db9e5f7e1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.237634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 793/1579] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:22 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:22.238396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2807f0-616f-4ee6-aaad-d28fa471851f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.248985 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2807f0-616f-4ee6-aaad-d28fa471851f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.254136 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774a77b-6458-4077-a1a3-cad4eb0dae8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.255054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774a77b-6458-4077-a1a3-cad4eb0dae8f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.255054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774a77b-6458-4077-a1a3-cad4eb0dae8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.255353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5774a77b-6458-4077-a1a3-cad4eb0dae8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.256049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774a77b-6458-4077-a1a3-cad4eb0dae8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.257813 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5774a77b-6458-4077-a1a3-cad4eb0dae8f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.268228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 794/1580] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:22.269013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774a77b-6458-4077-a1a3-cad4eb0dae8f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.279467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 787/1581] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:22 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:22.280235 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5774a77b-6458-4077-a1a3-cad4eb0dae8f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.280404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfbcff-3d48-4ead-8374-f02db9e5f7e1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.338010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa788c-5b11-410d-89b6-aebb69fb1eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.338617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa788c-5b11-410d-89b6-aebb69fb1eec admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.338897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa788c-5b11-410d-89b6-aebb69fb1eec admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.339172 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa788c-5b11-410d-89b6-aebb69fb1eec admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.339790 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa788c-5b11-410d-89b6-aebb69fb1eec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.341712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa788c-5b11-410d-89b6-aebb69fb1eec admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.343667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cfbcff-3d48-4ead-8374-f02db9e5f7e1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.348543 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244adaa-c76f-46aa-9baa-6e04aae69001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.349140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244adaa-c76f-46aa-9baa-6e04aae69001 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.349416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244adaa-c76f-46aa-9baa-6e04aae69001 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.349684 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a244adaa-c76f-46aa-9baa-6e04aae69001 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.350298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244adaa-c76f-46aa-9baa-6e04aae69001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.352882 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a244adaa-c76f-46aa-9baa-6e04aae69001 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.416573 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 795/1582] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:22 2022] POST /identity/v3/projects => generated 385 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:22.417410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa788c-5b11-410d-89b6-aebb69fb1eec admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.446954 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 788/1583] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:22 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:22.446954 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244adaa-c76f-46aa-9baa-6e04aae69001 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.453507 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a244adaa-c76f-46aa-9baa-6e04aae69001 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.479557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa788c-5b11-410d-89b6-aebb69fb1eec admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.484269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9784c35-14b9-42d0-b1e1-29161e077cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.484878 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9784c35-14b9-42d0-b1e1-29161e077cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.485158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9784c35-14b9-42d0-b1e1-29161e077cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.485551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9784c35-14b9-42d0-b1e1-29161e077cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.486198 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9784c35-14b9-42d0-b1e1-29161e077cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.487774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9784c35-14b9-42d0-b1e1-29161e077cb8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.498789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 796/1584] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:22.499573 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9784c35-14b9-42d0-b1e1-29161e077cb8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.504702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:22.511013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52db4a-ac52-44db-8de9-1009e2b8a83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.511556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9784c35-14b9-42d0-b1e1-29161e077cb8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.511699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52db4a-ac52-44db-8de9-1009e2b8a83b admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.511964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52db4a-ac52-44db-8de9-1009e2b8a83b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.512235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52db4a-ac52-44db-8de9-1009e2b8a83b admin admin] PATH_INFO: `/v3/projects/22a77f51d295458bb3c8051214f7eeb3/users/68ee993e0aab4f988751a8b1bf11346c/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.516127 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796c795-d84a-4892-b0ac-82392de9bf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.516764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796c795-d84a-4892-b0ac-82392de9bf1c admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.519672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796c795-d84a-4892-b0ac-82392de9bf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.519672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796c795-d84a-4892-b0ac-82392de9bf1c admin admin] PATH_INFO: `/v3/projects/8941ca6c0c124c619afa7b4b1b23be28/users/39cbda92fc2c48a4b36bbdd08a0a49d1/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.526500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52db4a-ac52-44db-8de9-1009e2b8a83b admin admin] RBAC: Authorizing `identity:create_grant(project_id=22a77f51d295458bb3c8051214f7eeb3, user_id=68ee993e0aab4f988751a8b1bf11346c, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.529179 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52db4a-ac52-44db-8de9-1009e2b8a83b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.532263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796c795-d84a-4892-b0ac-82392de9bf1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8941ca6c0c124c619afa7b4b1b23be28, user_id=39cbda92fc2c48a4b36bbdd08a0a49d1, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.533289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-c796c795-d84a-4892-b0ac-82392de9bf1c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:08:22.533289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: warnings.warn(msg) Aug 24 08:08:22.533289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: Aug 24 08:08:22.535213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796c795-d84a-4892-b0ac-82392de9bf1c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.595683 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 789/1585] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:22 2022] PUT /identity/v3/projects/22a77f51d295458bb3c8051214f7eeb3/users/68ee993e0aab4f988751a8b1bf11346c/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:22.596525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52db4a-ac52-44db-8de9-1009e2b8a83b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.624702 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 797/1586] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:22 2022] PUT /identity/v3/projects/8941ca6c0c124c619afa7b4b1b23be28/users/39cbda92fc2c48a4b36bbdd08a0a49d1/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:22.628551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796c795-d84a-4892-b0ac-82392de9bf1c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.656354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:22.672641 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52db4a-ac52-44db-8de9-1009e2b8a83b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.686889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796c795-d84a-4892-b0ac-82392de9bf1c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.692278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f21f-e634-4fd6-8429-0270f3f0d96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.692969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f21f-e634-4fd6-8429-0270f3f0d96a admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.693248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f21f-e634-4fd6-8429-0270f3f0d96a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.693516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce70f21f-e634-4fd6-8429-0270f3f0d96a admin admin] PATH_INFO: `/v3/projects/8763f79f5df848b3937bf5bcce20b9aa/users/cd7e2148a240426b925e49b8e1b48156/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.707669 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70f21f-e634-4fd6-8429-0270f3f0d96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8763f79f5df848b3937bf5bcce20b9aa, user_id=cd7e2148a240426b925e49b8e1b48156, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.710354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce70f21f-e634-4fd6-8429-0270f3f0d96a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.729728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff426d-324c-4cfb-8b52-81fa1e96e8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.731487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff426d-324c-4cfb-8b52-81fa1e96e8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.731487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff426d-324c-4cfb-8b52-81fa1e96e8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.731487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daff426d-324c-4cfb-8b52-81fa1e96e8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.731487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff426d-324c-4cfb-8b52-81fa1e96e8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.733073 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daff426d-324c-4cfb-8b52-81fa1e96e8e4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.742938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 790/1587] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:22.743687 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff426d-324c-4cfb-8b52-81fa1e96e8e4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.752738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daff426d-324c-4cfb-8b52-81fa1e96e8e4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.759097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c886-0299-436a-a747-0be2d66f3e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.760110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c886-0299-436a-a747-0be2d66f3e08 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.760587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c886-0299-436a-a747-0be2d66f3e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.761073 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7748c886-0299-436a-a747-0be2d66f3e08 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.762084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748c886-0299-436a-a747-0be2d66f3e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.764112 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7748c886-0299-436a-a747-0be2d66f3e08 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.784689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 798/1588] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:22 2022] PUT /identity/v3/projects/8763f79f5df848b3937bf5bcce20b9aa/users/cd7e2148a240426b925e49b8e1b48156/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:22.786363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f21f-e634-4fd6-8429-0270f3f0d96a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.847376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce70f21f-e634-4fd6-8429-0270f3f0d96a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.852053 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbffc5da-ce8e-4019-b1b0-1939fd72c866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.852650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc5da-ce8e-4019-b1b0-1939fd72c866 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.852930 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc5da-ce8e-4019-b1b0-1939fd72c866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.853198 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbffc5da-ce8e-4019-b1b0-1939fd72c866 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.853825 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffc5da-ce8e-4019-b1b0-1939fd72c866 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.855697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbffc5da-ce8e-4019-b1b0-1939fd72c866 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.866229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 791/1589] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:22 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:22.867947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c886-0299-436a-a747-0be2d66f3e08 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.879503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7748c886-0299-436a-a747-0be2d66f3e08 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.884821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ea6df-adfa-4c3d-910e-47a7766dd367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.885408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ea6df-adfa-4c3d-910e-47a7766dd367 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.885690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ea6df-adfa-4c3d-910e-47a7766dd367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.885946 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53ea6df-adfa-4c3d-910e-47a7766dd367 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.886579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ea6df-adfa-4c3d-910e-47a7766dd367 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.888177 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53ea6df-adfa-4c3d-910e-47a7766dd367 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.899101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 792/1590] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:22.900021 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ea6df-adfa-4c3d-910e-47a7766dd367 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.910036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53ea6df-adfa-4c3d-910e-47a7766dd367 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.915283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ceb86-83f7-4bfc-9ece-b690e7d4d697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.915854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ceb86-83f7-4bfc-9ece-b690e7d4d697 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.916145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ceb86-83f7-4bfc-9ece-b690e7d4d697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.916410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ceb86-83f7-4bfc-9ece-b690e7d4d697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.917022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ceb86-83f7-4bfc-9ece-b690e7d4d697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.918554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ceb86-83f7-4bfc-9ece-b690e7d4d697 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.928389 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 793/1591] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:22.930854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279abf-710e-4be5-acf0-15c83930f894 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.931254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279abf-710e-4be5-acf0-15c83930f894 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.931674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe279abf-710e-4be5-acf0-15c83930f894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.938938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 799/1592] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:22 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:22.938938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62e2e8-3d1c-4c79-9cd2-7833f544a3f3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.938938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62e2e8-3d1c-4c79-9cd2-7833f544a3f3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.938938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee62e2e8-3d1c-4c79-9cd2-7833f544a3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.952602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fe279abf-710e-4be5-acf0-15c83930f894 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:22.953801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fe279abf-710e-4be5-acf0-15c83930f894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:22.965404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 794/1593] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:22.965404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe279abf-710e-4be5-acf0-15c83930f894 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:22.973161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ee62e2e8-3d1c-4c79-9cd2-7833f544a3f3 None None] MFA Rules not processed for user `39cbda92fc2c48a4b36bbdd08a0a49d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:22.974440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ee62e2e8-3d1c-4c79-9cd2-7833f544a3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:22.975989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe279abf-710e-4be5-acf0-15c83930f894 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:22.981528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562dc9b2-c6af-42d7-bd5c-1d7a740cd4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:22.982133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc9b2-c6af-42d7-bd5c-1d7a740cd4d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.982409 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc9b2-c6af-42d7-bd5c-1d7a740cd4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.982679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dc9b2-c6af-42d7-bd5c-1d7a740cd4d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:22.983327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dc9b2-c6af-42d7-bd5c-1d7a740cd4d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:22.984957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562dc9b2-c6af-42d7-bd5c-1d7a740cd4d5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:22.995617 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 795/1594] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:22.996845 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4651ae-93bc-4b91-ab68-e7d85f15d4c1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:22.997131 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4651ae-93bc-4b91-ab68-e7d85f15d4c1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:22.997401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4651ae-93bc-4b91-ab68-e7d85f15d4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.016071 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8b4651ae-93bc-4b91-ab68-e7d85f15d4c1 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:23.017289 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8b4651ae-93bc-4b91-ab68-e7d85f15d4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:23.026649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 796/1595] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:23.027429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4651ae-93bc-4b91-ab68-e7d85f15d4c1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.037691 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4651ae-93bc-4b91-ab68-e7d85f15d4c1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.043448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 800/1596] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:23.043615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ba07d-4a50-4511-be5d-757be39856fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:23.044223 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ba07d-4a50-4511-be5d-757be39856fd admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.044417 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62e2e8-3d1c-4c79-9cd2-7833f544a3f3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.044604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ba07d-4a50-4511-be5d-757be39856fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.044997 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ba07d-4a50-4511-be5d-757be39856fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.045767 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ba07d-4a50-4511-be5d-757be39856fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:23.047351 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ba07d-4a50-4511-be5d-757be39856fd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:23.057308 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee62e2e8-3d1c-4c79-9cd2-7833f544a3f3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.061263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 797/1597] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:23.061263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ba07d-4a50-4511-be5d-757be39856fd admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.066667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596cf53-35a2-4f83-8d0a-adb2a5549352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:23.072914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596cf53-35a2-4f83-8d0a-adb2a5549352 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.072914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596cf53-35a2-4f83-8d0a-adb2a5549352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.072914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e596cf53-35a2-4f83-8d0a-adb2a5549352 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.072914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596cf53-35a2-4f83-8d0a-adb2a5549352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:23.072914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e596cf53-35a2-4f83-8d0a-adb2a5549352 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:23.073330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ba07d-4a50-4511-be5d-757be39856fd admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.078082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866124b6-aff4-4a24-80d0-31af27653186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:23.078783 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866124b6-aff4-4a24-80d0-31af27653186 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.079196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866124b6-aff4-4a24-80d0-31af27653186 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.079332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866124b6-aff4-4a24-80d0-31af27653186 admin admin] PATH_INFO: `/v3/projects/1d2a92ad79204e2c83a8d9ae030a9287/users/8e9558f071244924926df0fe80d3259a/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.081989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:23.087257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 801/1598] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:23.088150 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596cf53-35a2-4f83-8d0a-adb2a5549352 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.095863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866124b6-aff4-4a24-80d0-31af27653186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d2a92ad79204e2c83a8d9ae030a9287, user_id=8e9558f071244924926df0fe80d3259a, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:23.099296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866124b6-aff4-4a24-80d0-31af27653186 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:23.099794 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e596cf53-35a2-4f83-8d0a-adb2a5549352 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.105339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297aa7d-5a1a-4c71-9f6d-ced5172a91a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:23.105933 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297aa7d-5a1a-4c71-9f6d-ced5172a91a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.106216 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297aa7d-5a1a-4c71-9f6d-ced5172a91a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.106489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297aa7d-5a1a-4c71-9f6d-ced5172a91a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.107123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297aa7d-5a1a-4c71-9f6d-ced5172a91a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:23.108722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297aa7d-5a1a-4c71-9f6d-ced5172a91a6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:23.122346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 802/1599] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:23.122346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297aa7d-5a1a-4c71-9f6d-ced5172a91a6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.129960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:23.151440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 798/1600] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:23 2022] PUT /identity/v3/projects/1d2a92ad79204e2c83a8d9ae030a9287/users/8e9558f071244924926df0fe80d3259a/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:23.152808 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866124b6-aff4-4a24-80d0-31af27653186 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.175662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297aa7d-5a1a-4c71-9f6d-ced5172a91a6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.215527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866124b6-aff4-4a24-80d0-31af27653186 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.220201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c32767-ac4e-460b-865d-eedb65746917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:23.220858 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c32767-ac4e-460b-865d-eedb65746917 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.221133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c32767-ac4e-460b-865d-eedb65746917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.221401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c32767-ac4e-460b-865d-eedb65746917 admin admin] PATH_INFO: `/v3/projects/1e4559063e0a44b092ed48d8dd0073d6/users/108dfbd365a4455e83e5eebb799ef005/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.224150 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eee76d-e442-48af-9d27-75426588d41d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:23.224762 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee76d-e442-48af-9d27-75426588d41d service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.225038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee76d-e442-48af-9d27-75426588d41d service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.225308 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eee76d-e442-48af-9d27-75426588d41d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.235286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eee76d-e442-48af-9d27-75426588d41d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:23.239401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c32767-ac4e-460b-865d-eedb65746917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e4559063e0a44b092ed48d8dd0073d6, user_id=108dfbd365a4455e83e5eebb799ef005, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:23.239518 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eee76d-e442-48af-9d27-75426588d41d service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:23.239629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c32767-ac4e-460b-865d-eedb65746917 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:23.246405 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 803/1601] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:23.247286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eee76d-e442-48af-9d27-75426588d41d service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.254872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eee76d-e442-48af-9d27-75426588d41d service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.262014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaeaa3-c776-4082-ac81-a3a912ca0d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:23.262885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaeaa3-c776-4082-ac81-a3a912ca0d2a service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.263193 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaeaa3-c776-4082-ac81-a3a912ca0d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.263464 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aaeaa3-c776-4082-ac81-a3a912ca0d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.274393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aaeaa3-c776-4082-ac81-a3a912ca0d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:23.276437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aaeaa3-c776-4082-ac81-a3a912ca0d2a service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:23.286774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 804/1602] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:23.291342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaeaa3-c776-4082-ac81-a3a912ca0d2a service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.296738 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aaeaa3-c776-4082-ac81-a3a912ca0d2a service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.301545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8efee4b-3074-493a-8de3-96bdf6341126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:23.302142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efee4b-3074-493a-8de3-96bdf6341126 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.302419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efee4b-3074-493a-8de3-96bdf6341126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.302688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8efee4b-3074-493a-8de3-96bdf6341126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.303324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efee4b-3074-493a-8de3-96bdf6341126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:23.305556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8efee4b-3074-493a-8de3-96bdf6341126 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:23.315695 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 805/1603] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:23.316923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9a2bb-fc64-4ce9-ba31-d2317332f4d6 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.317201 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9a2bb-fc64-4ce9-ba31-d2317332f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.317471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9a2bb-fc64-4ce9-ba31-d2317332f4d6 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.318666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 806/1604] 10.222.0.62 () {54 vars in 962 bytes} [Wed Aug 24 08:08:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:08:23.319327 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9a2bb-fc64-4ce9-ba31-d2317332f4d6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.332061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d9a2bb-fc64-4ce9-ba31-d2317332f4d6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.337056 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf5c6d-102d-4a58-b639-3820f4e691d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:23.337688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf5c6d-102d-4a58-b639-3820f4e691d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.337970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf5c6d-102d-4a58-b639-3820f4e691d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.338245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf5c6d-102d-4a58-b639-3820f4e691d3 admin admin] PATH_INFO: `/v3/projects/c049eb42ef6f48d6994b3d15f5c80020/users/819d5835d9dc4406b2c666e10736e95e/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.352604 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf5c6d-102d-4a58-b639-3820f4e691d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c049eb42ef6f48d6994b3d15f5c80020, user_id=819d5835d9dc4406b2c666e10736e95e, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:23.355299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf5c6d-102d-4a58-b639-3820f4e691d3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:23.357768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 799/1605] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:23 2022] PUT /identity/v3/projects/1e4559063e0a44b092ed48d8dd0073d6/users/108dfbd365a4455e83e5eebb799ef005/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:23.360721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c32767-ac4e-460b-865d-eedb65746917 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.422930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c32767-ac4e-460b-865d-eedb65746917 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.427685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96a8b1-7523-4059-8d2e-a6d363f11aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:23.428330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96a8b1-7523-4059-8d2e-a6d363f11aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.428610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96a8b1-7523-4059-8d2e-a6d363f11aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.428881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96a8b1-7523-4059-8d2e-a6d363f11aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.429666 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96a8b1-7523-4059-8d2e-a6d363f11aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:23.431319 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96a8b1-7523-4059-8d2e-a6d363f11aa4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:23.441414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 800/1606] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:23.442629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2dbfe-e657-4817-b03c-57e4407cbac5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.442920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2dbfe-e657-4817-b03c-57e4407cbac5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.443190 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2dbfe-e657-4817-b03c-57e4407cbac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.462010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-24a2dbfe-e657-4817-b03c-57e4407cbac5 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:23.463226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-24a2dbfe-e657-4817-b03c-57e4407cbac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:23.471227 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 801/1607] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:23.472296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2dbfe-e657-4817-b03c-57e4407cbac5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.489480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 807/1608] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:23 2022] PUT /identity/v3/projects/c049eb42ef6f48d6994b3d15f5c80020/users/819d5835d9dc4406b2c666e10736e95e/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:23.495323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d1ef4-335e-4e9e-bb3c-e354d3453f19 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.495323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d1ef4-335e-4e9e-bb3c-e354d3453f19 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.495323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d1ef4-335e-4e9e-bb3c-e354d3453f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.495629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2dbfe-e657-4817-b03c-57e4407cbac5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.548675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-385d1ef4-335e-4e9e-bb3c-e354d3453f19 None None] MFA Rules not processed for user `9b99cff7a5f549adadee002f8ab1f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:23.550356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-385d1ef4-335e-4e9e-bb3c-e354d3453f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:23.562210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d6c15-4a1b-46b4-93bc-cd2ecd9b75e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:23.562805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d6c15-4a1b-46b4-93bc-cd2ecd9b75e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.563079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d6c15-4a1b-46b4-93bc-cd2ecd9b75e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.563344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d6c15-4a1b-46b4-93bc-cd2ecd9b75e6 admin admin] PATH_INFO: `/v3/projects/d28177cf7acb40519093ff6ace8d2cfa/users/f4b56136da884b79ab26be1bdd99e407/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.578180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d6c15-4a1b-46b4-93bc-cd2ecd9b75e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d28177cf7acb40519093ff6ace8d2cfa, user_id=f4b56136da884b79ab26be1bdd99e407, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:23.582390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d6c15-4a1b-46b4-93bc-cd2ecd9b75e6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:23.617396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 808/1609] 10.222.0.62 () {58 vars in 1059 bytes} [Wed Aug 24 08:08:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:23.618634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5c582-3822-4719-98f6-fa95bf53d9cc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.618920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5c582-3822-4719-98f6-fa95bf53d9cc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.619199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a5c582-3822-4719-98f6-fa95bf53d9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.653520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f7a5c582-3822-4719-98f6-fa95bf53d9cc None None] MFA Rules not processed for user `108dfbd365a4455e83e5eebb799ef005`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:23.653520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f7a5c582-3822-4719-98f6-fa95bf53d9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:23.678249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 802/1610] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:23 2022] PUT /identity/v3/projects/d28177cf7acb40519093ff6ace8d2cfa/users/f4b56136da884b79ab26be1bdd99e407/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:23.687999 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d6c15-4a1b-46b4-93bc-cd2ecd9b75e6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.708366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:23.719897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 809/1611] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:23.729423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f7cc-e946-49fb-987a-bb9808463ef5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.729423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f7cc-e946-49fb-987a-bb9808463ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.729897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b90f7cc-e946-49fb-987a-bb9808463ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.754625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d6c15-4a1b-46b4-93bc-cd2ecd9b75e6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.754722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5b90f7cc-e946-49fb-987a-bb9808463ef5 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:23.754816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfb690d-a698-4cc6-b72a-7f819a3ee535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:23.754816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb690d-a698-4cc6-b72a-7f819a3ee535 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.754816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb690d-a698-4cc6-b72a-7f819a3ee535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.755051 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5b90f7cc-e946-49fb-987a-bb9808463ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:23.755141 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfb690d-a698-4cc6-b72a-7f819a3ee535 admin admin] PATH_INFO: `/v3/projects/5d3b994a91da4215af01b0b42dec9e52/users/1f99c70aded147dd9373a5f03b63063a/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.764536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 810/1612] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:23.765842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90f7cc-e946-49fb-987a-bb9808463ef5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.773564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5b90f7cc-e946-49fb-987a-bb9808463ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:23.779643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb690d-a698-4cc6-b72a-7f819a3ee535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d3b994a91da4215af01b0b42dec9e52, user_id=1f99c70aded147dd9373a5f03b63063a, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:23.782096 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfb690d-a698-4cc6-b72a-7f819a3ee535 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:23.832179 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b90f7cc-e946-49fb-987a-bb9808463ef5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.836420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22666699-75fc-49a0-9dfb-27d84d537d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:23.837076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22666699-75fc-49a0-9dfb-27d84d537d75 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.837979 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22666699-75fc-49a0-9dfb-27d84d537d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.838255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22666699-75fc-49a0-9dfb-27d84d537d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.848312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:23.854630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22666699-75fc-49a0-9dfb-27d84d537d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:23.854630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22666699-75fc-49a0-9dfb-27d84d537d75 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:23.862921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 811/1613] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:23.863898 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22666699-75fc-49a0-9dfb-27d84d537d75 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:23.873776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 803/1614] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:23 2022] PUT /identity/v3/projects/5d3b994a91da4215af01b0b42dec9e52/users/1f99c70aded147dd9373a5f03b63063a/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:23.875627 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee5e8-bbda-46f0-bfa1-db61e35e2d79 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:23.875941 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee5e8-bbda-46f0-bfa1-db61e35e2d79 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:23.876602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ee5e8-bbda-46f0-bfa1-db61e35e2d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:23.896210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e95ee5e8-bbda-46f0-bfa1-db61e35e2d79 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:23.897421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e95ee5e8-bbda-46f0-bfa1-db61e35e2d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:23.956635 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22666699-75fc-49a0-9dfb-27d84d537d75 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:23.966226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 804/1615] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:23.966226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ee5e8-bbda-46f0-bfa1-db61e35e2d79 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:24.037591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ee5e8-bbda-46f0-bfa1-db61e35e2d79 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:24.052195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05384d-a405-480c-bbd7-e3743e3dfea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:24.055117 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05384d-a405-480c-bbd7-e3743e3dfea6 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:24.059973 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05384d-a405-480c-bbd7-e3743e3dfea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:24.060379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05384d-a405-480c-bbd7-e3743e3dfea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:24.061831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb6e79-57d1-4962-be0a-db5ae9d1c22a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:24.062309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb6e79-57d1-4962-be0a-db5ae9d1c22a service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:24.062885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb6e79-57d1-4962-be0a-db5ae9d1c22a service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:24.063414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb6e79-57d1-4962-be0a-db5ae9d1c22a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:24.088089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:24.154410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb6e79-57d1-4962-be0a-db5ae9d1c22a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:24.156191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eb6e79-57d1-4962-be0a-db5ae9d1c22a service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:24.162917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05384d-a405-480c-bbd7-e3743e3dfea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:24.163414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:24.164802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05384d-a405-480c-bbd7-e3743e3dfea6 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:24.169921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 812/1616] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:24.170508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb6e79-57d1-4962-be0a-db5ae9d1c22a service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:24.186841 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 805/1617] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:23 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:24.188619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfafdd-ca2a-4fc0-a157-7ef49c4fe797 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:24.189075 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfafdd-ca2a-4fc0-a157-7ef49c4fe797 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:24.189509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dfafdd-ca2a-4fc0-a157-7ef49c4fe797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:24.260877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-79dfafdd-ca2a-4fc0-a157-7ef49c4fe797 None None] MFA Rules not processed for user `1f99c70aded147dd9373a5f03b63063a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:24.262103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79dfafdd-ca2a-4fc0-a157-7ef49c4fe797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:24.272071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb6e79-57d1-4962-be0a-db5ae9d1c22a service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:24.277487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08996765-4452-4de2-b9ff-9eed51c5b9b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:24.279806 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08996765-4452-4de2-b9ff-9eed51c5b9b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:24.280244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08996765-4452-4de2-b9ff-9eed51c5b9b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:24.281376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08996765-4452-4de2-b9ff-9eed51c5b9b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:24.316997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08996765-4452-4de2-b9ff-9eed51c5b9b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:24.322534 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08996765-4452-4de2-b9ff-9eed51c5b9b6 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:24.339116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 813/1618] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:24.340250 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08996765-4452-4de2-b9ff-9eed51c5b9b6 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:24.361856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08996765-4452-4de2-b9ff-9eed51c5b9b6 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:24.369749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811cfac-c567-4423-875e-828ece7e230f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:24.370713 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811cfac-c567-4423-875e-828ece7e230f service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:24.371106 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811cfac-c567-4423-875e-828ece7e230f service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:24.373473 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811cfac-c567-4423-875e-828ece7e230f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:24.414627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811cfac-c567-4423-875e-828ece7e230f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:24.418315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f811cfac-c567-4423-875e-828ece7e230f service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:24.435944 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 806/1619] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:24.449212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 814/1620] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:24.475635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52577e-f309-4a57-a541-d0c13bae2b19 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:24.475965 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52577e-f309-4a57-a541-d0c13bae2b19 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:24.476364 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d52577e-f309-4a57-a541-d0c13bae2b19 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:24.478081 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 807/1621] 10.222.0.62 () {54 vars in 962 bytes} [Wed Aug 24 08:08:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:08:24.494968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb1a6d-5bbe-4481-a32d-b24df0af8e1f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:24.495301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb1a6d-5bbe-4481-a32d-b24df0af8e1f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:24.495530 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb1a6d-5bbe-4481-a32d-b24df0af8e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:24.529197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-48fb1a6d-5bbe-4481-a32d-b24df0af8e1f None None] MFA Rules not processed for user `9b99cff7a5f549adadee002f8ab1f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:24.530617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-48fb1a6d-5bbe-4481-a32d-b24df0af8e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:24.551031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 815/1622] 10.222.0.62 () {58 vars in 1059 bytes} [Wed Aug 24 08:08:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:24.560640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52577e-f309-4a57-a541-d0c13bae2b19 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:24.577082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d52577e-f309-4a57-a541-d0c13bae2b19 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:24.583695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c8db8-5382-47c8-9efe-d1dbc743b510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:24.584426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c8db8-5382-47c8-9efe-d1dbc743b510 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:24.587728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c8db8-5382-47c8-9efe-d1dbc743b510 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:24.587728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c8db8-5382-47c8-9efe-d1dbc743b510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:24.594960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c8db8-5382-47c8-9efe-d1dbc743b510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:24.596710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b5201-0454-4328-a445-32ba49823a7b None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:24.597008 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c8db8-5382-47c8-9efe-d1dbc743b510 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:24.597121 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b5201-0454-4328-a445-32ba49823a7b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:24.597314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6b5201-0454-4328-a445-32ba49823a7b None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:24.599117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 816/1623] 10.222.0.62 () {54 vars in 912 bytes} [Wed Aug 24 08:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:08:24.606212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db3e51-9cdb-4359-bd2b-5849e50beca8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:24.606495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db3e51-9cdb-4359-bd2b-5849e50beca8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:24.606770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db3e51-9cdb-4359-bd2b-5849e50beca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:24.609236 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 808/1624] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:24 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:24.628381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-56db3e51-9cdb-4359-bd2b-5849e50beca8 None None] MFA Rules not processed for user `9b99cff7a5f549adadee002f8ab1f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:24.629708 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-56db3e51-9cdb-4359-bd2b-5849e50beca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:24.641736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 817/1625] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:08:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:08:24.655332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c8db8-5382-47c8-9efe-d1dbc743b510 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:24.675747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c8db8-5382-47c8-9efe-d1dbc743b510 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:24.680637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bb58df-1174-4692-8678-e30dc384579d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:24.681239 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb58df-1174-4692-8678-e30dc384579d service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:24.681525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb58df-1174-4692-8678-e30dc384579d service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:24.681804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bb58df-1174-4692-8678-e30dc384579d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:24.694427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb58df-1174-4692-8678-e30dc384579d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:24.697031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bb58df-1174-4692-8678-e30dc384579d service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:24.711356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 809/1626] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:24.871165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661df5cd-7b7f-4eed-9b82-c125d41aaa04 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:24.871713 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661df5cd-7b7f-4eed-9b82-c125d41aaa04 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:24.873111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661df5cd-7b7f-4eed-9b82-c125d41aaa04 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:24.875050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 818/1627] 10.222.0.62 () {54 vars in 912 bytes} [Wed Aug 24 08:08:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:08:24.880663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b8893-9c83-44a4-9f75-afbb8a2ca813 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:24.881070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b8893-9c83-44a4-9f75-afbb8a2ca813 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:24.881436 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b8893-9c83-44a4-9f75-afbb8a2ca813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:24.906843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e17b8893-9c83-44a4-9f75-afbb8a2ca813 None None] MFA Rules not processed for user `9b99cff7a5f549adadee002f8ab1f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:24.908202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e17b8893-9c83-44a4-9f75-afbb8a2ca813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:24.921324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 810/1628] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:08:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:25.439188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661df5cd-7b7f-4eed-9b82-c125d41aaa04 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:25.458717 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661df5cd-7b7f-4eed-9b82-c125d41aaa04 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:25.473347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559904a-dc62-4d2d-b292-ea4c0af776f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:25.474556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559904a-dc62-4d2d-b292-ea4c0af776f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:25.474556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559904a-dc62-4d2d-b292-ea4c0af776f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:25.474778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559904a-dc62-4d2d-b292-ea4c0af776f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:25.491312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559904a-dc62-4d2d-b292-ea4c0af776f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:25.493575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f559904a-dc62-4d2d-b292-ea4c0af776f8 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:25.509281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 819/1629] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:27.465859 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4a7b5-fbf6-4f66-8bec-624310a9f2c3 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:27.465859 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4a7b5-fbf6-4f66-8bec-624310a9f2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:27.465859 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4a7b5-fbf6-4f66-8bec-624310a9f2c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:27.465859 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-acc4a7b5-fbf6-4f66-8bec-624310a9f2c3 None None] MFA Rules not processed for user `819d5835d9dc4406b2c666e10736e95e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:27.465859 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-acc4a7b5-fbf6-4f66-8bec-624310a9f2c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:27.651458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 811/1630] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:27 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:27.655676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559904a-dc62-4d2d-b292-ea4c0af776f8 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:27.687796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f559904a-dc62-4d2d-b292-ea4c0af776f8 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:27.700823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6e38e-4cbb-483c-bbf6-c2ddadc7bc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:27.701569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6e38e-4cbb-483c-bbf6-c2ddadc7bc2b admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:27.701958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6e38e-4cbb-483c-bbf6-c2ddadc7bc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:27.702333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6e38e-4cbb-483c-bbf6-c2ddadc7bc2b admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:27.707504 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6e38e-4cbb-483c-bbf6-c2ddadc7bc2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:27.717211 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6e38e-4cbb-483c-bbf6-c2ddadc7bc2b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:27.840017 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:27.849525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 820/1631] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:27 2022] POST /identity/v3/projects => generated 403 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:27.850664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4a7b5-fbf6-4f66-8bec-624310a9f2c3 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:27.864446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:27.912093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4a7b5-fbf6-4f66-8bec-624310a9f2c3 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:28.099222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be340ed-7a05-45a2-a1fb-fc9cd588a66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:28.102822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be340ed-7a05-45a2-a1fb-fc9cd588a66b admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:28.103618 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be340ed-7a05-45a2-a1fb-fc9cd588a66b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:28.103832 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be340ed-7a05-45a2-a1fb-fc9cd588a66b admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:28.104856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be340ed-7a05-45a2-a1fb-fc9cd588a66b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:28.111516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be340ed-7a05-45a2-a1fb-fc9cd588a66b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:28.257137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 812/1632] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:27 2022] POST /identity/v3/users => generated 308 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:28.260608 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6e38e-4cbb-483c-bbf6-c2ddadc7bc2b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:28.277289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6e38e-4cbb-483c-bbf6-c2ddadc7bc2b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:28.293422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c032f97-8c20-4427-b299-ba8eecea667b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:28.298061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c032f97-8c20-4427-b299-ba8eecea667b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:28.298061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c032f97-8c20-4427-b299-ba8eecea667b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:28.298061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c032f97-8c20-4427-b299-ba8eecea667b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:28.298061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c032f97-8c20-4427-b299-ba8eecea667b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:28.298061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c032f97-8c20-4427-b299-ba8eecea667b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:28.320926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 821/1633] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:28.321743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be340ed-7a05-45a2-a1fb-fc9cd588a66b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:28.350775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be340ed-7a05-45a2-a1fb-fc9cd588a66b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:28.373055 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f60e9-8cd5-4c4a-86c2-2a368f12c0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:28.393216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f60e9-8cd5-4c4a-86c2-2a368f12c0da admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:28.393584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f60e9-8cd5-4c4a-86c2-2a368f12c0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:28.396107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76f60e9-8cd5-4c4a-86c2-2a368f12c0da admin admin] PATH_INFO: `/v3/projects/ee5ed8189b304ec580c97115d5312919/users/e43850b81fe444659273aa88cfeec0be/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:28.451683 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f60e9-8cd5-4c4a-86c2-2a368f12c0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5ed8189b304ec580c97115d5312919, user_id=e43850b81fe444659273aa88cfeec0be, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:28.458090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76f60e9-8cd5-4c4a-86c2-2a368f12c0da admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:28.555579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 813/1634] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:28 2022] PUT /identity/v3/projects/ee5ed8189b304ec580c97115d5312919/users/e43850b81fe444659273aa88cfeec0be/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:08:28.560358 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c032f97-8c20-4427-b299-ba8eecea667b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:28.588514 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c032f97-8c20-4427-b299-ba8eecea667b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:28.709053 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744c834-1441-4b5d-84d7-591e4e794534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:28.710827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744c834-1441-4b5d-84d7-591e4e794534 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:28.711443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744c834-1441-4b5d-84d7-591e4e794534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:28.727083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744c834-1441-4b5d-84d7-591e4e794534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:28.731021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744c834-1441-4b5d-84d7-591e4e794534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:28.732892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744c834-1441-4b5d-84d7-591e4e794534 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:28.776688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 822/1635] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:28 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:28.782454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f60e9-8cd5-4c4a-86c2-2a368f12c0da admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:28.797659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76f60e9-8cd5-4c4a-86c2-2a368f12c0da admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:28.811360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6490051-0b80-4385-b480-4c88173a5305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:28.812277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6490051-0b80-4385-b480-4c88173a5305 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:28.812695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6490051-0b80-4385-b480-4c88173a5305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:28.815659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6490051-0b80-4385-b480-4c88173a5305 admin admin] PATH_INFO: `/v3/projects/ee5ed8189b304ec580c97115d5312919/users/e43850b81fe444659273aa88cfeec0be/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:28.820788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6490051-0b80-4385-b480-4c88173a5305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee5ed8189b304ec580c97115d5312919, user_id=e43850b81fe444659273aa88cfeec0be, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:28.832512 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6490051-0b80-4385-b480-4c88173a5305 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:28.888643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 814/1636] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:28 2022] PUT /identity/v3/projects/ee5ed8189b304ec580c97115d5312919/users/e43850b81fe444659273aa88cfeec0be/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:29.480593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744c834-1441-4b5d-84d7-591e4e794534 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:29.500427 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744c834-1441-4b5d-84d7-591e4e794534 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:29.665211 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:29.666101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:29.666983 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:29.667708 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] PATH_INFO: `/v3/users/39cbda92fc2c48a4b36bbdd08a0a49d1` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:29.669278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39cbda92fc2c48a4b36bbdd08a0a49d1)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:29.670508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: WARNING py.warnings [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:08:29.670508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: warnings.warn(msg) Aug 24 08:08:29.670508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: Aug 24 08:08:29.672600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:29.955533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39cbda92fc2c48a4b36bbdd08a0a49d1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:29.956296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39cbda92fc2c48a4b36bbdd08a0a49d1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:29.956936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39cbda92fc2c48a4b36bbdd08a0a49d1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:29.979144 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39cbda92fc2c48a4b36bbdd08a0a49d1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:30.021431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39cbda92fc2c48a4b36bbdd08a0a49d1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:30.119767 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 823/1637] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:29 2022] DELETE /identity/v3/users/39cbda92fc2c48a4b36bbdd08a0a49d1 => generated 0 bytes in 640 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:30.124490 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be55dd7-754d-4428-ba36-a63fb0e6d810 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:30.125012 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be55dd7-754d-4428-ba36-a63fb0e6d810 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:30.125012 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be55dd7-754d-4428-ba36-a63fb0e6d810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:30.196762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2be55dd7-754d-4428-ba36-a63fb0e6d810 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:30.200805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2be55dd7-754d-4428-ba36-a63fb0e6d810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:30.373803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 815/1638] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:30.391779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:30.394153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:30.407890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:30.606339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fbdf3-2f6a-4eda-ab7d-37e4c6dc2071 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:30.619942 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac93be-b7e5-4b94-b242-0050d0c11c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:30.622162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac93be-b7e5-4b94-b242-0050d0c11c4a service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:30.624595 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac93be-b7e5-4b94-b242-0050d0c11c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:30.625088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac93be-b7e5-4b94-b242-0050d0c11c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:30.646919 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac93be-b7e5-4b94-b242-0050d0c11c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:30.650631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac93be-b7e5-4b94-b242-0050d0c11c4a service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:30.683043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 824/1639] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:31.734277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be55dd7-754d-4428-ba36-a63fb0e6d810 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:31.737748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2be55dd7-754d-4428-ba36-a63fb0e6d810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:31.770988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be55dd7-754d-4428-ba36-a63fb0e6d810 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:31.787067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae80a57-af5e-451f-9224-9aa41bde50fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:31.789978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae80a57-af5e-451f-9224-9aa41bde50fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:31.794048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae80a57-af5e-451f-9224-9aa41bde50fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:31.794659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae80a57-af5e-451f-9224-9aa41bde50fe admin admin] PATH_INFO: `/v3/projects/8941ca6c0c124c619afa7b4b1b23be28` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:31.798090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae80a57-af5e-451f-9224-9aa41bde50fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8941ca6c0c124c619afa7b4b1b23be28)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:31.799319 dv-cinder-852211-5-smb devstack@keystone.service[81602]: WARNING py.warnings [None req-4ae80a57-af5e-451f-9224-9aa41bde50fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 08:08:31.799319 dv-cinder-852211-5-smb devstack@keystone.service[81602]: warnings.warn(msg) Aug 24 08:08:31.799319 dv-cinder-852211-5-smb devstack@keystone.service[81602]: Aug 24 08:08:31.801146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae80a57-af5e-451f-9224-9aa41bde50fe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:32.016140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4ae80a57-af5e-451f-9224-9aa41bde50fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8941ca6c0c124c619afa7b4b1b23be28', 'request_id': 'req-4ae80a57-af5e-451f-9224-9aa41bde50fe'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.018040 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:32.053054 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4ae80a57-af5e-451f-9224-9aa41bde50fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8941ca6c0c124c619afa7b4b1b23be28', 'request_id': 'req-4ae80a57-af5e-451f-9224-9aa41bde50fe'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.075833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4ae80a57-af5e-451f-9224-9aa41bde50fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8941ca6c0c124c619afa7b4b1b23be28', 'request_id': 'req-4ae80a57-af5e-451f-9224-9aa41bde50fe'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.189228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4ae80a57-af5e-451f-9224-9aa41bde50fe admin admin] The token cache is being invalidate because project 8941ca6c0c124c619afa7b4b1b23be28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:32.189682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4ae80a57-af5e-451f-9224-9aa41bde50fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.190512 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4ae80a57-af5e-451f-9224-9aa41bde50fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:32.192611 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 816/1640] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:31 2022] DELETE /identity/v3/projects/8941ca6c0c124c619afa7b4b1b23be28 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:32.199544 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7aa6bd-d390-45ef-9689-42a19b1f8c78 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:32.199544 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7aa6bd-d390-45ef-9689-42a19b1f8c78 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:32.199544 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7aa6bd-d390-45ef-9689-42a19b1f8c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:32.248329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-da7aa6bd-d390-45ef-9689-42a19b1f8c78 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:32.251611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-da7aa6bd-d390-45ef-9689-42a19b1f8c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:32.437309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 825/1641] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:32.445771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2881f-0072-4763-a1d8-f5444f421501 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:32.446061 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2881f-0072-4763-a1d8-f5444f421501 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:32.456446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede2881f-0072-4763-a1d8-f5444f421501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:32.534483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ede2881f-0072-4763-a1d8-f5444f421501 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:32.540123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ede2881f-0072-4763-a1d8-f5444f421501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:32.554147 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 817/1642] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:32.558300 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7aa6bd-d390-45ef-9689-42a19b1f8c78 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:32.571927 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7aa6bd-d390-45ef-9689-42a19b1f8c78 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:32.587674 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e062d-cc19-4e95-ae44-83f01ca1d423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:32.588354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e062d-cc19-4e95-ae44-83f01ca1d423 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:32.588634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e062d-cc19-4e95-ae44-83f01ca1d423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:32.589088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e062d-cc19-4e95-ae44-83f01ca1d423 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:32.590193 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e062d-cc19-4e95-ae44-83f01ca1d423 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:32.590657 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e062d-cc19-4e95-ae44-83f01ca1d423 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:32.593022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e062d-cc19-4e95-ae44-83f01ca1d423 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:32.621842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 826/1643] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:32.624036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2881f-0072-4763-a1d8-f5444f421501 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:32.650509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede2881f-0072-4763-a1d8-f5444f421501 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:32.663856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cca41-06ae-46c4-9aeb-a704636c74de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:32.664651 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cca41-06ae-46c4-9aeb-a704636c74de admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:32.666013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cca41-06ae-46c4-9aeb-a704636c74de admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:32.666400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675cca41-06ae-46c4-9aeb-a704636c74de admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:32.667655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cca41-06ae-46c4-9aeb-a704636c74de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:32.674737 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675cca41-06ae-46c4-9aeb-a704636c74de admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:32.861681 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 818/1644] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:32 2022] POST /identity/v3/projects => generated 355 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:32.865374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e062d-cc19-4e95-ae44-83f01ca1d423 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:32.913337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e062d-cc19-4e95-ae44-83f01ca1d423 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.042231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ce48d-c452-46c7-9497-4fedc7d3903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.044547 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ce48d-c452-46c7-9497-4fedc7d3903d admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.045166 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ce48d-c452-46c7-9497-4fedc7d3903d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.045657 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ce48d-c452-46c7-9497-4fedc7d3903d admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.046906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ce48d-c452-46c7-9497-4fedc7d3903d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.051668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ce48d-c452-46c7-9497-4fedc7d3903d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.158865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 827/1645] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:32 2022] POST /identity/v3/users => generated 278 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:33.160323 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cca41-06ae-46c4-9aeb-a704636c74de admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.171561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675cca41-06ae-46c4-9aeb-a704636c74de admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.200179 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa91b9-92b6-4fc6-9777-681b68234a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.201156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa91b9-92b6-4fc6-9777-681b68234a47 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.201414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa91b9-92b6-4fc6-9777-681b68234a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.201921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aa91b9-92b6-4fc6-9777-681b68234a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.202728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa91b9-92b6-4fc6-9777-681b68234a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.204634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aa91b9-92b6-4fc6-9777-681b68234a47 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.224686 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 819/1646] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:33.228956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ce48d-c452-46c7-9497-4fedc7d3903d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.263152 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ce48d-c452-46c7-9497-4fedc7d3903d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.276945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd37b3-8d26-449f-9bac-d2efb4bbe794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.277999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd37b3-8d26-449f-9bac-d2efb4bbe794 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.277999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd37b3-8d26-449f-9bac-d2efb4bbe794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.278201 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd37b3-8d26-449f-9bac-d2efb4bbe794 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.278755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd37b3-8d26-449f-9bac-d2efb4bbe794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.280394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd37b3-8d26-449f-9bac-d2efb4bbe794 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.307411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 828/1647] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:33.311296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa91b9-92b6-4fc6-9777-681b68234a47 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.328025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aa91b9-92b6-4fc6-9777-681b68234a47 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.357983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e5eff3-67f8-4d2f-98cf-5edb98284d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.365985 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5eff3-67f8-4d2f-98cf-5edb98284d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.366619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5eff3-67f8-4d2f-98cf-5edb98284d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.366904 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e5eff3-67f8-4d2f-98cf-5edb98284d13 admin admin] PATH_INFO: `/v3/projects/320f7c0486a54b1fad4571e0642ee66d/users/19a77cdc5b5c4257b7852c8b8b48e31d/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.400311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5eff3-67f8-4d2f-98cf-5edb98284d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=320f7c0486a54b1fad4571e0642ee66d, user_id=19a77cdc5b5c4257b7852c8b8b48e31d, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.403774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e5eff3-67f8-4d2f-98cf-5edb98284d13 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:33.496120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 820/1648] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:33 2022] PUT /identity/v3/projects/320f7c0486a54b1fad4571e0642ee66d/users/19a77cdc5b5c4257b7852c8b8b48e31d/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:33.500496 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107265-9501-4742-b513-27274880bc91 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.500789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107265-9501-4742-b513-27274880bc91 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.501069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9107265-9501-4742-b513-27274880bc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.570266 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:33.581068 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a9107265-9501-4742-b513-27274880bc91 None None] MFA Rules not processed for user `19a77cdc5b5c4257b7852c8b8b48e31d`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:33.582341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a9107265-9501-4742-b513-27274880bc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:33.759344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2a3c7-057d-44f5-852b-46ca2803ae52 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.759976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2a3c7-057d-44f5-852b-46ca2803ae52 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.760453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2a3c7-057d-44f5-852b-46ca2803ae52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.765168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 829/1649] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:33 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:33.769612 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9107265-9501-4742-b513-27274880bc91 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:33.819706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-75f2a3c7-057d-44f5-852b-46ca2803ae52 None None] MFA Rules not processed for user `e43850b81fe444659273aa88cfeec0be`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:33.821710 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-75f2a3c7-057d-44f5-852b-46ca2803ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:33.947823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9107265-9501-4742-b513-27274880bc91 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:33.971195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c039f3-97fb-439e-99bc-fbab29e07e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:33.971874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c039f3-97fb-439e-99bc-fbab29e07e7f admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:33.976416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c039f3-97fb-439e-99bc-fbab29e07e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:33.976416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c039f3-97fb-439e-99bc-fbab29e07e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:33.976416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c039f3-97fb-439e-99bc-fbab29e07e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:33.978173 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c039f3-97fb-439e-99bc-fbab29e07e7f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:34.045649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 821/1650] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:33 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:34.074451 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2a3c7-057d-44f5-852b-46ca2803ae52 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:34.076565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-75f2a3c7-057d-44f5-852b-46ca2803ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:34.104762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2a3c7-057d-44f5-852b-46ca2803ae52 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:34.113031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeac75e-70eb-4309-b715-f93abd648ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:34.113969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeac75e-70eb-4309-b715-f93abd648ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:34.114416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeac75e-70eb-4309-b715-f93abd648ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:34.114824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeac75e-70eb-4309-b715-f93abd648ace admin admin] PATH_INFO: `/v3/users/1f99c70aded147dd9373a5f03b63063a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:34.117012 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeac75e-70eb-4309-b715-f93abd648ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f99c70aded147dd9373a5f03b63063a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:34.125887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeac75e-70eb-4309-b715-f93abd648ace admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:34.192978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 830/1651] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:33 2022] POST /identity/v3/projects => generated 351 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:08:34.196470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c039f3-97fb-439e-99bc-fbab29e07e7f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:34.328169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c039f3-97fb-439e-99bc-fbab29e07e7f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:34.337393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6a63f-ade6-4602-9af3-f603840a68e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:34.339894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a63f-ade6-4602-9af3-f603840a68e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:34.340552 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a63f-ade6-4602-9af3-f603840a68e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:34.341370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b6a63f-ade6-4602-9af3-f603840a68e2 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:34.343416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6a63f-ade6-4602-9af3-f603840a68e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:34.346176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b6a63f-ade6-4602-9af3-f603840a68e2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:34.440463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-baeac75e-70eb-4309-b715-f93abd648ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f99c70aded147dd9373a5f03b63063a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:34.456929 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 831/1652] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:34 2022] POST /identity/v3/users => generated 282 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:34.461312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6a63f-ade6-4602-9af3-f603840a68e2 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:34.473691 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:34.499031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b6a63f-ade6-4602-9af3-f603840a68e2 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:34.511597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-baeac75e-70eb-4309-b715-f93abd648ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f99c70aded147dd9373a5f03b63063a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:34.520160 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-baeac75e-70eb-4309-b715-f93abd648ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f99c70aded147dd9373a5f03b63063a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:34.521301 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-baeac75e-70eb-4309-b715-f93abd648ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f99c70aded147dd9373a5f03b63063a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:34.528281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec18c3-4a5d-4b3a-81bf-8c0c7b41607a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:34.528929 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec18c3-4a5d-4b3a-81bf-8c0c7b41607a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:34.529215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec18c3-4a5d-4b3a-81bf-8c0c7b41607a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:34.531029 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ec18c3-4a5d-4b3a-81bf-8c0c7b41607a admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:34.533122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec18c3-4a5d-4b3a-81bf-8c0c7b41607a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:34.534785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ec18c3-4a5d-4b3a-81bf-8c0c7b41607a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:34.551595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-baeac75e-70eb-4309-b715-f93abd648ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f99c70aded147dd9373a5f03b63063a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:34.581529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 832/1653] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:34.582851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec18c3-4a5d-4b3a-81bf-8c0c7b41607a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:34.586634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-77ec18c3-4a5d-4b3a-81bf-8c0c7b41607a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:34.619043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ec18c3-4a5d-4b3a-81bf-8c0c7b41607a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:34.634436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a71d3-c386-40f4-a4f6-c6df8c64e568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:34.635090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a71d3-c386-40f4-a4f6-c6df8c64e568 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:34.635381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a71d3-c386-40f4-a4f6-c6df8c64e568 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:34.635661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a71d3-c386-40f4-a4f6-c6df8c64e568 admin admin] PATH_INFO: `/v3/projects/4eeb0637d2fc4a1180fbc71ca3e83a6b/users/7bec5383fe984de88c2fc0dedda55dea/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:34.667740 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:34.675222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a71d3-c386-40f4-a4f6-c6df8c64e568 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eeb0637d2fc4a1180fbc71ca3e83a6b, user_id=7bec5383fe984de88c2fc0dedda55dea, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:34.678141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a71d3-c386-40f4-a4f6-c6df8c64e568 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:34.729180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 822/1654] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:34 2022] DELETE /identity/v3/users/1f99c70aded147dd9373a5f03b63063a => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:34.729180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95da0a0-9291-4e22-88c0-0efd222229f4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:34.729180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95da0a0-9291-4e22-88c0-0efd222229f4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:34.729180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95da0a0-9291-4e22-88c0-0efd222229f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:34.754901 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f95da0a0-9291-4e22-88c0-0efd222229f4 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:34.758850 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f95da0a0-9291-4e22-88c0-0efd222229f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:34.827731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 833/1655] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:34 2022] PUT /identity/v3/projects/4eeb0637d2fc4a1180fbc71ca3e83a6b/users/7bec5383fe984de88c2fc0dedda55dea/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:08:34.832008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a71d3-c386-40f4-a4f6-c6df8c64e568 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:34.895593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 823/1656] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:34.965788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a71d3-c386-40f4-a4f6-c6df8c64e568 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:34.973466 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f08d4-bf75-4f28-9403-dccea58f34f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:34.974443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f08d4-bf75-4f28-9403-dccea58f34f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:34.974871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f08d4-bf75-4f28-9403-dccea58f34f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:34.975291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f08d4-bf75-4f28-9403-dccea58f34f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:34.977095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f08d4-bf75-4f28-9403-dccea58f34f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:34.980593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95da0a0-9291-4e22-88c0-0efd222229f4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:34.984270 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f95da0a0-9291-4e22-88c0-0efd222229f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:34.995723 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f08d4-bf75-4f28-9403-dccea58f34f3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:35.034389 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 834/1657] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:35.036675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f08d4-bf75-4f28-9403-dccea58f34f3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:35.070300 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f08d4-bf75-4f28-9403-dccea58f34f3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:35.089768 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a840c6-a89b-49fa-8c73-6cbacccb1e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:35.092036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a840c6-a89b-49fa-8c73-6cbacccb1e24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:35.092638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a840c6-a89b-49fa-8c73-6cbacccb1e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:35.093979 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a840c6-a89b-49fa-8c73-6cbacccb1e24 admin admin] PATH_INFO: `/v3/projects/4eeb0637d2fc4a1180fbc71ca3e83a6b/users/7bec5383fe984de88c2fc0dedda55dea/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:35.102755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a840c6-a89b-49fa-8c73-6cbacccb1e24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4eeb0637d2fc4a1180fbc71ca3e83a6b, user_id=7bec5383fe984de88c2fc0dedda55dea, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:35.107402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a840c6-a89b-49fa-8c73-6cbacccb1e24 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:35.138248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 835/1658] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:35 2022] PUT /identity/v3/projects/4eeb0637d2fc4a1180fbc71ca3e83a6b/users/7bec5383fe984de88c2fc0dedda55dea/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:35.141879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa4926-bf4a-41f6-9de3-82974b3b0415 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:35.142276 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa4926-bf4a-41f6-9de3-82974b3b0415 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:35.142740 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fa4926-bf4a-41f6-9de3-82974b3b0415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:35.188921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95da0a0-9291-4e22-88c0-0efd222229f4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:35.252970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-73fa4926-bf4a-41f6-9de3-82974b3b0415 None None] MFA Rules not processed for user `7bec5383fe984de88c2fc0dedda55dea`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:35.261450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-73fa4926-bf4a-41f6-9de3-82974b3b0415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:35.353869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038783be-8d6e-41bd-9fc0-18e1ec045a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:35.354924 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038783be-8d6e-41bd-9fc0-18e1ec045a7d service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:35.355231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038783be-8d6e-41bd-9fc0-18e1ec045a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:35.355494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038783be-8d6e-41bd-9fc0-18e1ec045a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:35.517787 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 836/1659] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:35 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:35.528664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa4926-bf4a-41f6-9de3-82974b3b0415 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:35.530131 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-73fa4926-bf4a-41f6-9de3-82974b3b0415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:35.555017 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038783be-8d6e-41bd-9fc0-18e1ec045a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:35.568314 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038783be-8d6e-41bd-9fc0-18e1ec045a7d service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:35.590478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 824/1660] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 610 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:35.675160 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fa4926-bf4a-41f6-9de3-82974b3b0415 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:35.682768 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adac1459-011c-4b62-8ef5-9fbc23a4a15a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:35.683690 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac1459-011c-4b62-8ef5-9fbc23a4a15a service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:35.684144 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac1459-011c-4b62-8ef5-9fbc23a4a15a service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:35.684566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adac1459-011c-4b62-8ef5-9fbc23a4a15a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:35.700315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:35.711943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac1459-011c-4b62-8ef5-9fbc23a4a15a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:35.713717 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adac1459-011c-4b62-8ef5-9fbc23a4a15a service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:35.738519 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 837/1661] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:35 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:35.778824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:36.079906 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038783be-8d6e-41bd-9fc0-18e1ec045a7d service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:36.094602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038783be-8d6e-41bd-9fc0-18e1ec045a7d service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:36.104122 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e4260-7c76-4524-b027-99c62617fec4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:36.105115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e4260-7c76-4524-b027-99c62617fec4 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:36.105742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e4260-7c76-4524-b027-99c62617fec4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:36.106276 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e4260-7c76-4524-b027-99c62617fec4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:36.109809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6e2e4260-7c76-4524-b027-99c62617fec4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:36.230096 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e4260-7c76-4524-b027-99c62617fec4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:36.231761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e4260-7c76-4524-b027-99c62617fec4 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:36.259107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 825/1662] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:36 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:36.857754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0327d0f-7801-4e80-872c-4a4044e4181e None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:36.858305 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0327d0f-7801-4e80-872c-4a4044e4181e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:36.858481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0327d0f-7801-4e80-872c-4a4044e4181e None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:36.860192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 838/1663] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 24 08:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:08:36.908884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c54a0-a99d-4b00-a7b2-ccd22f8be8e5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:36.913892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c54a0-a99d-4b00-a7b2-ccd22f8be8e5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:36.913892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c54a0-a99d-4b00-a7b2-ccd22f8be8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:36.951835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4d5c54a0-a99d-4b00-a7b2-ccd22f8be8e5 None None] MFA Rules not processed for user `d213e29685f3402b804d4d8fbc88ba96`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:36.953522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4d5c54a0-a99d-4b00-a7b2-ccd22f8be8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:37.088907 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 826/1664] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 24 08:08:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:37.116859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a897a7-902d-414b-995e-c6335a361a83 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.117353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a897a7-902d-414b-995e-c6335a361a83 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.119383 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a897a7-902d-414b-995e-c6335a361a83 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.121797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 839/1665] 10.222.0.62 () {54 vars in 961 bytes} [Wed Aug 24 08:08:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:08:37.129469 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70bd5c-ea63-4264-9f4b-1f16be3ccd81 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.130135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70bd5c-ea63-4264-9f4b-1f16be3ccd81 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.130545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70bd5c-ea63-4264-9f4b-1f16be3ccd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.158519 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4d70bd5c-ea63-4264-9f4b-1f16be3ccd81 None None] MFA Rules not processed for user `d213e29685f3402b804d4d8fbc88ba96`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:37.161482 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4d70bd5c-ea63-4264-9f4b-1f16be3ccd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:37.179354 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 827/1666] 10.222.0.62 () {58 vars in 1058 bytes} [Wed Aug 24 08:08:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:37.187478 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a897a7-902d-414b-995e-c6335a361a83 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:37.215483 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a897a7-902d-414b-995e-c6335a361a83 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:37.230658 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809b50d-ba7f-4e12-92b3-bfae5f800a69 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213e29685f3402b804d4d8fbc88ba96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:37.231231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809b50d-ba7f-4e12-92b3-bfae5f800a69 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.232741 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809b50d-ba7f-4e12-92b3-bfae5f800a69 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.233213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6809b50d-ba7f-4e12-92b3-bfae5f800a69 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.260375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809b50d-ba7f-4e12-92b3-bfae5f800a69 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:37.262124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6809b50d-ba7f-4e12-92b3-bfae5f800a69 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:37.304514 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 840/1667] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:37.866920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce91f0-f5c7-45c2-bbb9-a78937ab0f6c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:37.868030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce91f0-f5c7-45c2-bbb9-a78937ab0f6c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:37.868584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce91f0-f5c7-45c2-bbb9-a78937ab0f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:37.928109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-65ce91f0-f5c7-45c2-bbb9-a78937ab0f6c None None] MFA Rules not processed for user `8e9558f071244924926df0fe80d3259a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:37.929894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-65ce91f0-f5c7-45c2-bbb9-a78937ab0f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:37.962254 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809b50d-ba7f-4e12-92b3-bfae5f800a69 service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:37.964069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6809b50d-ba7f-4e12-92b3-bfae5f800a69 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:37.991796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6809b50d-ba7f-4e12-92b3-bfae5f800a69 service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.003226 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f778705-2de2-4171-b914-4b19230ef92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.004961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f778705-2de2-4171-b914-4b19230ef92a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.005866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f778705-2de2-4171-b914-4b19230ef92a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.006373 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f778705-2de2-4171-b914-4b19230ef92a admin admin] PATH_INFO: `/v3/users/108dfbd365a4455e83e5eebb799ef005` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.010934 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f778705-2de2-4171-b914-4b19230ef92a admin admin] RBAC: Authorizing `identity:delete_user(user_id=108dfbd365a4455e83e5eebb799ef005)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.015464 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f778705-2de2-4171-b914-4b19230ef92a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.055114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:38.079090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 828/1668] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:38.091581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce91f0-f5c7-45c2-bbb9-a78937ab0f6c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:38.093645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-65ce91f0-f5c7-45c2-bbb9-a78937ab0f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:38.111222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce91f0-f5c7-45c2-bbb9-a78937ab0f6c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.117216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:38.120247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.120247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.120247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] PATH_INFO: `/v3/projects/5d3b994a91da4215af01b0b42dec9e52` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.120953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d3b994a91da4215af01b0b42dec9e52)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:38.124570 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:38.340774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4f778705-2de2-4171-b914-4b19230ef92a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '108dfbd365a4455e83e5eebb799ef005'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:38.353964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4f778705-2de2-4171-b914-4b19230ef92a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '108dfbd365a4455e83e5eebb799ef005'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:38.356112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4f778705-2de2-4171-b914-4b19230ef92a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '108dfbd365a4455e83e5eebb799ef005'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:38.362063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d3b994a91da4215af01b0b42dec9e52', 'request_id': 'req-a763745f-49e8-4ae3-987d-25f808d8c43d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:38.375564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4f778705-2de2-4171-b914-4b19230ef92a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '108dfbd365a4455e83e5eebb799ef005'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:38.387613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d3b994a91da4215af01b0b42dec9e52', 'request_id': 'req-a763745f-49e8-4ae3-987d-25f808d8c43d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:38.417424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d3b994a91da4215af01b0b42dec9e52', 'request_id': 'req-a763745f-49e8-4ae3-987d-25f808d8c43d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:38.429697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4f778705-2de2-4171-b914-4b19230ef92a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '108dfbd365a4455e83e5eebb799ef005'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:38.506334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] The token cache is being invalidate because project 5d3b994a91da4215af01b0b42dec9e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:38.509486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:38.509486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:38.512327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 829/1669] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:38 2022] DELETE /identity/v3/projects/5d3b994a91da4215af01b0b42dec9e52 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:38.513497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:38.520695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:38.609223 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 841/1670] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:37 2022] DELETE /identity/v3/users/108dfbd365a4455e83e5eebb799ef005 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:38.609223 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debfb63-21d6-40cc-97b8-a6e42d258435 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.609891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debfb63-21d6-40cc-97b8-a6e42d258435 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.610241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5debfb63-21d6-40cc-97b8-a6e42d258435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.721493 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5debfb63-21d6-40cc-97b8-a6e42d258435 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:38.733195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5debfb63-21d6-40cc-97b8-a6e42d258435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:38.871544 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763745f-49e8-4ae3-987d-25f808d8c43d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:38.891471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 842/1671] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:38.891471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b08fd-cc52-4a8a-9b3c-f8bab8c7de59 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:38.891471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b08fd-cc52-4a8a-9b3c-f8bab8c7de59 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:38.891471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0b08fd-cc52-4a8a-9b3c-f8bab8c7de59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:38.932101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fe0b08fd-cc52-4a8a-9b3c-f8bab8c7de59 None None] MFA Rules not processed for user `cd7e2148a240426b925e49b8e1b48156`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:38.934477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fe0b08fd-cc52-4a8a-9b3c-f8bab8c7de59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:39.032276 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b73016-5977-4156-816c-a651210cbdd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:39.033162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b73016-5977-4156-816c-a651210cbdd8 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:39.033463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b73016-5977-4156-816c-a651210cbdd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:39.033727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b73016-5977-4156-816c-a651210cbdd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:39.040762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e5b73016-5977-4156-816c-a651210cbdd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:39.058293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:39.082824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:39.121213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 843/1672] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:38 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:39.123232 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d5fe7-39b9-40af-bd29-4836dfa8f502 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:39.123638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d5fe7-39b9-40af-bd29-4836dfa8f502 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:39.123837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38d5fe7-39b9-40af-bd29-4836dfa8f502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:39.173247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b38d5fe7-39b9-40af-bd29-4836dfa8f502 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:39.177342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b38d5fe7-39b9-40af-bd29-4836dfa8f502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:39.196896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 844/1673] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:39.198212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912985f-1d74-443b-b0fc-4de776903172 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:39.199260 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912985f-1d74-443b-b0fc-4de776903172 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:39.199681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e912985f-1d74-443b-b0fc-4de776903172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:39.240395 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b73016-5977-4156-816c-a651210cbdd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:39.241774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b73016-5977-4156-816c-a651210cbdd8 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:39.249507 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e912985f-1d74-443b-b0fc-4de776903172 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:39.255602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e912985f-1d74-443b-b0fc-4de776903172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:39.271160 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 830/1674] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 758 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:39.277889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 845/1675] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:39.279527 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912985f-1d74-443b-b0fc-4de776903172 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:39.284981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e912985f-1d74-443b-b0fc-4de776903172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:39.287180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b846d-6848-4862-8786-8cf4f2a58461 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:39.287620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b846d-6848-4862-8786-8cf4f2a58461 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:39.292524 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b846d-6848-4862-8786-8cf4f2a58461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:39.409283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-698b846d-6848-4862-8786-8cf4f2a58461 None None] MFA Rules not processed for user `cd7e2148a240426b925e49b8e1b48156`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:39.411753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-698b846d-6848-4862-8786-8cf4f2a58461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:39.433320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 831/1676] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:39.434571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b846d-6848-4862-8786-8cf4f2a58461 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:39.448914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e912985f-1d74-443b-b0fc-4de776903172 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:39.456413 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438abb1b-939b-49ee-9d01-e6fc88c7ee42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:39.457198 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438abb1b-939b-49ee-9d01-e6fc88c7ee42 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:39.458004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b846d-6848-4862-8786-8cf4f2a58461 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:39.458162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438abb1b-939b-49ee-9d01-e6fc88c7ee42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:39.458456 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438abb1b-939b-49ee-9d01-e6fc88c7ee42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:39.476544 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95661d1f-0c7d-41a2-99b5-165bc019f60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:39.477428 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95661d1f-0c7d-41a2-99b5-165bc019f60a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:39.477850 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95661d1f-0c7d-41a2-99b5-165bc019f60a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:39.478301 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95661d1f-0c7d-41a2-99b5-165bc019f60a admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:39.479419 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95661d1f-0c7d-41a2-99b5-165bc019f60a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:39.479903 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95661d1f-0c7d-41a2-99b5-165bc019f60a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:39.481850 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95661d1f-0c7d-41a2-99b5-165bc019f60a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:39.495247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438abb1b-939b-49ee-9d01-e6fc88c7ee42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:39.502212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438abb1b-939b-49ee-9d01-e6fc88c7ee42 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:39.528432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 832/1677] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:39.529469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 846/1678] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:39.533480 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95661d1f-0c7d-41a2-99b5-165bc019f60a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:39.539197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438abb1b-939b-49ee-9d01-e6fc88c7ee42 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:39.541823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-95661d1f-0c7d-41a2-99b5-165bc019f60a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:39.566179 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438abb1b-939b-49ee-9d01-e6fc88c7ee42 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:39.577310 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00347988-71d4-4ec9-a843-becf12921b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:39.579355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00347988-71d4-4ec9-a843-becf12921b90 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:39.579654 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00347988-71d4-4ec9-a843-becf12921b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:39.580352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00347988-71d4-4ec9-a843-becf12921b90 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:39.581011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00347988-71d4-4ec9-a843-becf12921b90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:39.586392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00347988-71d4-4ec9-a843-becf12921b90 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:39.594458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95661d1f-0c7d-41a2-99b5-165bc019f60a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:39.631589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e5d3b-4680-460b-835f-76c0fea09a04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:39.633141 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e5d3b-4680-460b-835f-76c0fea09a04 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:39.634367 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e5d3b-4680-460b-835f-76c0fea09a04 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:39.636145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e5d3b-4680-460b-835f-76c0fea09a04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:39.656652 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e5d3b-4680-460b-835f-76c0fea09a04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:39.674379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e5d3b-4680-460b-835f-76c0fea09a04 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:39.720392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 833/1679] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:39 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:39.774927 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 847/1680] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:39 2022] POST /identity/v3/projects => generated 363 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:39.782823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e5d3b-4680-460b-835f-76c0fea09a04 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:39.813472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e5d3b-4680-460b-835f-76c0fea09a04 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:39.947016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da05e0-fb1f-4f09-8fb1-59363807d7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:39.948912 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da05e0-fb1f-4f09-8fb1-59363807d7e1 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:39.949199 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da05e0-fb1f-4f09-8fb1-59363807d7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:39.949483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03da05e0-fb1f-4f09-8fb1-59363807d7e1 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:39.950128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da05e0-fb1f-4f09-8fb1-59363807d7e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:39.957018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03da05e0-fb1f-4f09-8fb1-59363807d7e1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:39.997450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c45da-4bb5-4a24-a0a9-cefbe2493eeb None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:39.997755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c45da-4bb5-4a24-a0a9-cefbe2493eeb None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:39.999167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c45da-4bb5-4a24-a0a9-cefbe2493eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:40.086806 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-891c45da-4bb5-4a24-a0a9-cefbe2493eeb None None] MFA Rules not processed for user `68ee993e0aab4f988751a8b1bf11346c`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:40.089314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-891c45da-4bb5-4a24-a0a9-cefbe2493eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:40.097156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 834/1681] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:39 2022] POST /identity/v3/users => generated 282 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:40.098838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da05e0-fb1f-4f09-8fb1-59363807d7e1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:40.117234 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03da05e0-fb1f-4f09-8fb1-59363807d7e1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:40.131891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b9fc1-1b80-44e0-a042-3baa57a878f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:40.132556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b9fc1-1b80-44e0-a042-3baa57a878f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:40.132830 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b9fc1-1b80-44e0-a042-3baa57a878f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:40.133105 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22b9fc1-1b80-44e0-a042-3baa57a878f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:40.133764 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b9fc1-1b80-44e0-a042-3baa57a878f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:40.137390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22b9fc1-1b80-44e0-a042-3baa57a878f7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:40.166996 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 835/1682] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:08:40.170310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b9fc1-1b80-44e0-a042-3baa57a878f7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:40.201936 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22b9fc1-1b80-44e0-a042-3baa57a878f7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:40.220282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9de7d-5734-4628-998c-dcdcf9fae8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:40.220912 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9de7d-5734-4628-998c-dcdcf9fae8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:40.221196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9de7d-5734-4628-998c-dcdcf9fae8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:40.222067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c9de7d-5734-4628-998c-dcdcf9fae8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:40.222163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9de7d-5734-4628-998c-dcdcf9fae8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:40.223877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c9de7d-5734-4628-998c-dcdcf9fae8a9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:40.245821 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 848/1683] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:40.260712 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 836/1684] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:40.265279 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f4185-0c2b-4d91-8d60-61062fc8edcc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:40.265576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f4185-0c2b-4d91-8d60-61062fc8edcc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:40.265858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f4185-0c2b-4d91-8d60-61062fc8edcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:40.266532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9de7d-5734-4628-998c-dcdcf9fae8a9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:40.293372 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-399f4185-0c2b-4d91-8d60-61062fc8edcc None None] MFA Rules not processed for user `68ee993e0aab4f988751a8b1bf11346c`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:40.295018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-399f4185-0c2b-4d91-8d60-61062fc8edcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:40.322276 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 849/1685] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:40.325663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c9de7d-5734-4628-998c-dcdcf9fae8a9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:40.331413 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f4185-0c2b-4d91-8d60-61062fc8edcc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:40.350856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa7c30-3c6e-4fab-9085-544ce2068826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:40.351550 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa7c30-3c6e-4fab-9085-544ce2068826 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:40.351822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa7c30-3c6e-4fab-9085-544ce2068826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:40.352283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa7c30-3c6e-4fab-9085-544ce2068826 admin admin] PATH_INFO: `/v3/projects/cc4e844639564937ae84ab5f9955967d/users/80a5e9b85a5f406fba0653fa077b0c5e/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:40.400673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa7c30-3c6e-4fab-9085-544ce2068826 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc4e844639564937ae84ab5f9955967d, user_id=80a5e9b85a5f406fba0653fa077b0c5e, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:40.403341 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa7c30-3c6e-4fab-9085-544ce2068826 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:40.410017 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:40.492707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f4185-0c2b-4d91-8d60-61062fc8edcc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:40.503370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce9641-f5e9-44da-8dd5-e9b23a243a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:40.504169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce9641-f5e9-44da-8dd5-e9b23a243a8b service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:40.504521 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce9641-f5e9-44da-8dd5-e9b23a243a8b service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:40.504972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce9641-f5e9-44da-8dd5-e9b23a243a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:40.507432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 837/1686] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:40 2022] PUT /identity/v3/projects/cc4e844639564937ae84ab5f9955967d/users/80a5e9b85a5f406fba0653fa077b0c5e/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:40.516716 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce9641-f5e9-44da-8dd5-e9b23a243a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:40.517386 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410c98-2ed0-4caf-9644-8030c1077e58 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:40.517675 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410c98-2ed0-4caf-9644-8030c1077e58 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:40.517947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66410c98-2ed0-4caf-9644-8030c1077e58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:40.518591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce9641-f5e9-44da-8dd5-e9b23a243a8b service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:40.545335 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 850/1687] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:40 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:40.549015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-66410c98-2ed0-4caf-9644-8030c1077e58 None None] MFA Rules not processed for user `80a5e9b85a5f406fba0653fa077b0c5e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:40.550551 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-66410c98-2ed0-4caf-9644-8030c1077e58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:40.565062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:40.693175 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce9641-f5e9-44da-8dd5-e9b23a243a8b service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:40.696002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-42ce9641-f5e9-44da-8dd5-e9b23a243a8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:40.699706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 838/1688] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:08:40.700824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66410c98-2ed0-4caf-9644-8030c1077e58 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:40.721794 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce9641-f5e9-44da-8dd5-e9b23a243a8b service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:40.870868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66410c98-2ed0-4caf-9644-8030c1077e58 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:40.883995 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98469f1b-7350-4bc6-b38d-27d13138d870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:40.884669 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98469f1b-7350-4bc6-b38d-27d13138d870 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:40.884989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98469f1b-7350-4bc6-b38d-27d13138d870 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:40.885243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98469f1b-7350-4bc6-b38d-27d13138d870 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:40.885892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98469f1b-7350-4bc6-b38d-27d13138d870 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:40.890238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98469f1b-7350-4bc6-b38d-27d13138d870 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:40.902321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd50fb4a-7507-47f3-bd76-c2da30ce1aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:40.902994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50fb4a-7507-47f3-bd76-c2da30ce1aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:40.903258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50fb4a-7507-47f3-bd76-c2da30ce1aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:40.903531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd50fb4a-7507-47f3-bd76-c2da30ce1aeb admin admin] PATH_INFO: `/v3/users/819d5835d9dc4406b2c666e10736e95e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:40.906485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50fb4a-7507-47f3-bd76-c2da30ce1aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=819d5835d9dc4406b2c666e10736e95e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:40.908653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd50fb4a-7507-47f3-bd76-c2da30ce1aeb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:41.047794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 839/1689] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:40 2022] POST /identity/v3/projects => generated 363 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:08:41.052609 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98469f1b-7350-4bc6-b38d-27d13138d870 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:41.187213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98469f1b-7350-4bc6-b38d-27d13138d870 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:41.204145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6daf256-20c1-4e32-b202-9e799e27ed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:41.205108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daf256-20c1-4e32-b202-9e799e27ed51 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:41.205510 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daf256-20c1-4e32-b202-9e799e27ed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:41.205880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6daf256-20c1-4e32-b202-9e799e27ed51 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:41.206618 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6daf256-20c1-4e32-b202-9e799e27ed51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:41.208878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6daf256-20c1-4e32-b202-9e799e27ed51 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:41.211275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fd50fb4a-7507-47f3-bd76-c2da30ce1aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '819d5835d9dc4406b2c666e10736e95e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:41.212275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fd50fb4a-7507-47f3-bd76-c2da30ce1aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '819d5835d9dc4406b2c666e10736e95e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:41.213601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fd50fb4a-7507-47f3-bd76-c2da30ce1aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '819d5835d9dc4406b2c666e10736e95e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:41.239724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fd50fb4a-7507-47f3-bd76-c2da30ce1aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '819d5835d9dc4406b2c666e10736e95e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:41.278265 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fd50fb4a-7507-47f3-bd76-c2da30ce1aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '819d5835d9dc4406b2c666e10736e95e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:41.403375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 851/1690] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:40 2022] DELETE /identity/v3/users/819d5835d9dc4406b2c666e10736e95e => generated 0 bytes in 711 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:08:41.404769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b1318-8046-42b6-ad27-b832b25600c3 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:41.406138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b1318-8046-42b6-ad27-b832b25600c3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:41.406138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0b1318-8046-42b6-ad27-b832b25600c3 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:41.408482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 852/1691] 10.222.0.62 () {54 vars in 912 bytes} [Wed Aug 24 08:08:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:08:41.408823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 840/1692] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:41 2022] POST /identity/v3/users => generated 288 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:41.413717 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a31f57-ca96-4386-9f8d-b242c11bc25b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:41.414096 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a31f57-ca96-4386-9f8d-b242c11bc25b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:41.414378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a31f57-ca96-4386-9f8d-b242c11bc25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:41.414749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b1318-8046-42b6-ad27-b832b25600c3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:41.420566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0a0b1318-8046-42b6-ad27-b832b25600c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:41.500828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-32a31f57-ca96-4386-9f8d-b242c11bc25b None None] MFA Rules not processed for user `f49116f202774e4da0c96875ffa08288`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:41.503334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-32a31f57-ca96-4386-9f8d-b242c11bc25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:41.574350 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0b1318-8046-42b6-ad27-b832b25600c3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:41.589116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e55657-8172-40cd-92a9-0210f1654442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:41.589713 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e55657-8172-40cd-92a9-0210f1654442 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:41.589999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e55657-8172-40cd-92a9-0210f1654442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:41.590277 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e55657-8172-40cd-92a9-0210f1654442 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:41.590947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e55657-8172-40cd-92a9-0210f1654442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:41.595215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e55657-8172-40cd-92a9-0210f1654442 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:41.616173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 841/1693] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:08:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:08:41.618230 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 853/1694] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:41.618840 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba072-2f34-4535-ad62-bfe64382b8fe None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:41.619171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba072-2f34-4535-ad62-bfe64382b8fe None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:41.619509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ba072-2f34-4535-ad62-bfe64382b8fe None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:41.621931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 842/1695] 10.222.0.62 () {54 vars in 912 bytes} [Wed Aug 24 08:08:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:08:41.626766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e55657-8172-40cd-92a9-0210f1654442 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:41.628773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa893464-18dd-41b1-a50d-2e7689a9c041 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:41.629063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa893464-18dd-41b1-a50d-2e7689a9c041 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:41.629340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa893464-18dd-41b1-a50d-2e7689a9c041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:41.638290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e55657-8172-40cd-92a9-0210f1654442 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:41.644278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08e0ad-68e6-4936-a7cf-a77667c14678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:41.645059 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08e0ad-68e6-4936-a7cf-a77667c14678 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:41.645345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08e0ad-68e6-4936-a7cf-a77667c14678 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:41.645714 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e08e0ad-68e6-4936-a7cf-a77667c14678 admin admin] PATH_INFO: `/v3/projects/a6b0669d0275499bbbfdc8cd1625f6d5/users/c90a9a7c5d3a433aa9952a48a7d2dc92/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:41.696081 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08e0ad-68e6-4936-a7cf-a77667c14678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b0669d0275499bbbfdc8cd1625f6d5, user_id=c90a9a7c5d3a433aa9952a48a7d2dc92, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:41.702031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e08e0ad-68e6-4936-a7cf-a77667c14678 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:41.723663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-aa893464-18dd-41b1-a50d-2e7689a9c041 None None] MFA Rules not processed for user `f49116f202774e4da0c96875ffa08288`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:41.725045 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-aa893464-18dd-41b1-a50d-2e7689a9c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:41.751421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 843/1696] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:08:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:41.753374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa893464-18dd-41b1-a50d-2e7689a9c041 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:41.754399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-aa893464-18dd-41b1-a50d-2e7689a9c041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:41.767025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa893464-18dd-41b1-a50d-2e7689a9c041 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:41.770910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc757c3d-a0c5-4505-a230-8ed0fb4b8e86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:41.771530 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc757c3d-a0c5-4505-a230-8ed0fb4b8e86 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:41.771810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc757c3d-a0c5-4505-a230-8ed0fb4b8e86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:41.773006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc757c3d-a0c5-4505-a230-8ed0fb4b8e86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:41.793904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 854/1697] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:41 2022] PUT /identity/v3/projects/a6b0669d0275499bbbfdc8cd1625f6d5/users/c90a9a7c5d3a433aa9952a48a7d2dc92/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:41.794837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08e0ad-68e6-4936-a7cf-a77667c14678 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:41.799705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3e08e0ad-68e6-4936-a7cf-a77667c14678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:41.808595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc757c3d-a0c5-4505-a230-8ed0fb4b8e86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:41.810218 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc757c3d-a0c5-4505-a230-8ed0fb4b8e86 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:41.865091 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:41.869710 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 844/1698] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:41.870287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc757c3d-a0c5-4505-a230-8ed0fb4b8e86 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:41.914315 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc757c3d-a0c5-4505-a230-8ed0fb4b8e86 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:41.983597 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e08e0ad-68e6-4936-a7cf-a77667c14678 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:41.997643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161153-977c-4930-9818-0605e240060c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:42.003199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161153-977c-4930-9818-0605e240060c service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.003199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161153-977c-4930-9818-0605e240060c service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.003199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb161153-977c-4930-9818-0605e240060c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.031051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89801c4-11e5-4a3b-a88e-1553ec8b2aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:42.031699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89801c4-11e5-4a3b-a88e-1553ec8b2aaf admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.032187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb161153-977c-4930-9818-0605e240060c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:42.033371 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89801c4-11e5-4a3b-a88e-1553ec8b2aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.033647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89801c4-11e5-4a3b-a88e-1553ec8b2aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.034302 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89801c4-11e5-4a3b-a88e-1553ec8b2aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:42.035804 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb161153-977c-4930-9818-0605e240060c service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:42.044786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89801c4-11e5-4a3b-a88e-1553ec8b2aaf admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:42.062680 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 855/1699] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:41 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:42.063713 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161153-977c-4930-9818-0605e240060c service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:42.063900 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 845/1700] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:42.065158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89801c4-11e5-4a3b-a88e-1553ec8b2aaf admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:42.071709 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bb161153-977c-4930-9818-0605e240060c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:42.080025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89801c4-11e5-4a3b-a88e-1553ec8b2aaf admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:42.086183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62711d5-118e-4ea4-bd05-f89b34a872aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:42.086868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62711d5-118e-4ea4-bd05-f89b34a872aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.087146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62711d5-118e-4ea4-bd05-f89b34a872aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.087471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62711d5-118e-4ea4-bd05-f89b34a872aa admin admin] PATH_INFO: `/v3/projects/a6b0669d0275499bbbfdc8cd1625f6d5/users/c90a9a7c5d3a433aa9952a48a7d2dc92/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.089660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62711d5-118e-4ea4-bd05-f89b34a872aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b0669d0275499bbbfdc8cd1625f6d5, user_id=c90a9a7c5d3a433aa9952a48a7d2dc92, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:42.094819 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62711d5-118e-4ea4-bd05-f89b34a872aa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:42.098909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:42.116247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb161153-977c-4930-9818-0605e240060c service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:42.133725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 846/1701] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:42 2022] PUT /identity/v3/projects/a6b0669d0275499bbbfdc8cd1625f6d5/users/c90a9a7c5d3a433aa9952a48a7d2dc92/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:42.135426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddd800-0b34-4ba1-9a39-e1a0abdc8872 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.140700 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddd800-0b34-4ba1-9a39-e1a0abdc8872 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.141156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ddd800-0b34-4ba1-9a39-e1a0abdc8872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.218362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-79ddd800-0b34-4ba1-9a39-e1a0abdc8872 None None] MFA Rules not processed for user `c90a9a7c5d3a433aa9952a48a7d2dc92`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:42.221671 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79ddd800-0b34-4ba1-9a39-e1a0abdc8872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:42.281885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fc424-b78d-4f38-8862-83bc909fe727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:42.283294 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fc424-b78d-4f38-8862-83bc909fe727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.283630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fc424-b78d-4f38-8862-83bc909fe727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.285785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fc424-b78d-4f38-8862-83bc909fe727 admin admin] PATH_INFO: `/v3/projects/1e4559063e0a44b092ed48d8dd0073d6` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.302219 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fc424-b78d-4f38-8862-83bc909fe727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e4559063e0a44b092ed48d8dd0073d6)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:42.314375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648fc424-b78d-4f38-8862-83bc909fe727 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:42.451407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 847/1702] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:42 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:42.463070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddd800-0b34-4ba1-9a39-e1a0abdc8872 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:42.466035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79ddd800-0b34-4ba1-9a39-e1a0abdc8872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:42.529734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-648fc424-b78d-4f38-8862-83bc909fe727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e4559063e0a44b092ed48d8dd0073d6', 'request_id': 'req-648fc424-b78d-4f38-8862-83bc909fe727'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:42.546751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-648fc424-b78d-4f38-8862-83bc909fe727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e4559063e0a44b092ed48d8dd0073d6', 'request_id': 'req-648fc424-b78d-4f38-8862-83bc909fe727'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:42.583321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ddd800-0b34-4ba1-9a39-e1a0abdc8872 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:42.624796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-648fc424-b78d-4f38-8862-83bc909fe727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e4559063e0a44b092ed48d8dd0073d6', 'request_id': 'req-648fc424-b78d-4f38-8862-83bc909fe727'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:42.646820 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-648fc424-b78d-4f38-8862-83bc909fe727 admin admin] The token cache is being invalidate because project 1e4559063e0a44b092ed48d8dd0073d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:42.647144 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-648fc424-b78d-4f38-8862-83bc909fe727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:42.650318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae28397-287f-4ce0-8ca6-92e98e65b730 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:42.651072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28397-287f-4ce0-8ca6-92e98e65b730 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.651449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28397-287f-4ce0-8ca6-92e98e65b730 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.651985 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae28397-287f-4ce0-8ca6-92e98e65b730 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.652326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-648fc424-b78d-4f38-8862-83bc909fe727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:42.654238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4ae28397-287f-4ce0-8ca6-92e98e65b730 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:42.655438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 856/1703] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:42 2022] DELETE /identity/v3/projects/1e4559063e0a44b092ed48d8dd0073d6 => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:42.664010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d38bf-d6e4-4e05-b0e7-57bc6e5d035a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.664452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d38bf-d6e4-4e05-b0e7-57bc6e5d035a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.664734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d38bf-d6e4-4e05-b0e7-57bc6e5d035a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.713585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c92d38bf-d6e4-4e05-b0e7-57bc6e5d035a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:42.714881 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c92d38bf-d6e4-4e05-b0e7-57bc6e5d035a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:42.896688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 857/1704] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:42.904118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae28397-287f-4ce0-8ca6-92e98e65b730 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:42.905216 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa655767-3990-4671-b47d-a874284c921d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:42.905216 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa655767-3990-4671-b47d-a874284c921d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:42.905376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa655767-3990-4671-b47d-a874284c921d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:42.905591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae28397-287f-4ce0-8ca6-92e98e65b730 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:42.930046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fa655767-3990-4671-b47d-a874284c921d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:42.932578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fa655767-3990-4671-b47d-a874284c921d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:42.950607 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 848/1705] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:42.969775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 858/1706] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:42.975276 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae28397-287f-4ce0-8ca6-92e98e65b730 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:42.997004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae28397-287f-4ce0-8ca6-92e98e65b730 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:43.009202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa655767-3990-4671-b47d-a874284c921d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:43.013906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fa655767-3990-4671-b47d-a874284c921d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:43.018395 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd173b40-cd10-4515-85c0-65d195482f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:43.018395 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd173b40-cd10-4515-85c0-65d195482f31 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.018648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd173b40-cd10-4515-85c0-65d195482f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.018880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd173b40-cd10-4515-85c0-65d195482f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.019537 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd173b40-cd10-4515-85c0-65d195482f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:43.019857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd173b40-cd10-4515-85c0-65d195482f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:43.021460 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd173b40-cd10-4515-85c0-65d195482f31 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:43.033663 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa655767-3990-4671-b47d-a874284c921d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:43.050002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:43.050725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.051011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.051286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] PATH_INFO: `/v3/projects/c049eb42ef6f48d6994b3d15f5c80020` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.052622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c049eb42ef6f48d6994b3d15f5c80020)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:43.054751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 849/1707] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:08:43.056570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:43.059017 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd173b40-cd10-4515-85c0-65d195482f31 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:43.079797 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd173b40-cd10-4515-85c0-65d195482f31 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:43.091747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abcddf-2c17-44c6-ab80-c225f61efc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:43.092418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abcddf-2c17-44c6-ab80-c225f61efc47 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.092701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abcddf-2c17-44c6-ab80-c225f61efc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.092977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abcddf-2c17-44c6-ab80-c225f61efc47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.093673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abcddf-2c17-44c6-ab80-c225f61efc47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:43.097903 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abcddf-2c17-44c6-ab80-c225f61efc47 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:43.250483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 850/1708] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:43 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:43.254394 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abcddf-2c17-44c6-ab80-c225f61efc47 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:43.274620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c049eb42ef6f48d6994b3d15f5c80020', 'request_id': 'req-f3af4848-e736-4265-b79b-59eaf75fc3a5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:43.302274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c049eb42ef6f48d6994b3d15f5c80020', 'request_id': 'req-f3af4848-e736-4265-b79b-59eaf75fc3a5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:43.382964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abcddf-2c17-44c6-ab80-c225f61efc47 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:43.398013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c049eb42ef6f48d6994b3d15f5c80020', 'request_id': 'req-f3af4848-e736-4265-b79b-59eaf75fc3a5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:43.398173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:43.399584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3b1ec-6032-4d8d-a3cd-8c22e8480db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:43.400430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3b1ec-6032-4d8d-a3cd-8c22e8480db0 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.403015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3b1ec-6032-4d8d-a3cd-8c22e8480db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.403015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3b1ec-6032-4d8d-a3cd-8c22e8480db0 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.405354 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3b1ec-6032-4d8d-a3cd-8c22e8480db0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:43.411414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3b1ec-6032-4d8d-a3cd-8c22e8480db0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:43.426326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] The token cache is being invalidate because project c049eb42ef6f48d6994b3d15f5c80020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:43.426609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:43.436373 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:43.438061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 859/1709] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:43 2022] DELETE /identity/v3/projects/c049eb42ef6f48d6994b3d15f5c80020 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:43.439396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:43.442541 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:43.533701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 851/1710] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:43 2022] POST /identity/v3/users => generated 289 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:43.537314 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3b1ec-6032-4d8d-a3cd-8c22e8480db0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:43.547756 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6ef3b1ec-6032-4d8d-a3cd-8c22e8480db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:43.602777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3b1ec-6032-4d8d-a3cd-8c22e8480db0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:43.620305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd36b8-54e1-4115-a1c8-51c700eafd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:43.622230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd36b8-54e1-4115-a1c8-51c700eafd7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.622453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd36b8-54e1-4115-a1c8-51c700eafd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.622728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dd36b8-54e1-4115-a1c8-51c700eafd7b admin admin] PATH_INFO: `/v3/users/e43850b81fe444659273aa88cfeec0be` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.630434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af4848-e736-4265-b79b-59eaf75fc3a5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:43.632715 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd36b8-54e1-4115-a1c8-51c700eafd7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e43850b81fe444659273aa88cfeec0be)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:43.638564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dd36b8-54e1-4115-a1c8-51c700eafd7b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:43.789345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:43.898517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5990464-305b-478e-902c-97db243af051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:43.899812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5990464-305b-478e-902c-97db243af051 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:43.900186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5990464-305b-478e-902c-97db243af051 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:43.900456 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5990464-305b-478e-902c-97db243af051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:43.909399 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c5990464-305b-478e-902c-97db243af051 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:43.935482 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a5dd36b8-54e1-4115-a1c8-51c700eafd7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e43850b81fe444659273aa88cfeec0be'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:43.968845 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a5dd36b8-54e1-4115-a1c8-51c700eafd7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e43850b81fe444659273aa88cfeec0be'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:43.970910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a5dd36b8-54e1-4115-a1c8-51c700eafd7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e43850b81fe444659273aa88cfeec0be'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:43.971919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a5dd36b8-54e1-4115-a1c8-51c700eafd7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e43850b81fe444659273aa88cfeec0be'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:43.983754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a5dd36b8-54e1-4115-a1c8-51c700eafd7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e43850b81fe444659273aa88cfeec0be'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:44.063350 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 852/1711] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:43 2022] DELETE /identity/v3/users/e43850b81fe444659273aa88cfeec0be => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:44.065538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd36b8-54e1-4115-a1c8-51c700eafd7b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:44.069299 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a5dd36b8-54e1-4115-a1c8-51c700eafd7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:44.145267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5990464-305b-478e-902c-97db243af051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:44.148140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5990464-305b-478e-902c-97db243af051 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:44.194726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 860/1712] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:43 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 754 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:44.195981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5990464-305b-478e-902c-97db243af051 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:44.210298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c5990464-305b-478e-902c-97db243af051 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:44.220866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dd36b8-54e1-4115-a1c8-51c700eafd7b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:44.230554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8976d99-302f-491c-8b36-a9bf4e98da22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:44.231187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8976d99-302f-491c-8b36-a9bf4e98da22 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.231466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8976d99-302f-491c-8b36-a9bf4e98da22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.233725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8976d99-302f-491c-8b36-a9bf4e98da22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:44.237201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8976d99-302f-491c-8b36-a9bf4e98da22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:44.246298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8976d99-302f-491c-8b36-a9bf4e98da22 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:44.275400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 853/1713] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:44.275400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8976d99-302f-491c-8b36-a9bf4e98da22 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:44.279104 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c8976d99-302f-491c-8b36-a9bf4e98da22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:44.436896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5990464-305b-478e-902c-97db243af051 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:44.484330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8976d99-302f-491c-8b36-a9bf4e98da22 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:44.498090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3e281-73e1-4561-912d-342f030edf2b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213e29685f3402b804d4d8fbc88ba96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:44.499146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3e281-73e1-4561-912d-342f030edf2b service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.499428 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3e281-73e1-4561-912d-342f030edf2b service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.502883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3e281-73e1-4561-912d-342f030edf2b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:44.504505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f2c3e281-73e1-4561-912d-342f030edf2b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:44.531471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3e281-73e1-4561-912d-342f030edf2b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:44.535393 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3e281-73e1-4561-912d-342f030edf2b service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:44.577952 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 854/1714] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:44.579131 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:44.581040 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3e281-73e1-4561-912d-342f030edf2b service placement] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:44.588555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad97338-3f74-4694-823c-f87cad202222 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213e29685f3402b804d4d8fbc88ba96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:44.590003 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad97338-3f74-4694-823c-f87cad202222 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.590567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad97338-3f74-4694-823c-f87cad202222 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.591206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad97338-3f74-4694-823c-f87cad202222 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:44.608125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3e281-73e1-4561-912d-342f030edf2b service placement] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:44.608704 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad97338-3f74-4694-823c-f87cad202222 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:44.610872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad97338-3f74-4694-823c-f87cad202222 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:44.627333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 861/1715] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:44.646542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b472f-f557-4fbe-81b7-236739bbf9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:44.647176 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b472f-f557-4fbe-81b7-236739bbf9e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.647465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b472f-f557-4fbe-81b7-236739bbf9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.647744 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b472f-f557-4fbe-81b7-236739bbf9e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:44.651877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b472f-f557-4fbe-81b7-236739bbf9e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:44.652894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74b05d-c411-46e8-83bf-aa4e05b2e144 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.653419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74b05d-c411-46e8-83bf-aa4e05b2e144 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.653787 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74b05d-c411-46e8-83bf-aa4e05b2e144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:44.668968 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b472f-f557-4fbe-81b7-236739bbf9e7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:44.707539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 855/1716] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:44 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:44.710254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b472f-f557-4fbe-81b7-236739bbf9e7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:44.732511 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7e74b05d-c411-46e8-83bf-aa4e05b2e144 None None] MFA Rules not processed for user `68ee993e0aab4f988751a8b1bf11346c`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:44.737283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b472f-f557-4fbe-81b7-236739bbf9e7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:44.749767 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7e74b05d-c411-46e8-83bf-aa4e05b2e144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:44.755198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95931eca-d563-4967-9c21-f945d30dcee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:44.759735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95931eca-d563-4967-9c21-f945d30dcee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.760268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95931eca-d563-4967-9c21-f945d30dcee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.760694 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95931eca-d563-4967-9c21-f945d30dcee2 admin admin] PATH_INFO: `/v3/projects/1a1775ec51a24ca6b9d4b6fb4cd1dd1a/users/7c1df8c6cf70480c905c20a8c88a2dc5/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:44.827323 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95931eca-d563-4967-9c21-f945d30dcee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a1775ec51a24ca6b9d4b6fb4cd1dd1a, user_id=7c1df8c6cf70480c905c20a8c88a2dc5, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:44.852056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95931eca-d563-4967-9c21-f945d30dcee2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:44.980135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 856/1717] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:44 2022] PUT /identity/v3/projects/1a1775ec51a24ca6b9d4b6fb4cd1dd1a/users/7c1df8c6cf70480c905c20a8c88a2dc5/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:44.980135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7746d-2d4b-4270-b7e0-171b088131e6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.980135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7746d-2d4b-4270-b7e0-171b088131e6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.980135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7746d-2d4b-4270-b7e0-171b088131e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:44.981074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 862/1718] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:44 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:44.989477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a39cb4-eb10-4599-b615-19052752b054 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:44.989768 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a39cb4-eb10-4599-b615-19052752b054 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:44.990627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a39cb4-eb10-4599-b615-19052752b054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.137553 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-75a39cb4-eb10-4599-b615-19052752b054 None None] MFA Rules not processed for user `7c1df8c6cf70480c905c20a8c88a2dc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:45.143610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-75a39cb4-eb10-4599-b615-19052752b054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:45.198565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-bdb7746d-2d4b-4270-b7e0-171b088131e6 None None] MFA Rules not processed for user `f4b56136da884b79ab26be1bdd99e407`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:45.202306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bdb7746d-2d4b-4270-b7e0-171b088131e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:45.405773 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 863/1719] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:45.406926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a39cb4-eb10-4599-b615-19052752b054 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:45.474757 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 857/1720] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:45.492295 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7746d-2d4b-4270-b7e0-171b088131e6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:45.496840 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bdb7746d-2d4b-4270-b7e0-171b088131e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:45.597215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a39cb4-eb10-4599-b615-19052752b054 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:45.607596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9964c0-6c4b-4ba7-a93a-43a1ed5f06c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:45.610061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9964c0-6c4b-4ba7-a93a-43a1ed5f06c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.610550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9964c0-6c4b-4ba7-a93a-43a1ed5f06c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.610823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9964c0-6c4b-4ba7-a93a-43a1ed5f06c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.611471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9964c0-6c4b-4ba7-a93a-43a1ed5f06c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:45.617256 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9964c0-6c4b-4ba7-a93a-43a1ed5f06c4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:45.650691 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7746d-2d4b-4270-b7e0-171b088131e6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:45.660401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:45.661513 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:45.662022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:45.664989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] PATH_INFO: `/v3/projects/ee5ed8189b304ec580c97115d5312919` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:45.667242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee5ed8189b304ec580c97115d5312919)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:45.670793 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:45.766816 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 864/1721] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:45 2022] POST /identity/v3/projects => generated 379 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:08:45.771225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9964c0-6c4b-4ba7-a93a-43a1ed5f06c4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:45.873351 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee5ed8189b304ec580c97115d5312919', 'request_id': 'req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.884524 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee5ed8189b304ec580c97115d5312919', 'request_id': 'req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.896622 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee5ed8189b304ec580c97115d5312919', 'request_id': 'req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:45.916467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9964c0-6c4b-4ba7-a93a-43a1ed5f06c4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:45.920160 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:46.000640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] The token cache is being invalidate because project ee5ed8189b304ec580c97115d5312919 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:08:46.000640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:46.000640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:46.000640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 858/1722] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:08:45 2022] DELETE /identity/v3/projects/ee5ed8189b304ec580c97115d5312919 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:46.000640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:46.001104 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:46.057063 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121b0ef4-7a88-4670-94dc-db0f32469977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:46.058773 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b0ef4-7a88-4670-94dc-db0f32469977 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.064336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b0ef4-7a88-4670-94dc-db0f32469977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.064921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121b0ef4-7a88-4670-94dc-db0f32469977 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.066066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b0ef4-7a88-4670-94dc-db0f32469977 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:46.074910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:46.075006 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121b0ef4-7a88-4670-94dc-db0f32469977 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:46.232750 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 865/1723] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:45 2022] POST /identity/v3/users => generated 296 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:46.234492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e7cf-5411-4848-a543-027eaa98e789 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.237857 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e7cf-5411-4848-a543-027eaa98e789 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.238143 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03e7cf-5411-4848-a543-027eaa98e789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.259879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f4c03-c4c4-4dff-b9be-d7c4567ed81a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:46.281572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5bbcd-71cc-4b10-9f00-b19058e6447f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:46.283830 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5bbcd-71cc-4b10-9f00-b19058e6447f service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.285483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5bbcd-71cc-4b10-9f00-b19058e6447f service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.288147 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5bbcd-71cc-4b10-9f00-b19058e6447f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.297045 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-12b5bbcd-71cc-4b10-9f00-b19058e6447f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:46.314796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-dd03e7cf-5411-4848-a543-027eaa98e789 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:46.316693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dd03e7cf-5411-4848-a543-027eaa98e789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:46.336321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 866/1724] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:46.340853 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615e75e-5431-4c2a-a943-8daace6e8ab6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.341402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615e75e-5431-4c2a-a943-8daace6e8ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.343658 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9615e75e-5431-4c2a-a943-8daace6e8ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.387798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9615e75e-5431-4c2a-a943-8daace6e8ab6 None None] MFA Rules not processed for user `8e9558f071244924926df0fe80d3259a`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:46.390188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9615e75e-5431-4c2a-a943-8daace6e8ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:46.458126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5bbcd-71cc-4b10-9f00-b19058e6447f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:46.458126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5bbcd-71cc-4b10-9f00-b19058e6447f service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:46.466517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 859/1725] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:46.468315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 867/1726] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:46.470300 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e930e-1e63-4b0a-8004-6da03d88c864 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.470848 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e930e-1e63-4b0a-8004-6da03d88c864 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.471325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e930e-1e63-4b0a-8004-6da03d88c864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.471554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5bbcd-71cc-4b10-9f00-b19058e6447f service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:46.474525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-12b5bbcd-71cc-4b10-9f00-b19058e6447f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:46.492617 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5bbcd-71cc-4b10-9f00-b19058e6447f service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:46.495098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ca8e930e-1e63-4b0a-8004-6da03d88c864 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:46.497022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ca8e930e-1e63-4b0a-8004-6da03d88c864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:46.499647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c4d3-8a09-4bc9-b797-a9e98bbb3909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:46.500499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c4d3-8a09-4bc9-b797-a9e98bbb3909 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.500952 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c4d3-8a09-4bc9-b797-a9e98bbb3909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.502822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883c4d3-8a09-4bc9-b797-a9e98bbb3909 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.503555 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883c4d3-8a09-4bc9-b797-a9e98bbb3909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:46.505555 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883c4d3-8a09-4bc9-b797-a9e98bbb3909 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:46.516375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 868/1727] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:46.518545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 860/1728] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:46.520989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e930e-1e63-4b0a-8004-6da03d88c864 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:46.525562 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c4d3-8a09-4bc9-b797-a9e98bbb3909 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:46.539587 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e930e-1e63-4b0a-8004-6da03d88c864 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:46.542597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883c4d3-8a09-4bc9-b797-a9e98bbb3909 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:46.550720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d046b1-c75a-4f52-aa5a-15e87c0b1f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:46.551348 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d046b1-c75a-4f52-aa5a-15e87c0b1f91 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.551634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d046b1-c75a-4f52-aa5a-15e87c0b1f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.551927 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d046b1-c75a-4f52-aa5a-15e87c0b1f91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.552751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d046b1-c75a-4f52-aa5a-15e87c0b1f91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:08:46.553899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d046b1-c75a-4f52-aa5a-15e87c0b1f91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:46.554721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10867b12-1c76-4f16-87ba-5e869b1bf5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:46.556007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d046b1-c75a-4f52-aa5a-15e87c0b1f91 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:46.556696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867b12-1c76-4f16-87ba-5e869b1bf5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.557065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867b12-1c76-4f16-87ba-5e869b1bf5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.557421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10867b12-1c76-4f16-87ba-5e869b1bf5c7 admin admin] PATH_INFO: `/v3/projects/f448811912b546d89a9870dc024f1eaf/users/21462ad16a084e419d74b859173b1c85/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.571682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 869/1729] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:08:46.576249 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d046b1-c75a-4f52-aa5a-15e87c0b1f91 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:46.592764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d046b1-c75a-4f52-aa5a-15e87c0b1f91 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:46.603718 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432712e1-90b9-44f0-b3b6-65b4b30fa0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:46.605078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432712e1-90b9-44f0-b3b6-65b4b30fa0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:46.605558 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432712e1-90b9-44f0-b3b6-65b4b30fa0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:46.606026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432712e1-90b9-44f0-b3b6-65b4b30fa0b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:46.606854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432712e1-90b9-44f0-b3b6-65b4b30fa0b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:46.610018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432712e1-90b9-44f0-b3b6-65b4b30fa0b9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:46.637103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10867b12-1c76-4f16-87ba-5e869b1bf5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f448811912b546d89a9870dc024f1eaf, user_id=21462ad16a084e419d74b859173b1c85, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:46.649335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10867b12-1c76-4f16-87ba-5e869b1bf5c7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:46.798283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 861/1730] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:46 2022] PUT /identity/v3/projects/f448811912b546d89a9870dc024f1eaf/users/21462ad16a084e419d74b859173b1c85/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:46.805471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10867b12-1c76-4f16-87ba-5e869b1bf5c7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:46.853658 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 870/1731] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:46 2022] POST /identity/v3/projects => generated 373 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:46.857825 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432712e1-90b9-44f0-b3b6-65b4b30fa0b9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:46.956373 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10867b12-1c76-4f16-87ba-5e869b1bf5c7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:47.062755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432712e1-90b9-44f0-b3b6-65b4b30fa0b9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:47.074975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61d481-ae03-4c36-942e-57eec551da82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:47.075632 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61d481-ae03-4c36-942e-57eec551da82 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.076127 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61d481-ae03-4c36-942e-57eec551da82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.076550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61d481-ae03-4c36-942e-57eec551da82 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.077220 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61d481-ae03-4c36-942e-57eec551da82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:47.079186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61d481-ae03-4c36-942e-57eec551da82 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:47.080647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dec880-8fb7-4425-8d3a-92ae274e679e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:47.081777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dec880-8fb7-4425-8d3a-92ae274e679e admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.082346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dec880-8fb7-4425-8d3a-92ae274e679e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.082891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dec880-8fb7-4425-8d3a-92ae274e679e admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.084215 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dec880-8fb7-4425-8d3a-92ae274e679e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:47.086229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dec880-8fb7-4425-8d3a-92ae274e679e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:47.103476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 862/1732] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:47.106005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dec880-8fb7-4425-8d3a-92ae274e679e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:47.117720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dec880-8fb7-4425-8d3a-92ae274e679e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:47.138484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd280ab0-2228-4fa0-a8d1-a975cf0e36dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:47.138484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd280ab0-2228-4fa0-a8d1-a975cf0e36dc admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.138484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd280ab0-2228-4fa0-a8d1-a975cf0e36dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.138484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd280ab0-2228-4fa0-a8d1-a975cf0e36dc admin admin] PATH_INFO: `/v3/projects/f448811912b546d89a9870dc024f1eaf/users/21462ad16a084e419d74b859173b1c85/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.143900 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd280ab0-2228-4fa0-a8d1-a975cf0e36dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=f448811912b546d89a9870dc024f1eaf, user_id=21462ad16a084e419d74b859173b1c85, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:47.151639 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd280ab0-2228-4fa0-a8d1-a975cf0e36dc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:47.166692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 863/1733] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:47 2022] PUT /identity/v3/projects/f448811912b546d89a9870dc024f1eaf/users/21462ad16a084e419d74b859173b1c85/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:47.176916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee802d9d-3e74-4555-a904-e0bb4d74b1b4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.177203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee802d9d-3e74-4555-a904-e0bb4d74b1b4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.184209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee802d9d-3e74-4555-a904-e0bb4d74b1b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.256597 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 871/1734] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:46 2022] POST /identity/v3/users => generated 287 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:47.261403 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61d481-ae03-4c36-942e-57eec551da82 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:47.278846 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ee802d9d-3e74-4555-a904-e0bb4d74b1b4 None None] MFA Rules not processed for user `21462ad16a084e419d74b859173b1c85`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:47.286568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ee802d9d-3e74-4555-a904-e0bb4d74b1b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:47.311660 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61d481-ae03-4c36-942e-57eec551da82 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:47.440930 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ede99f-8f89-4dd1-9dc0-0da3d5ab5fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:47.441682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ede99f-8f89-4dd1-9dc0-0da3d5ab5fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.442395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ede99f-8f89-4dd1-9dc0-0da3d5ab5fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.442888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ede99f-8f89-4dd1-9dc0-0da3d5ab5fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.444834 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ede99f-8f89-4dd1-9dc0-0da3d5ab5fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:47.447203 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ede99f-8f89-4dd1-9dc0-0da3d5ab5fa6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:47.456065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 864/1735] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:08:47.467435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 872/1736] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:47.472301 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee802d9d-3e74-4555-a904-e0bb4d74b1b4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:47.494618 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee802d9d-3e74-4555-a904-e0bb4d74b1b4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:47.510027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfcab7-24af-456b-b3c8-107685b85b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:47.510027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfcab7-24af-456b-b3c8-107685b85b93 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.510027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfcab7-24af-456b-b3c8-107685b85b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.510027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfcab7-24af-456b-b3c8-107685b85b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.512196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfcab7-24af-456b-b3c8-107685b85b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:47.516246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfcab7-24af-456b-b3c8-107685b85b93 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:47.540656 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ede99f-8f89-4dd1-9dc0-0da3d5ab5fa6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:47.542421 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-04ede99f-8f89-4dd1-9dc0-0da3d5ab5fa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:47.553496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 865/1737] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:47.558021 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfcab7-24af-456b-b3c8-107685b85b93 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:47.611182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfcab7-24af-456b-b3c8-107685b85b93 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:47.623889 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b9c64a-b809-4d7b-aac1-dd41cab20a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:47.624673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9c64a-b809-4d7b-aac1-dd41cab20a16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.624960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9c64a-b809-4d7b-aac1-dd41cab20a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.625243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b9c64a-b809-4d7b-aac1-dd41cab20a16 admin admin] PATH_INFO: `/v3/projects/bea0f69a2fb9490c93ef1c0ecb2a373a/users/3bc656159ecc4f81bee227bca1f3175e/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.687224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9c64a-b809-4d7b-aac1-dd41cab20a16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bea0f69a2fb9490c93ef1c0ecb2a373a, user_id=3bc656159ecc4f81bee227bca1f3175e, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:47.696469 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b9c64a-b809-4d7b-aac1-dd41cab20a16 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:47.714416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ede99f-8f89-4dd1-9dc0-0da3d5ab5fa6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:47.719460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac67d0-fd0c-4793-a09c-810810291162 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:47.720156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac67d0-fd0c-4793-a09c-810810291162 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.720441 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac67d0-fd0c-4793-a09c-810810291162 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.720713 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ac67d0-fd0c-4793-a09c-810810291162 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.723494 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-82ac67d0-fd0c-4793-a09c-810810291162 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:47.820239 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 866/1738] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:47 2022] PUT /identity/v3/projects/bea0f69a2fb9490c93ef1c0ecb2a373a/users/3bc656159ecc4f81bee227bca1f3175e/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:47.823015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fae307-e2e3-43a6-b2b6-8d1b6f0cd9f6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:47.823462 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fae307-e2e3-43a6-b2b6-8d1b6f0cd9f6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:47.823918 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fae307-e2e3-43a6-b2b6-8d1b6f0cd9f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:47.833678 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac67d0-fd0c-4793-a09c-810810291162 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:47.835815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ac67d0-fd0c-4793-a09c-810810291162 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:47.860401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 873/1739] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:47.860679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-74fae307-e2e3-43a6-b2b6-8d1b6f0cd9f6 None None] MFA Rules not processed for user `3bc656159ecc4f81bee227bca1f3175e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:47.864984 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-74fae307-e2e3-43a6-b2b6-8d1b6f0cd9f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:47.999919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 867/1740] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:08:48.000083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac67d0-fd0c-4793-a09c-810810291162 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:48.016855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ac67d0-fd0c-4793-a09c-810810291162 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:48.174653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b01e3-f9cb-4a1b-9b21-ba02d27ef596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:48.175807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b01e3-f9cb-4a1b-9b21-ba02d27ef596 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:48.176365 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b01e3-f9cb-4a1b-9b21-ba02d27ef596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:48.176851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b01e3-f9cb-4a1b-9b21-ba02d27ef596 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:48.177786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b01e3-f9cb-4a1b-9b21-ba02d27ef596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:48.181614 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b01e3-f9cb-4a1b-9b21-ba02d27ef596 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:48.321428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 874/1741] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:08:47 2022] POST /identity/v3/projects => generated 373 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:48.324195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fae307-e2e3-43a6-b2b6-8d1b6f0cd9f6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:48.340842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fae307-e2e3-43a6-b2b6-8d1b6f0cd9f6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:48.385582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:48.480462 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af9891-0d24-4800-b404-ed31abd9a76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:48.481863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af9891-0d24-4800-b404-ed31abd9a76b admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:48.482275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af9891-0d24-4800-b404-ed31abd9a76b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:48.482557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af9891-0d24-4800-b404-ed31abd9a76b admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:48.483205 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af9891-0d24-4800-b404-ed31abd9a76b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:48.485156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79af9891-0d24-4800-b404-ed31abd9a76b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:48.584012 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 868/1742] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:08:48 2022] POST /identity/v3/users => generated 293 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:08:48.588273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b01e3-f9cb-4a1b-9b21-ba02d27ef596 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:48.599426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b01e3-f9cb-4a1b-9b21-ba02d27ef596 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:48.607630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce534495-6edf-486b-8429-838f74a6613e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:48.608858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534495-6edf-486b-8429-838f74a6613e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:48.609434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534495-6edf-486b-8429-838f74a6613e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:48.610418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce534495-6edf-486b-8429-838f74a6613e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:48.611565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce534495-6edf-486b-8429-838f74a6613e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:48.613573 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce534495-6edf-486b-8429-838f74a6613e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:48.634356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 875/1743] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:08:48.637686 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af9891-0d24-4800-b404-ed31abd9a76b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:48.659652 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af9891-0d24-4800-b404-ed31abd9a76b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:48.683290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d00c7-2dd9-4a8d-bee9-d1259a4e7f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:48.684119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d00c7-2dd9-4a8d-bee9-d1259a4e7f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:48.684536 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d00c7-2dd9-4a8d-bee9-d1259a4e7f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:48.684661 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d00c7-2dd9-4a8d-bee9-d1259a4e7f0b admin admin] PATH_INFO: `/v3/projects/eb0d5305535348e3929a1333d8d3a4a0/users/7b37e6c1bcf042a18b5ecd14488deff2/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:48.709384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d00c7-2dd9-4a8d-bee9-d1259a4e7f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0d5305535348e3929a1333d8d3a4a0, user_id=7b37e6c1bcf042a18b5ecd14488deff2, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:48.712509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d00c7-2dd9-4a8d-bee9-d1259a4e7f0b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:48.790438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:48.827411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 869/1744] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:48 2022] PUT /identity/v3/projects/eb0d5305535348e3929a1333d8d3a4a0/users/7b37e6c1bcf042a18b5ecd14488deff2/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:48.830711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce534495-6edf-486b-8429-838f74a6613e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:48.846153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce534495-6edf-486b-8429-838f74a6613e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:49.015918 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68031eb1-a85e-4399-92e3-8575532c7945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:49.016730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031eb1-a85e-4399-92e3-8575532c7945 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:49.017048 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031eb1-a85e-4399-92e3-8575532c7945 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:49.017653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68031eb1-a85e-4399-92e3-8575532c7945 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:49.018398 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68031eb1-a85e-4399-92e3-8575532c7945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:49.022699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68031eb1-a85e-4399-92e3-8575532c7945 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:49.045234 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 876/1745] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:08:48 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:08:49.048671 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d00c7-2dd9-4a8d-bee9-d1259a4e7f0b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:49.066507 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d00c7-2dd9-4a8d-bee9-d1259a4e7f0b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:49.088621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6deea36-50d9-4cc5-9f79-1772d96cf0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:49.089533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deea36-50d9-4cc5-9f79-1772d96cf0f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:49.089823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deea36-50d9-4cc5-9f79-1772d96cf0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:49.090101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6deea36-50d9-4cc5-9f79-1772d96cf0f4 admin admin] PATH_INFO: `/v3/projects/eb0d5305535348e3929a1333d8d3a4a0/users/7b37e6c1bcf042a18b5ecd14488deff2/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:49.097583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6deea36-50d9-4cc5-9f79-1772d96cf0f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0d5305535348e3929a1333d8d3a4a0, user_id=7b37e6c1bcf042a18b5ecd14488deff2, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:49.109540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6deea36-50d9-4cc5-9f79-1772d96cf0f4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:49.144562 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 870/1746] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:08:49 2022] PUT /identity/v3/projects/eb0d5305535348e3929a1333d8d3a4a0/users/7b37e6c1bcf042a18b5ecd14488deff2/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:49.156471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad110c-5221-40d0-9c83-aff3739dfd86 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:49.156750 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad110c-5221-40d0-9c83-aff3739dfd86 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:49.157744 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad110c-5221-40d0-9c83-aff3739dfd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:49.251363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-04ad110c-5221-40d0-9c83-aff3739dfd86 None None] MFA Rules not processed for user `7b37e6c1bcf042a18b5ecd14488deff2`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:49.252921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-04ad110c-5221-40d0-9c83-aff3739dfd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:49.282562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:49.474539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 877/1747] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:49.846004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6deea36-50d9-4cc5-9f79-1772d96cf0f4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:49.933645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6deea36-50d9-4cc5-9f79-1772d96cf0f4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:49.938087 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47962e-e01f-4480-9dae-d9d084007c1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:49.939155 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47962e-e01f-4480-9dae-d9d084007c1b service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:49.939493 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47962e-e01f-4480-9dae-d9d084007c1b service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:49.939775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47962e-e01f-4480-9dae-d9d084007c1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:49.959107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47962e-e01f-4480-9dae-d9d084007c1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:49.959107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47962e-e01f-4480-9dae-d9d084007c1b service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:49.968051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 871/1748] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:49 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:50.335586 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad110c-5221-40d0-9c83-aff3739dfd86 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:50.351787 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad110c-5221-40d0-9c83-aff3739dfd86 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:50.377314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d52376-4ac2-484d-ba6a-c10d12c72874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:50.382216 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d52376-4ac2-484d-ba6a-c10d12c72874 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:50.386322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d52376-4ac2-484d-ba6a-c10d12c72874 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:50.387480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d52376-4ac2-484d-ba6a-c10d12c72874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:50.606375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47962e-e01f-4480-9dae-d9d084007c1b service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:50.608951 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fb47962e-e01f-4480-9dae-d9d084007c1b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:50.632180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47962e-e01f-4480-9dae-d9d084007c1b service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:50.652135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90744382-9077-43b7-bb38-ffc59dbbc595 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:50.654046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90744382-9077-43b7-bb38-ffc59dbbc595 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:50.655834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90744382-9077-43b7-bb38-ffc59dbbc595 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:50.656360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90744382-9077-43b7-bb38-ffc59dbbc595 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:50.666363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d52376-4ac2-484d-ba6a-c10d12c72874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:50.671582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d52376-4ac2-484d-ba6a-c10d12c72874 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:50.729964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 878/1749] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:50 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:50.799130 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90744382-9077-43b7-bb38-ffc59dbbc595 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:50.806945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90744382-9077-43b7-bb38-ffc59dbbc595 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:50.830356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 872/1750] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:08:50.968411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ad1fc-6bae-4d35-85eb-1dbe65e56030 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:50.968709 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ad1fc-6bae-4d35-85eb-1dbe65e56030 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:50.969036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ad1fc-6bae-4d35-85eb-1dbe65e56030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:50.983641 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:51.071401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5e9ad1fc-6bae-4d35-85eb-1dbe65e56030 None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:51.078065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5e9ad1fc-6bae-4d35-85eb-1dbe65e56030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:51.256557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 879/1751] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:08:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:51.341489 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:51.814682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90744382-9077-43b7-bb38-ffc59dbbc595 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:51.816632 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-90744382-9077-43b7-bb38-ffc59dbbc595 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:52.046128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90744382-9077-43b7-bb38-ffc59dbbc595 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:52.058317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796686fb-6412-4632-9cd7-c3db946eb14a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:52.060451 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796686fb-6412-4632-9cd7-c3db946eb14a service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:52.062047 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796686fb-6412-4632-9cd7-c3db946eb14a service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:52.062306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796686fb-6412-4632-9cd7-c3db946eb14a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:52.088491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796686fb-6412-4632-9cd7-c3db946eb14a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:52.090747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796686fb-6412-4632-9cd7-c3db946eb14a service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:52.144409 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 873/1752] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:08:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:08:52.424934 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4135a-170e-4ef6-99bd-6b2a2bd6cc1c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:52.425462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4135a-170e-4ef6-99bd-6b2a2bd6cc1c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:52.425540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf4135a-170e-4ef6-99bd-6b2a2bd6cc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:52.496190 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-abf4135a-170e-4ef6-99bd-6b2a2bd6cc1c None None] MFA Rules not processed for user `f4b56136da884b79ab26be1bdd99e407`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:52.507503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-abf4135a-170e-4ef6-99bd-6b2a2bd6cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:52.614468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:52.778494 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 880/1753] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:08:52.897062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff926a-3f5d-48a0-aba2-f8f32146d6f8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:52.897062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff926a-3f5d-48a0-aba2-f8f32146d6f8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:52.897062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff926a-3f5d-48a0-aba2-f8f32146d6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:52.992694 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-baff926a-3f5d-48a0-aba2-f8f32146d6f8 None None] MFA Rules not processed for user `f49116f202774e4da0c96875ffa08288`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:53.001306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-baff926a-3f5d-48a0-aba2-f8f32146d6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:53.118541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 874/1754] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Aug 24 08:08:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:53.422219 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4135a-170e-4ef6-99bd-6b2a2bd6cc1c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:53.424028 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-abf4135a-170e-4ef6-99bd-6b2a2bd6cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:53.439919 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf4135a-170e-4ef6-99bd-6b2a2bd6cc1c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:53.467719 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a7b511-4ad7-482a-84c3-c6f2d77aeb29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:53.473362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7b511-4ad7-482a-84c3-c6f2d77aeb29 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:53.473650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7b511-4ad7-482a-84c3-c6f2d77aeb29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:53.479618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a7b511-4ad7-482a-84c3-c6f2d77aeb29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:53.519417 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7b511-4ad7-482a-84c3-c6f2d77aeb29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:53.521005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a7b511-4ad7-482a-84c3-c6f2d77aeb29 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:53.521938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:53.544287 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 881/1755] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:53 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:08:53.653541 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:55.561963 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:56.036082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:57.226095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f8439-8520-458a-9c94-b01840897c39 None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:57.226646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f8439-8520-458a-9c94-b01840897c39 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:57.226646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f8439-8520-458a-9c94-b01840897c39 None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:57.228154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 875/1756] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 24 08:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:08:57.259094 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e7624-f46d-4c79-928e-8ed5d6268727 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:57.259645 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e7624-f46d-4c79-928e-8ed5d6268727 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:57.259752 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8e7624-f46d-4c79-928e-8ed5d6268727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:57.306709 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2a8e7624-f46d-4c79-928e-8ed5d6268727 None None] MFA Rules not processed for user `9b99cff7a5f549adadee002f8ab1f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:57.306709 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2a8e7624-f46d-4c79-928e-8ed5d6268727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:57.603275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 882/1757] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 24 08:08:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:57.667208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:58.204918 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f8439-8520-458a-9c94-b01840897c39 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:58.207022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-257f8439-8520-458a-9c94-b01840897c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:58.255050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e7624-f46d-4c79-928e-8ed5d6268727 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:58.456256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f8439-8520-458a-9c94-b01840897c39 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:58.456938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8e7624-f46d-4c79-928e-8ed5d6268727 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:58.468741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd5d62-f2d9-4dde-8c75-defc5e282be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:58.469406 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd5d62-f2d9-4dde-8c75-defc5e282be3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:58.469680 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd5d62-f2d9-4dde-8c75-defc5e282be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:58.469952 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd5d62-f2d9-4dde-8c75-defc5e282be3 admin admin] PATH_INFO: `/v3/users/80a5e9b85a5f406fba0653fa077b0c5e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:58.474856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d9777-83b5-4171-bd1b-947c559e4534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:58.476032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d9777-83b5-4171-bd1b-947c559e4534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:58.476473 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d9777-83b5-4171-bd1b-947c559e4534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:58.476938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d9777-83b5-4171-bd1b-947c559e4534 admin admin] PATH_INFO: `/v3/users/7c1df8c6cf70480c905c20a8c88a2dc5` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:58.478051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd5d62-f2d9-4dde-8c75-defc5e282be3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80a5e9b85a5f406fba0653fa077b0c5e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:58.478423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d9777-83b5-4171-bd1b-947c559e4534 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c1df8c6cf70480c905c20a8c88a2dc5)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:58.480511 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d9777-83b5-4171-bd1b-947c559e4534 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:58.482278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd5d62-f2d9-4dde-8c75-defc5e282be3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:58.782913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0a8d9777-83b5-4171-bd1b-947c559e4534 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c1df8c6cf70480c905c20a8c88a2dc5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:58.783889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0a8d9777-83b5-4171-bd1b-947c559e4534 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c1df8c6cf70480c905c20a8c88a2dc5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:58.785239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0a8d9777-83b5-4171-bd1b-947c559e4534 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c1df8c6cf70480c905c20a8c88a2dc5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:58.825272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0a8d9777-83b5-4171-bd1b-947c559e4534 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c1df8c6cf70480c905c20a8c88a2dc5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:58.828217 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72cd5d62-f2d9-4dde-8c75-defc5e282be3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80a5e9b85a5f406fba0653fa077b0c5e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:58.859120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0a8d9777-83b5-4171-bd1b-947c559e4534 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c1df8c6cf70480c905c20a8c88a2dc5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:58.861916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72cd5d62-f2d9-4dde-8c75-defc5e282be3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80a5e9b85a5f406fba0653fa077b0c5e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:58.863242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72cd5d62-f2d9-4dde-8c75-defc5e282be3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80a5e9b85a5f406fba0653fa077b0c5e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:58.865612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72cd5d62-f2d9-4dde-8c75-defc5e282be3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80a5e9b85a5f406fba0653fa077b0c5e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:58.880542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72cd5d62-f2d9-4dde-8c75-defc5e282be3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80a5e9b85a5f406fba0653fa077b0c5e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:08:58.940511 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:58.951635 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 883/1758] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:58 2022] DELETE /identity/v3/users/7c1df8c6cf70480c905c20a8c88a2dc5 => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:58.954070 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c707fa-c6d0-4a23-be28-9e9161425664 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:58.955728 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c707fa-c6d0-4a23-be28-9e9161425664 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:58.956268 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c707fa-c6d0-4a23-be28-9e9161425664 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:58.958580 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 884/1759] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 24 08:08:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:08:58.959638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c707fa-c6d0-4a23-be28-9e9161425664 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:58.969923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a1c707fa-c6d0-4a23-be28-9e9161425664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:59.026362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 876/1760] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:08:58 2022] DELETE /identity/v3/users/80a5e9b85a5f406fba0653fa077b0c5e => generated 0 bytes in 822 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:08:59.032045 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0f38d-83b2-445c-bde6-d8fb867960e4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:59.032633 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0f38d-83b2-445c-bde6-d8fb867960e4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:59.033113 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0f38d-83b2-445c-bde6-d8fb867960e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:59.076546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2ed0f38d-83b2-445c-bde6-d8fb867960e4 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:59.084148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2ed0f38d-83b2-445c-bde6-d8fb867960e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:59.128234 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c707fa-c6d0-4a23-be28-9e9161425664 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:59.231124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 877/1761] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:59.231124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469558b-1241-4da8-b211-a706656b9322 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:59.231124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469558b-1241-4da8-b211-a706656b9322 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:59.231861 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469558b-1241-4da8-b211-a706656b9322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:59.261624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7469558b-1241-4da8-b211-a706656b9322 None None] MFA Rules not processed for user `9b99cff7a5f549adadee002f8ab1f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:59.264121 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7469558b-1241-4da8-b211-a706656b9322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:59.294907 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:08:59.324095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ae622-72d6-48e6-9528-03c50713ee5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:59.325711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ae622-72d6-48e6-9528-03c50713ee5e service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:59.325996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ae622-72d6-48e6-9528-03c50713ee5e service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:59.326272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ae622-72d6-48e6-9528-03c50713ee5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:59.339121 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-036ae622-72d6-48e6-9528-03c50713ee5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:59.384438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ae622-72d6-48e6-9528-03c50713ee5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:59.387191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ae622-72d6-48e6-9528-03c50713ee5e service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:59.440512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 885/1762] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:59.440512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97303c-4353-4435-b8e2-7315d10f25ae None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:59.440512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97303c-4353-4435-b8e2-7315d10f25ae None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:59.440512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97303c-4353-4435-b8e2-7315d10f25ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:59.476789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 878/1763] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 24 08:08:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:59.477942 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469558b-1241-4da8-b211-a706656b9322 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:59.479547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7469558b-1241-4da8-b211-a706656b9322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:59.531177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2d97303c-4353-4435-b8e2-7315d10f25ae None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:08:59.537844 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2d97303c-4353-4435-b8e2-7315d10f25ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:59.570065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 886/1764] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:08:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:08:59.607158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469558b-1241-4da8-b211-a706656b9322 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:59.615454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba979f-d159-4215-9935-b8407f626d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:59.616342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba979f-d159-4215-9935-b8407f626d5e service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:59.616859 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba979f-d159-4215-9935-b8407f626d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:59.617315 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ba979f-d159-4215-9935-b8407f626d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:59.632840 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba979f-d159-4215-9935-b8407f626d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:59.634280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ba979f-d159-4215-9935-b8407f626d5e service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:59.655144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 879/1765] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:59.703601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97303c-4353-4435-b8e2-7315d10f25ae None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:59.705351 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2d97303c-4353-4435-b8e2-7315d10f25ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:59.737199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97303c-4353-4435-b8e2-7315d10f25ae None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:59.741512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b335c3-3c40-4155-86fd-d7807a3f0d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:59.742242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b335c3-3c40-4155-86fd-d7807a3f0d76 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:59.742595 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b335c3-3c40-4155-86fd-d7807a3f0d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:59.742939 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b335c3-3c40-4155-86fd-d7807a3f0d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:59.762517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b335c3-3c40-4155-86fd-d7807a3f0d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:59.766339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b335c3-3c40-4155-86fd-d7807a3f0d76 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:59.791878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba979f-d159-4215-9935-b8407f626d5e service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:08:59.793458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a1ba979f-d159-4215-9935-b8407f626d5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:08:59.806467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 887/1766] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:08:59.833299 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ba979f-d159-4215-9935-b8407f626d5e service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:08:59.845353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa050-0a29-4ba9-a2c3-34e95c138531 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:08:59.846022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa050-0a29-4ba9-a2c3-34e95c138531 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:08:59.846299 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa050-0a29-4ba9-a2c3-34e95c138531 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:08:59.847394 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddaa050-0a29-4ba9-a2c3-34e95c138531 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:08:59.876244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaa050-0a29-4ba9-a2c3-34e95c138531 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:08:59.878567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddaa050-0a29-4ba9-a2c3-34e95c138531 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:08:59.905464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 880/1767] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:08:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:01.507163 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b335c3-3c40-4155-86fd-d7807a3f0d76 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:01.518814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e0b335c3-3c40-4155-86fd-d7807a3f0d76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:01.569103 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b335c3-3c40-4155-86fd-d7807a3f0d76 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:01.583229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:01.584495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:01.584778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:01.585212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] PATH_INFO: `/v3/projects/1a1775ec51a24ca6b9d4b6fb4cd1dd1a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:01.587488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a1775ec51a24ca6b9d4b6fb4cd1dd1a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:01.590507 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:01.803024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa050-0a29-4ba9-a2c3-34e95c138531 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:01.804508 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3ddaa050-0a29-4ba9-a2c3-34e95c138531 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:01.829805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddaa050-0a29-4ba9-a2c3-34e95c138531 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:01.848045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a1775ec51a24ca6b9d4b6fb4cd1dd1a', 'request_id': 'req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:01.864784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a1775ec51a24ca6b9d4b6fb4cd1dd1a', 'request_id': 'req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:01.884267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:01.995342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a1775ec51a24ca6b9d4b6fb4cd1dd1a', 'request_id': 'req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:02.019711 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:02.021643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:02.023014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:02.025978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] PATH_INFO: `/v3/projects/cc4e844639564937ae84ab5f9955967d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:02.026381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] The token cache is being invalidate because project 1a1775ec51a24ca6b9d4b6fb4cd1dd1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:02.027126 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:02.027784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:02.030812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 888/1768] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:01 2022] DELETE /identity/v3/projects/1a1775ec51a24ca6b9d4b6fb4cd1dd1a => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:02.033798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:02.035659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc4e844639564937ae84ab5f9955967d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:02.038407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:02.040865 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:02.061917 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ab999-fb67-44b5-b9e3-d7ae58df9a0f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:02.069274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e646b-d3c2-45e6-a130-a285fa7078c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:02.086165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e646b-d3c2-45e6-a130-a285fa7078c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:02.087108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e646b-d3c2-45e6-a130-a285fa7078c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:02.088350 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734e646b-d3c2-45e6-a130-a285fa7078c8 admin admin] PATH_INFO: `/v3/users/19a77cdc5b5c4257b7852c8b8b48e31d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:02.089907 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e646b-d3c2-45e6-a130-a285fa7078c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19a77cdc5b5c4257b7852c8b8b48e31d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:02.093168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734e646b-d3c2-45e6-a130-a285fa7078c8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:02.242511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:02.245224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc4e844639564937ae84ab5f9955967d', 'request_id': 'req-6b7be257-dcee-4066-918a-1f124720b567'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:02.273267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc4e844639564937ae84ab5f9955967d', 'request_id': 'req-6b7be257-dcee-4066-918a-1f124720b567'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:02.292319 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc4e844639564937ae84ab5f9955967d', 'request_id': 'req-6b7be257-dcee-4066-918a-1f124720b567'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:02.389685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] The token cache is being invalidate because project cc4e844639564937ae84ab5f9955967d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:02.390067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:02.391620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:02.393947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 881/1769] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:01 2022] DELETE /identity/v3/projects/cc4e844639564937ae84ab5f9955967d => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:02.395017 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-734e646b-d3c2-45e6-a130-a285fa7078c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19a77cdc5b5c4257b7852c8b8b48e31d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:02.395485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:02.404854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:02.405963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-734e646b-d3c2-45e6-a130-a285fa7078c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19a77cdc5b5c4257b7852c8b8b48e31d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:02.406712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-734e646b-d3c2-45e6-a130-a285fa7078c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19a77cdc5b5c4257b7852c8b8b48e31d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:02.422563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-734e646b-d3c2-45e6-a130-a285fa7078c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19a77cdc5b5c4257b7852c8b8b48e31d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:02.459345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-734e646b-d3c2-45e6-a130-a285fa7078c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19a77cdc5b5c4257b7852c8b8b48e31d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:02.542936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 889/1770] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:02 2022] DELETE /identity/v3/users/19a77cdc5b5c4257b7852c8b8b48e31d => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:02.551122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e646b-d3c2-45e6-a130-a285fa7078c8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:02.557565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-734e646b-d3c2-45e6-a130-a285fa7078c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:02.595497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7be257-dcee-4066-918a-1f124720b567 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:02.717309 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36f50b-175c-4fbb-8a54-988819d0e7a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:02.718415 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36f50b-175c-4fbb-8a54-988819d0e7a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:02.719106 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36f50b-175c-4fbb-8a54-988819d0e7a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:02.719460 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36f50b-175c-4fbb-8a54-988819d0e7a6 admin admin] PATH_INFO: `/v3/users/21462ad16a084e419d74b859173b1c85` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:02.720841 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36f50b-175c-4fbb-8a54-988819d0e7a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21462ad16a084e419d74b859173b1c85)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:02.723377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36f50b-175c-4fbb-8a54-988819d0e7a6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:02.760550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734e646b-d3c2-45e6-a130-a285fa7078c8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:02.786248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce42a7-20e7-4c97-b7d6-ea9fe79ba633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:02.786969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce42a7-20e7-4c97-b7d6-ea9fe79ba633 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:02.787252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce42a7-20e7-4c97-b7d6-ea9fe79ba633 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:02.787527 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfce42a7-20e7-4c97-b7d6-ea9fe79ba633 admin admin] PATH_INFO: `/v3/users/c90a9a7c5d3a433aa9952a48a7d2dc92` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:02.789736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce42a7-20e7-4c97-b7d6-ea9fe79ba633 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c90a9a7c5d3a433aa9952a48a7d2dc92)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:02.792613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfce42a7-20e7-4c97-b7d6-ea9fe79ba633 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:03.034113 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9b36f50b-175c-4fbb-8a54-988819d0e7a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21462ad16a084e419d74b859173b1c85'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:03.069997 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9b36f50b-175c-4fbb-8a54-988819d0e7a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21462ad16a084e419d74b859173b1c85'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:03.071084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9b36f50b-175c-4fbb-8a54-988819d0e7a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21462ad16a084e419d74b859173b1c85'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:03.076306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9b36f50b-175c-4fbb-8a54-988819d0e7a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21462ad16a084e419d74b859173b1c85'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:03.079499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cfce42a7-20e7-4c97-b7d6-ea9fe79ba633 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c90a9a7c5d3a433aa9952a48a7d2dc92'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:03.080729 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cfce42a7-20e7-4c97-b7d6-ea9fe79ba633 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c90a9a7c5d3a433aa9952a48a7d2dc92'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:03.081676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cfce42a7-20e7-4c97-b7d6-ea9fe79ba633 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c90a9a7c5d3a433aa9952a48a7d2dc92'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:03.091910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9b36f50b-175c-4fbb-8a54-988819d0e7a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21462ad16a084e419d74b859173b1c85'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:03.097000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cfce42a7-20e7-4c97-b7d6-ea9fe79ba633 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c90a9a7c5d3a433aa9952a48a7d2dc92'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:03.119322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cfce42a7-20e7-4c97-b7d6-ea9fe79ba633 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c90a9a7c5d3a433aa9952a48a7d2dc92'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:03.178487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 882/1771] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:02 2022] DELETE /identity/v3/users/21462ad16a084e419d74b859173b1c85 => generated 0 bytes in 781 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:03.178487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd2581-4fec-4486-8e53-63866eb46c24 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:03.178487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd2581-4fec-4486-8e53-63866eb46c24 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:03.179134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd2581-4fec-4486-8e53-63866eb46c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:03.225429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8ebd2581-4fec-4486-8e53-63866eb46c24 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:03.226958 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8ebd2581-4fec-4486-8e53-63866eb46c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:03.323244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 890/1772] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:02 2022] DELETE /identity/v3/users/c90a9a7c5d3a433aa9952a48a7d2dc92 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:03.420007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 883/1773] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:03.467238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce42a7-20e7-4c97-b7d6-ea9fe79ba633 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:03.468893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cfce42a7-20e7-4c97-b7d6-ea9fe79ba633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:03.554858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfce42a7-20e7-4c97-b7d6-ea9fe79ba633 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:03.562710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa1645-e794-4cf0-b954-6146151795fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:03.564078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa1645-e794-4cf0-b954-6146151795fc service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:03.564689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa1645-e794-4cf0-b954-6146151795fc service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:03.565309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfa1645-e794-4cf0-b954-6146151795fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:03.668625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa1645-e794-4cf0-b954-6146151795fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:03.670340 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfa1645-e794-4cf0-b954-6146151795fc service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:03.731274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 891/1774] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:03.808089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:03.950176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:05.086815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd2581-4fec-4486-8e53-63866eb46c24 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:05.092059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8ebd2581-4fec-4486-8e53-63866eb46c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:05.120202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd2581-4fec-4486-8e53-63866eb46c24 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:05.126657 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:05.127523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:05.128318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:05.129107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] PATH_INFO: `/v3/projects/f448811912b546d89a9870dc024f1eaf` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:05.131663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f448811912b546d89a9870dc024f1eaf)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:05.134228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:05.269923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa1645-e794-4cf0-b954-6146151795fc service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:05.272375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ddfa1645-e794-4cf0-b954-6146151795fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:05.340492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfa1645-e794-4cf0-b954-6146151795fc service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:05.340492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecade33b-4971-456a-b3ed-5c9e24d4101b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:05.340492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecade33b-4971-456a-b3ed-5c9e24d4101b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:05.340492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecade33b-4971-456a-b3ed-5c9e24d4101b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:05.341602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecade33b-4971-456a-b3ed-5c9e24d4101b admin admin] PATH_INFO: `/v3/projects/a6b0669d0275499bbbfdc8cd1625f6d5` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:05.341602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecade33b-4971-456a-b3ed-5c9e24d4101b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b0669d0275499bbbfdc8cd1625f6d5)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:05.341602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecade33b-4971-456a-b3ed-5c9e24d4101b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:05.675825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f448811912b546d89a9870dc024f1eaf', 'request_id': 'req-cb8d714b-0550-4e9c-b264-694e8d575144'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:05.684276 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f448811912b546d89a9870dc024f1eaf', 'request_id': 'req-cb8d714b-0550-4e9c-b264-694e8d575144'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:05.696815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f448811912b546d89a9870dc024f1eaf', 'request_id': 'req-cb8d714b-0550-4e9c-b264-694e8d575144'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:05.711374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ecade33b-4971-456a-b3ed-5c9e24d4101b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b0669d0275499bbbfdc8cd1625f6d5', 'request_id': 'req-ecade33b-4971-456a-b3ed-5c9e24d4101b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:05.721593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ecade33b-4971-456a-b3ed-5c9e24d4101b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b0669d0275499bbbfdc8cd1625f6d5', 'request_id': 'req-ecade33b-4971-456a-b3ed-5c9e24d4101b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:05.778791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] The token cache is being invalidate because project f448811912b546d89a9870dc024f1eaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:05.779214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:05.779869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:05.781513 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 884/1775] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:05 2022] DELETE /identity/v3/projects/f448811912b546d89a9870dc024f1eaf => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:05.782484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:05.783931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:05.856251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d714b-0550-4e9c-b264-694e8d575144 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:05.858377 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ecade33b-4971-456a-b3ed-5c9e24d4101b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b0669d0275499bbbfdc8cd1625f6d5', 'request_id': 'req-ecade33b-4971-456a-b3ed-5c9e24d4101b'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:05.872592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ecade33b-4971-456a-b3ed-5c9e24d4101b admin admin] The token cache is being invalidate because project a6b0669d0275499bbbfdc8cd1625f6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:05.872592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ecade33b-4971-456a-b3ed-5c9e24d4101b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:05.872592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-ecade33b-4971-456a-b3ed-5c9e24d4101b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:05.873970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 892/1776] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:05 2022] DELETE /identity/v3/projects/a6b0669d0275499bbbfdc8cd1625f6d5 => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:05.875322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d063b-dd48-4c5f-b4f2-10fa4810db70 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:05.875605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d063b-dd48-4c5f-b4f2-10fa4810db70 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:05.875917 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d063b-dd48-4c5f-b4f2-10fa4810db70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:05.900924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6d2d063b-dd48-4c5f-b4f2-10fa4810db70 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:05.902646 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6d2d063b-dd48-4c5f-b4f2-10fa4810db70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:05.908369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:05.908690 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:05.949660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:05.950306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:05.950584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:05.951394 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] PATH_INFO: `/v3/projects/320f7c0486a54b1fad4571e0642ee66d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:05.952728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=320f7c0486a54b1fad4571e0642ee66d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:05.955617 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:05.996032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 893/1777] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:05.996032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503f687-79b3-4f96-90f2-7bd0bf70be8d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:05.996032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503f687-79b3-4f96-90f2-7bd0bf70be8d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:05.996032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1503f687-79b3-4f96-90f2-7bd0bf70be8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.038796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1503f687-79b3-4f96-90f2-7bd0bf70be8d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:06.040208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1503f687-79b3-4f96-90f2-7bd0bf70be8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:06.048705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 894/1778] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:06.052475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cab4d-9fcc-45a7-a18a-ff9be133211c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.052475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cab4d-9fcc-45a7-a18a-ff9be133211c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.052475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74cab4d-9fcc-45a7-a18a-ff9be133211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.078630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f74cab4d-9fcc-45a7-a18a-ff9be133211c None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:06.079912 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f74cab4d-9fcc-45a7-a18a-ff9be133211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:06.086789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '320f7c0486a54b1fad4571e0642ee66d', 'request_id': 'req-8d7524d6-05a6-4734-b3c2-48721171be50'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:06.093176 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '320f7c0486a54b1fad4571e0642ee66d', 'request_id': 'req-8d7524d6-05a6-4734-b3c2-48721171be50'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:06.099575 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '320f7c0486a54b1fad4571e0642ee66d', 'request_id': 'req-8d7524d6-05a6-4734-b3c2-48721171be50'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:06.145034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 895/1779] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:06.146402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59bac4-2434-43eb-b976-cff1f28e671d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.146864 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59bac4-2434-43eb-b976-cff1f28e671d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.147293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59bac4-2434-43eb-b976-cff1f28e671d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.167454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8b59bac4-2434-43eb-b976-cff1f28e671d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:06.168715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8b59bac4-2434-43eb-b976-cff1f28e671d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:06.176768 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 896/1780] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:06.178213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59bac4-2434-43eb-b976-cff1f28e671d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:06.189096 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59bac4-2434-43eb-b976-cff1f28e671d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:06.201419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c20b6d-11d3-4d00-8946-2ee3a0d2b72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:06.205256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] The token cache is being invalidate because project 320f7c0486a54b1fad4571e0642ee66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:06.205256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:06.205415 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c20b6d-11d3-4d00-8946-2ee3a0d2b72f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.205415 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c20b6d-11d3-4d00-8946-2ee3a0d2b72f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.205415 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c20b6d-11d3-4d00-8946-2ee3a0d2b72f admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.205617 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:06.205694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c20b6d-11d3-4d00-8946-2ee3a0d2b72f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:06.205694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c20b6d-11d3-4d00-8946-2ee3a0d2b72f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:06.205694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c20b6d-11d3-4d00-8946-2ee3a0d2b72f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:06.205896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 885/1781] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:05 2022] DELETE /identity/v3/projects/320f7c0486a54b1fad4571e0642ee66d => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:06.205896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:06.207200 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:06.221724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7524d6-05a6-4734-b3c2-48721171be50 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:06.227670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633e534-bd00-4eca-b527-d3931e0efd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:06.232008 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633e534-bd00-4eca-b527-d3931e0efd3c admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.232008 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633e534-bd00-4eca-b527-d3931e0efd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.232008 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f633e534-bd00-4eca-b527-d3931e0efd3c admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.232008 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633e534-bd00-4eca-b527-d3931e0efd3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:06.232008 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633e534-bd00-4eca-b527-d3931e0efd3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:06.232008 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f633e534-bd00-4eca-b527-d3931e0efd3c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:06.238070 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 897/1782] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:06.238070 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c20b6d-11d3-4d00-8946-2ee3a0d2b72f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:06.239873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-80c20b6d-11d3-4d00-8946-2ee3a0d2b72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:06.253410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 886/1783] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:06.254419 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633e534-bd00-4eca-b527-d3931e0efd3c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:06.256617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c20b6d-11d3-4d00-8946-2ee3a0d2b72f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:06.260869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f633e534-bd00-4eca-b527-d3931e0efd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:06.264396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e09fd3-8d17-4a61-beac-afb2ba5d9973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:06.265706 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e09fd3-8d17-4a61-beac-afb2ba5d9973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.266154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e09fd3-8d17-4a61-beac-afb2ba5d9973 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.266591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e09fd3-8d17-4a61-beac-afb2ba5d9973 admin admin] PATH_INFO: `/v3/users/7bec5383fe984de88c2fc0dedda55dea` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.268954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e09fd3-8d17-4a61-beac-afb2ba5d9973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bec5383fe984de88c2fc0dedda55dea)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:06.271663 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e09fd3-8d17-4a61-beac-afb2ba5d9973 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:06.281541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f633e534-bd00-4eca-b527-d3931e0efd3c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:06.288748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36812f-90db-4f1e-b4b2-653e7109764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:06.289376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36812f-90db-4f1e-b4b2-653e7109764f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.289658 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36812f-90db-4f1e-b4b2-653e7109764f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.289934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36812f-90db-4f1e-b4b2-653e7109764f admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.290760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36812f-90db-4f1e-b4b2-653e7109764f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:06.293238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36812f-90db-4f1e-b4b2-653e7109764f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:06.443145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 887/1784] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:06 2022] POST /identity/v3/projects => generated 389 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:06.444110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36812f-90db-4f1e-b4b2-653e7109764f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:06.503885 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36812f-90db-4f1e-b4b2-653e7109764f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:06.509379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bacb6-3354-4e43-83d8-94eef110f127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:06.509982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bacb6-3354-4e43-83d8-94eef110f127 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.510254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bacb6-3354-4e43-83d8-94eef110f127 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.510549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50bacb6-3354-4e43-83d8-94eef110f127 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.511161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bacb6-3354-4e43-83d8-94eef110f127 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:06.513172 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50bacb6-3354-4e43-83d8-94eef110f127 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:06.517969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d2e09fd3-8d17-4a61-beac-afb2ba5d9973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bec5383fe984de88c2fc0dedda55dea'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:06.518639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d2e09fd3-8d17-4a61-beac-afb2ba5d9973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bec5383fe984de88c2fc0dedda55dea'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:06.519255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d2e09fd3-8d17-4a61-beac-afb2ba5d9973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bec5383fe984de88c2fc0dedda55dea'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:06.526867 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d2e09fd3-8d17-4a61-beac-afb2ba5d9973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bec5383fe984de88c2fc0dedda55dea'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:06.538591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d2e09fd3-8d17-4a61-beac-afb2ba5d9973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bec5383fe984de88c2fc0dedda55dea'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:06.608159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 888/1785] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:06 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:06.611204 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bacb6-3354-4e43-83d8-94eef110f127 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:06.611204 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a50bacb6-3354-4e43-83d8-94eef110f127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:06.639683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 898/1786] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:06 2022] DELETE /identity/v3/users/7bec5383fe984de88c2fc0dedda55dea => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:06.640125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e09fd3-8d17-4a61-beac-afb2ba5d9973 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:06.644019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d2e09fd3-8d17-4a61-beac-afb2ba5d9973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:06.684956 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50bacb6-3354-4e43-83d8-94eef110f127 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:06.722612 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e09fd3-8d17-4a61-beac-afb2ba5d9973 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:06.727553 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e25c6-413e-437c-bbea-19db0c1dc835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:06.731995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e25c6-413e-437c-bbea-19db0c1dc835 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.731995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e25c6-413e-437c-bbea-19db0c1dc835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.731995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e25c6-413e-437c-bbea-19db0c1dc835 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.731995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e25c6-413e-437c-bbea-19db0c1dc835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:06.731995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e25c6-413e-437c-bbea-19db0c1dc835 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:06.750868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41e29b-bd6d-49f3-8628-13e5fdb812e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:06.751493 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41e29b-bd6d-49f3-8628-13e5fdb812e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.751774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41e29b-bd6d-49f3-8628-13e5fdb812e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.752084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b41e29b-bd6d-49f3-8628-13e5fdb812e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.752727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41e29b-bd6d-49f3-8628-13e5fdb812e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:06.754709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b41e29b-bd6d-49f3-8628-13e5fdb812e6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:06.815325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 899/1787] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:06 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:06.816549 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e25c6-413e-437c-bbea-19db0c1dc835 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:06.829419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e25c6-413e-437c-bbea-19db0c1dc835 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:06.834391 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5779e6-8ce4-4737-af33-fab249a5368d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:06.838556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 889/1788] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:06 2022] POST /identity/v3/users => generated 295 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:06.838688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5779e6-8ce4-4737-af33-fab249a5368d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.838688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5779e6-8ce4-4737-af33-fab249a5368d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.838688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5779e6-8ce4-4737-af33-fab249a5368d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.838688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5779e6-8ce4-4737-af33-fab249a5368d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:06.838688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5779e6-8ce4-4737-af33-fab249a5368d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:06.839541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41e29b-bd6d-49f3-8628-13e5fdb812e6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:06.848193 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 900/1789] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:06.849454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b41e29b-bd6d-49f3-8628-13e5fdb812e6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:06.852391 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5779e6-8ce4-4737-af33-fab249a5368d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:06.854126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d7a85-d4c9-4b15-a2fc-920f599c4943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:06.854723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d7a85-d4c9-4b15-a2fc-920f599c4943 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.855103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d7a85-d4c9-4b15-a2fc-920f599c4943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.855380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d7a85-d4c9-4b15-a2fc-920f599c4943 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.856074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d7a85-d4c9-4b15-a2fc-920f599c4943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:06.857655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d7a85-d4c9-4b15-a2fc-920f599c4943 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:06.862340 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5779e6-8ce4-4737-af33-fab249a5368d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:06.868250 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45859ffa-b11a-416c-8c88-478a54df58c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:06.869048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 890/1790] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:06.869174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45859ffa-b11a-416c-8c88-478a54df58c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.869281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45859ffa-b11a-416c-8c88-478a54df58c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.869512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45859ffa-b11a-416c-8c88-478a54df58c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.870160 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45859ffa-b11a-416c-8c88-478a54df58c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:06.871912 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45859ffa-b11a-416c-8c88-478a54df58c7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:06.872366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d7a85-d4c9-4b15-a2fc-920f599c4943 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:06.882462 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d7a85-d4c9-4b15-a2fc-920f599c4943 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:06.885968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 901/1791] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:06.887894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45859ffa-b11a-416c-8c88-478a54df58c7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:06.888006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b56f94-e073-446a-81c4-d6ce0a911f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:06.888573 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b56f94-e073-446a-81c4-d6ce0a911f49 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.888849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b56f94-e073-446a-81c4-d6ce0a911f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.889121 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b56f94-e073-446a-81c4-d6ce0a911f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.889985 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b56f94-e073-446a-81c4-d6ce0a911f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:06.891433 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b56f94-e073-446a-81c4-d6ce0a911f49 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:06.899575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45859ffa-b11a-416c-8c88-478a54df58c7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:06.903611 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 891/1792] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:06.906061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331fb76d-e5dc-4f21-aec8-8a06b630b887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:06.906719 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fb76d-e5dc-4f21-aec8-8a06b630b887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.906997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fb76d-e5dc-4f21-aec8-8a06b630b887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.907271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331fb76d-e5dc-4f21-aec8-8a06b630b887 admin admin] PATH_INFO: `/v3/projects/645d04d4d20349be80afd247e3fa1060/users/2e6c9b9d62a648fc99c951449c046fab/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.909454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b56f94-e073-446a-81c4-d6ce0a911f49 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:06.923541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b56f94-e073-446a-81c4-d6ce0a911f49 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:06.924699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fb76d-e5dc-4f21-aec8-8a06b630b887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=645d04d4d20349be80afd247e3fa1060, user_id=2e6c9b9d62a648fc99c951449c046fab, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:06.927397 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331fb76d-e5dc-4f21-aec8-8a06b630b887 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:06.929589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4df1e2-b793-4c68-ad0c-47271e05796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:06.930238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4df1e2-b793-4c68-ad0c-47271e05796a admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:06.930739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4df1e2-b793-4c68-ad0c-47271e05796a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:06.930875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4df1e2-b793-4c68-ad0c-47271e05796a admin admin] PATH_INFO: `/v3/projects/eb872d2a90d640fcb402f2671f62a912/users/12f0c1be623d4e9ca92823878ef0e1ab/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:06.950109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4df1e2-b793-4c68-ad0c-47271e05796a admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb872d2a90d640fcb402f2671f62a912, user_id=12f0c1be623d4e9ca92823878ef0e1ab, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:06.953307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4df1e2-b793-4c68-ad0c-47271e05796a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:07.045539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 902/1793] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:06 2022] PUT /identity/v3/projects/645d04d4d20349be80afd247e3fa1060/users/2e6c9b9d62a648fc99c951449c046fab/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:07.055925 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23ff5-1230-4ac9-b48b-012c9e26a16b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.056329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23ff5-1230-4ac9-b48b-012c9e26a16b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.056485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc23ff5-1230-4ac9-b48b-012c9e26a16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.072297 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 892/1794] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:06 2022] PUT /identity/v3/projects/eb872d2a90d640fcb402f2671f62a912/users/12f0c1be623d4e9ca92823878ef0e1ab/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:07.087619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875871e-c7ea-4bee-9a07-6eef93d6e54b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.087935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875871e-c7ea-4bee-9a07-6eef93d6e54b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.088228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875871e-c7ea-4bee-9a07-6eef93d6e54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.127007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-dcc23ff5-1230-4ac9-b48b-012c9e26a16b None None] MFA Rules not processed for user `2e6c9b9d62a648fc99c951449c046fab`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:07.135982 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dcc23ff5-1230-4ac9-b48b-012c9e26a16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:07.136320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d875871e-c7ea-4bee-9a07-6eef93d6e54b None None] MFA Rules not processed for user `12f0c1be623d4e9ca92823878ef0e1ab`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:07.136320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d875871e-c7ea-4bee-9a07-6eef93d6e54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:07.230272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 903/1795] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:07.231102 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc23ff5-1230-4ac9-b48b-012c9e26a16b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:07.232499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dcc23ff5-1230-4ac9-b48b-012c9e26a16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:07.240077 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 893/1796] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:07 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:07.241146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875871e-c7ea-4bee-9a07-6eef93d6e54b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:07.355421 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc23ff5-1230-4ac9-b48b-012c9e26a16b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:07.356558 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875871e-c7ea-4bee-9a07-6eef93d6e54b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:07.360834 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:07.365866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.365866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.365866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] PATH_INFO: `/v3/projects/4eeb0637d2fc4a1180fbc71ca3e83a6b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.366219 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58fb27-18be-4f0c-8702-589f60a6976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:07.366323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4eeb0637d2fc4a1180fbc71ca3e83a6b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:07.366411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58fb27-18be-4f0c-8702-589f60a6976b admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.366565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:07.366802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58fb27-18be-4f0c-8702-589f60a6976b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.367209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58fb27-18be-4f0c-8702-589f60a6976b admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.368066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58fb27-18be-4f0c-8702-589f60a6976b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:07.370144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58fb27-18be-4f0c-8702-589f60a6976b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:07.485543 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 894/1797] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:07 2022] POST /identity/v3/projects => generated 369 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:07.485543 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58fb27-18be-4f0c-8702-589f60a6976b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:07.533653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4eeb0637d2fc4a1180fbc71ca3e83a6b', 'request_id': 'req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.543318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4eeb0637d2fc4a1180fbc71ca3e83a6b', 'request_id': 'req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.555860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58fb27-18be-4f0c-8702-589f60a6976b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:07.567412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:07.621933 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b39905-d53b-414b-b341-9efc8a77577c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:07.622542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39905-d53b-414b-b341-9efc8a77577c admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.622819 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39905-d53b-414b-b341-9efc8a77577c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.623088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b39905-d53b-414b-b341-9efc8a77577c admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.623708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b39905-d53b-414b-b341-9efc8a77577c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:07.625616 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b39905-d53b-414b-b341-9efc8a77577c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:07.650526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4eeb0637d2fc4a1180fbc71ca3e83a6b', 'request_id': 'req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.661279 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] The token cache is being invalidate because project 4eeb0637d2fc4a1180fbc71ca3e83a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:07.661585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.662225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:07.663761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 904/1798] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:07 2022] DELETE /identity/v3/projects/4eeb0637d2fc4a1180fbc71ca3e83a6b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:07.664555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:07.665823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:07.674213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:07.678926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347eafdf-e8e0-46aa-ae01-050a19d5b9a4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:07.683596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830d09b-e384-4a3d-b33a-eefcd8245f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:07.684255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830d09b-e384-4a3d-b33a-eefcd8245f81 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.684532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830d09b-e384-4a3d-b33a-eefcd8245f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.684802 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e830d09b-e384-4a3d-b33a-eefcd8245f81 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.685421 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830d09b-e384-4a3d-b33a-eefcd8245f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:07.687320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e830d09b-e384-4a3d-b33a-eefcd8245f81 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:07.703384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 895/1799] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:07 2022] POST /identity/v3/projects => generated 389 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:07.704864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f66544-2ae1-4cb1-886d-42f6a560dc8e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.705156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f66544-2ae1-4cb1-886d-42f6a560dc8e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.705430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f66544-2ae1-4cb1-886d-42f6a560dc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.725202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b1f66544-2ae1-4cb1-886d-42f6a560dc8e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:07.726412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b1f66544-2ae1-4cb1-886d-42f6a560dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:07.784337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 896/1800] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:07.785166 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f66544-2ae1-4cb1-886d-42f6a560dc8e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:07.788246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 905/1801] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:07 2022] POST /identity/v3/users => generated 291 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:07.792102 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830d09b-e384-4a3d-b33a-eefcd8245f81 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:07.793861 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b1f66544-2ae1-4cb1-886d-42f6a560dc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:07.802876 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e830d09b-e384-4a3d-b33a-eefcd8245f81 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:07.805772 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f66544-2ae1-4cb1-886d-42f6a560dc8e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:07.807511 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b195496-0268-48b5-9edb-82f45109123b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:07.808187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b195496-0268-48b5-9edb-82f45109123b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.808467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b195496-0268-48b5-9edb-82f45109123b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.808739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b195496-0268-48b5-9edb-82f45109123b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.809403 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b195496-0268-48b5-9edb-82f45109123b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:07.810408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd79639-650a-45c4-bc88-5247214682f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:07.810951 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b195496-0268-48b5-9edb-82f45109123b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:07.811089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd79639-650a-45c4-bc88-5247214682f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.811369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd79639-650a-45c4-bc88-5247214682f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.811645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd79639-650a-45c4-bc88-5247214682f5 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.812307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd79639-650a-45c4-bc88-5247214682f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:07.814468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd79639-650a-45c4-bc88-5247214682f5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:07.823435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 906/1802] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:07.829021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504de8b-d4bc-46f1-b2b1-40703eef02fc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.829021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504de8b-d4bc-46f1-b2b1-40703eef02fc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.829021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504de8b-d4bc-46f1-b2b1-40703eef02fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.846160 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c504de8b-d4bc-46f1-b2b1-40703eef02fc None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:07.847466 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c504de8b-d4bc-46f1-b2b1-40703eef02fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:07.856429 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 907/1803] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:07.857665 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504de8b-d4bc-46f1-b2b1-40703eef02fc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:07.867285 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504de8b-d4bc-46f1-b2b1-40703eef02fc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:07.871942 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5da8cf-cbc3-40e1-adcb-8e94a9307777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:07.872611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5da8cf-cbc3-40e1-adcb-8e94a9307777 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.872891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5da8cf-cbc3-40e1-adcb-8e94a9307777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.873165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5da8cf-cbc3-40e1-adcb-8e94a9307777 admin admin] PATH_INFO: `/v3/projects/2fcdf5d9e2034e8992ea9941d320a47d/users/0e2455f0d3794adbb94e73ed48e72999/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.889377 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5da8cf-cbc3-40e1-adcb-8e94a9307777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcdf5d9e2034e8992ea9941d320a47d, user_id=0e2455f0d3794adbb94e73ed48e72999, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:07.892079 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5da8cf-cbc3-40e1-adcb-8e94a9307777 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:07.911159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 897/1804] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:07 2022] POST /identity/v3/users => generated 301 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:07.919050 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd79639-650a-45c4-bc88-5247214682f5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:07.927955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd79639-650a-45c4-bc88-5247214682f5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:07.934451 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa77ff-3014-4966-8c18-ded9b71d1235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:07.935166 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa77ff-3014-4966-8c18-ded9b71d1235 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.935524 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa77ff-3014-4966-8c18-ded9b71d1235 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.935874 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa77ff-3014-4966-8c18-ded9b71d1235 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.936619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa77ff-3014-4966-8c18-ded9b71d1235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:07.937598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa77ff-3014-4966-8c18-ded9b71d1235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:07.939652 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa77ff-3014-4966-8c18-ded9b71d1235 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:07.953144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 898/1805] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:07.953980 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa77ff-3014-4966-8c18-ded9b71d1235 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:07.964218 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa77ff-3014-4966-8c18-ded9b71d1235 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:07.971534 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de17cf-4558-441b-afbc-49eeb246ad11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:07.978593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de17cf-4558-441b-afbc-49eeb246ad11 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:07.978593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de17cf-4558-441b-afbc-49eeb246ad11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:07.978991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 908/1806] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:07 2022] PUT /identity/v3/projects/2fcdf5d9e2034e8992ea9941d320a47d/users/0e2455f0d3794adbb94e73ed48e72999/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:07.979078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de17cf-4558-441b-afbc-49eeb246ad11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:07.979156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5da8cf-cbc3-40e1-adcb-8e94a9307777 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:07.979231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de17cf-4558-441b-afbc-49eeb246ad11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:07.979231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de17cf-4558-441b-afbc-49eeb246ad11 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:07.985735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 899/1807] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:07.986578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de17cf-4558-441b-afbc-49eeb246ad11 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:07.997089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de17cf-4558-441b-afbc-49eeb246ad11 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.039056 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5da8cf-cbc3-40e1-adcb-8e94a9307777 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.044547 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564924d4-4719-4623-8873-c3a1b3934eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.045210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564924d4-4719-4623-8873-c3a1b3934eaf admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.045488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564924d4-4719-4623-8873-c3a1b3934eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.045754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564924d4-4719-4623-8873-c3a1b3934eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.046375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564924d4-4719-4623-8873-c3a1b3934eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.048298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564924d4-4719-4623-8873-c3a1b3934eaf admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.055088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa8a73-21c4-45eb-b78d-4d5037df9317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.055704 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8a73-21c4-45eb-b78d-4d5037df9317 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.056022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8a73-21c4-45eb-b78d-4d5037df9317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.056292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa8a73-21c4-45eb-b78d-4d5037df9317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.056934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa8a73-21c4-45eb-b78d-4d5037df9317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.058532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa8a73-21c4-45eb-b78d-4d5037df9317 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.069265 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 900/1808] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:08.070070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa8a73-21c4-45eb-b78d-4d5037df9317 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.079423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa8a73-21c4-45eb-b78d-4d5037df9317 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.085242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6fe03-1440-4996-93c1-494828799947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.086847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6fe03-1440-4996-93c1-494828799947 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.086847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6fe03-1440-4996-93c1-494828799947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.086847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6fe03-1440-4996-93c1-494828799947 admin admin] PATH_INFO: `/v3/projects/8b89b88ff2cb4dc883121972282bd4ac/users/37132e7a61c549d5bc0bf66ecbafa9ae/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.101088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6fe03-1440-4996-93c1-494828799947 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b89b88ff2cb4dc883121972282bd4ac, user_id=37132e7a61c549d5bc0bf66ecbafa9ae, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.104330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df6fe03-1440-4996-93c1-494828799947 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.132949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 909/1809] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:07 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:08.133755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564924d4-4719-4623-8873-c3a1b3934eaf admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.194677 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564924d4-4719-4623-8873-c3a1b3934eaf admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.199170 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236404f-456c-4c3f-ba70-e29d95b217cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.199818 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236404f-456c-4c3f-ba70-e29d95b217cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.200127 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236404f-456c-4c3f-ba70-e29d95b217cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.200398 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236404f-456c-4c3f-ba70-e29d95b217cf admin admin] PATH_INFO: `/v3/projects/2fcdf5d9e2034e8992ea9941d320a47d/users/0e2455f0d3794adbb94e73ed48e72999/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.202265 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236404f-456c-4c3f-ba70-e29d95b217cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fcdf5d9e2034e8992ea9941d320a47d, user_id=0e2455f0d3794adbb94e73ed48e72999, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.204921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236404f-456c-4c3f-ba70-e29d95b217cf admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.212701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 901/1810] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:08 2022] PUT /identity/v3/projects/8b89b88ff2cb4dc883121972282bd4ac/users/37132e7a61c549d5bc0bf66ecbafa9ae/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:08.213323 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6fe03-1440-4996-93c1-494828799947 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.216503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 910/1811] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:08 2022] PUT /identity/v3/projects/2fcdf5d9e2034e8992ea9941d320a47d/users/0e2455f0d3794adbb94e73ed48e72999/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:08.217301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236404f-456c-4c3f-ba70-e29d95b217cf admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.278466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6fe03-1440-4996-93c1-494828799947 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.283168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66a1cc-022f-4282-8772-45384e5f7070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.284007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66a1cc-022f-4282-8772-45384e5f7070 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.284298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66a1cc-022f-4282-8772-45384e5f7070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.284551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236404f-456c-4c3f-ba70-e29d95b217cf admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.285851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d66a1cc-022f-4282-8772-45384e5f7070 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.286729 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66a1cc-022f-4282-8772-45384e5f7070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.288716 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d66a1cc-022f-4282-8772-45384e5f7070 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.289509 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fadf21-70f8-4c17-b253-b87712bbaee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.290177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fadf21-70f8-4c17-b253-b87712bbaee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.290429 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fadf21-70f8-4c17-b253-b87712bbaee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.290932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fadf21-70f8-4c17-b253-b87712bbaee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.291521 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fadf21-70f8-4c17-b253-b87712bbaee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.293400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fadf21-70f8-4c17-b253-b87712bbaee8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.314040 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 911/1812] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:08.315336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a64d38-432e-42e0-ba94-4cb3d40fe87e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.315620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a64d38-432e-42e0-ba94-4cb3d40fe87e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.315913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a64d38-432e-42e0-ba94-4cb3d40fe87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.357081 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-29a64d38-432e-42e0-ba94-4cb3d40fe87e None None] MFA Rules not processed for user `0e2455f0d3794adbb94e73ed48e72999`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:08.358014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 902/1813] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:08 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:08.359263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66a1cc-022f-4282-8772-45384e5f7070 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.364142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-29a64d38-432e-42e0-ba94-4cb3d40fe87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:08.374311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d66a1cc-022f-4282-8772-45384e5f7070 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.398441 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a190bc1-6468-46e8-a1d8-d0f1b5701b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.399394 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190bc1-6468-46e8-a1d8-d0f1b5701b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.401450 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190bc1-6468-46e8-a1d8-d0f1b5701b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.401450 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a190bc1-6468-46e8-a1d8-d0f1b5701b7d admin admin] PATH_INFO: `/v3/projects/8b89b88ff2cb4dc883121972282bd4ac/users/37132e7a61c549d5bc0bf66ecbafa9ae/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.402374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a190bc1-6468-46e8-a1d8-d0f1b5701b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b89b88ff2cb4dc883121972282bd4ac, user_id=37132e7a61c549d5bc0bf66ecbafa9ae, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.405231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a190bc1-6468-46e8-a1d8-d0f1b5701b7d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.436681 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 903/1814] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:08 2022] PUT /identity/v3/projects/8b89b88ff2cb4dc883121972282bd4ac/users/37132e7a61c549d5bc0bf66ecbafa9ae/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:08.436681 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a190bc1-6468-46e8-a1d8-d0f1b5701b7d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.463396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 912/1815] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:08.463396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd5509-00d2-4ed0-aa6c-b2a38a9557c5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.463396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd5509-00d2-4ed0-aa6c-b2a38a9557c5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.463396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd5509-00d2-4ed0-aa6c-b2a38a9557c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.509918 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-58fd5509-00d2-4ed0-aa6c-b2a38a9557c5 None None] MFA Rules not processed for user `37132e7a61c549d5bc0bf66ecbafa9ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:08.511391 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-58fd5509-00d2-4ed0-aa6c-b2a38a9557c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:08.529249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a190bc1-6468-46e8-a1d8-d0f1b5701b7d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.534046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8d484-4c4e-497e-8680-875cd7f8dcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.534648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8d484-4c4e-497e-8680-875cd7f8dcd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.534924 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8d484-4c4e-497e-8680-875cd7f8dcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.535190 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8d484-4c4e-497e-8680-875cd7f8dcd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.535890 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8d484-4c4e-497e-8680-875cd7f8dcd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.538398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a8d484-4c4e-497e-8680-875cd7f8dcd2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.548169 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 904/1816] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:08.552645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8d484-4c4e-497e-8680-875cd7f8dcd2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.552645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b5a8d484-4c4e-497e-8680-875cd7f8dcd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:08.581228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 913/1817] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:08 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:08.582076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd5509-00d2-4ed0-aa6c-b2a38a9557c5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.592812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd5509-00d2-4ed0-aa6c-b2a38a9557c5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.597537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d08f8-a31b-45e5-b51e-b286a4a83c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.598250 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d08f8-a31b-45e5-b51e-b286a4a83c2c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.598532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d08f8-a31b-45e5-b51e-b286a4a83c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.599404 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692d08f8-a31b-45e5-b51e-b286a4a83c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.600076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d08f8-a31b-45e5-b51e-b286a4a83c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.601671 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692d08f8-a31b-45e5-b51e-b286a4a83c2c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.607936 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8d484-4c4e-497e-8680-875cd7f8dcd2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.611558 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 914/1818] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:08.617584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7424d25-4e60-45de-b788-b85835f8301c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.617584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7424d25-4e60-45de-b788-b85835f8301c service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.617846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d08f8-a31b-45e5-b51e-b286a4a83c2c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.617948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7424d25-4e60-45de-b788-b85835f8301c service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.617948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7424d25-4e60-45de-b788-b85835f8301c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.618114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-692d08f8-a31b-45e5-b51e-b286a4a83c2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:08.626794 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692d08f8-a31b-45e5-b51e-b286a4a83c2c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.631607 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bfee9-081b-4c95-bb61-464609f8bcc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.632406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bfee9-081b-4c95-bb61-464609f8bcc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.632785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bfee9-081b-4c95-bb61-464609f8bcc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.633089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19bfee9-081b-4c95-bb61-464609f8bcc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.643433 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bfee9-081b-4c95-bb61-464609f8bcc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.644952 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19bfee9-081b-4c95-bb61-464609f8bcc1 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.659978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 915/1819] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:08 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:08.660619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bfee9-081b-4c95-bb61-464609f8bcc1 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.673855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19bfee9-081b-4c95-bb61-464609f8bcc1 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.681808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9707c44-cceb-45eb-a403-1cb5f6c0275f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.682480 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9707c44-cceb-45eb-a403-1cb5f6c0275f admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.682760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9707c44-cceb-45eb-a403-1cb5f6c0275f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.683031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9707c44-cceb-45eb-a403-1cb5f6c0275f admin admin] PATH_INFO: `/v3/projects/43e12dca7d63471c8deb3883b0da16db/users/70e35fabd2ad456caaf73f164f95b0fd/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.705771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7424d25-4e60-45de-b788-b85835f8301c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.707215 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7424d25-4e60-45de-b788-b85835f8301c service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.709672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9707c44-cceb-45eb-a403-1cb5f6c0275f admin admin] RBAC: Authorizing `identity:create_grant(project_id=43e12dca7d63471c8deb3883b0da16db, user_id=70e35fabd2ad456caaf73f164f95b0fd, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.714230 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9707c44-cceb-45eb-a403-1cb5f6c0275f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.725154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 905/1820] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:08.766997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 916/1821] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:08 2022] PUT /identity/v3/projects/43e12dca7d63471c8deb3883b0da16db/users/70e35fabd2ad456caaf73f164f95b0fd/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:08.779911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433f349-3165-4da3-86ef-43bd3a767a28 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.780208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433f349-3165-4da3-86ef-43bd3a767a28 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.780487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0433f349-3165-4da3-86ef-43bd3a767a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.810143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0433f349-3165-4da3-86ef-43bd3a767a28 None None] MFA Rules not processed for user `70e35fabd2ad456caaf73f164f95b0fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:08.813260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0433f349-3165-4da3-86ef-43bd3a767a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:08.839344 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9707c44-cceb-45eb-a403-1cb5f6c0275f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.884420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 906/1822] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:08.885500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433f349-3165-4da3-86ef-43bd3a767a28 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:08.891168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:08.904334 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9707c44-cceb-45eb-a403-1cb5f6c0275f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.909212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc421d1-b77c-4e76-92b4-3735ef565d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.909845 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc421d1-b77c-4e76-92b4-3735ef565d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.910126 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc421d1-b77c-4e76-92b4-3735ef565d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.910402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc421d1-b77c-4e76-92b4-3735ef565d37 admin admin] PATH_INFO: `/v3/users/12f0c1be623d4e9ca92823878ef0e1ab` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.911872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc421d1-b77c-4e76-92b4-3735ef565d37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f0c1be623d4e9ca92823878ef0e1ab)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:08.913812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc421d1-b77c-4e76-92b4-3735ef565d37 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:08.942321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0433f349-3165-4da3-86ef-43bd3a767a28 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:08.947105 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44cf00-fa2c-4859-8f7d-d5b2e5dad8a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:08.947892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44cf00-fa2c-4859-8f7d-d5b2e5dad8a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:08.953005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44cf00-fa2c-4859-8f7d-d5b2e5dad8a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:08.953005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd44cf00-fa2c-4859-8f7d-d5b2e5dad8a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:08.953005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:08.953005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fd44cf00-fa2c-4859-8f7d-d5b2e5dad8a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:09.015076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44cf00-fa2c-4859-8f7d-d5b2e5dad8a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:09.016433 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd44cf00-fa2c-4859-8f7d-d5b2e5dad8a6 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:09.027822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 907/1823] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:09.028593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44cf00-fa2c-4859-8f7d-d5b2e5dad8a6 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:09.040172 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd44cf00-fa2c-4859-8f7d-d5b2e5dad8a6 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:09.045212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acd863-12c3-4674-b6ee-e57654f710b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:09.045879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acd863-12c3-4674-b6ee-e57654f710b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:09.050468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acd863-12c3-4674-b6ee-e57654f710b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:09.050468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acd863-12c3-4674-b6ee-e57654f710b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:09.050468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acd863-12c3-4674-b6ee-e57654f710b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:09.050468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56acd863-12c3-4674-b6ee-e57654f710b0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:09.086515 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7fc421d1-b77c-4e76-92b4-3735ef565d37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f0c1be623d4e9ca92823878ef0e1ab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:09.087301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7fc421d1-b77c-4e76-92b4-3735ef565d37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f0c1be623d4e9ca92823878ef0e1ab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:09.089370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7fc421d1-b77c-4e76-92b4-3735ef565d37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f0c1be623d4e9ca92823878ef0e1ab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:09.097410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7fc421d1-b77c-4e76-92b4-3735ef565d37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f0c1be623d4e9ca92823878ef0e1ab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:09.111915 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7fc421d1-b77c-4e76-92b4-3735ef565d37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f0c1be623d4e9ca92823878ef0e1ab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:09.169668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 908/1824] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:09 2022] POST /identity/v3/projects => generated 387 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:09.173810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acd863-12c3-4674-b6ee-e57654f710b0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:09.175735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-56acd863-12c3-4674-b6ee-e57654f710b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:09.240260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56acd863-12c3-4674-b6ee-e57654f710b0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:09.244985 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00663c44-6cf7-4560-ab66-458879b49cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:09.245590 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663c44-6cf7-4560-ab66-458879b49cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:09.245875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663c44-6cf7-4560-ab66-458879b49cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:09.246153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00663c44-6cf7-4560-ab66-458879b49cc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:09.246791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00663c44-6cf7-4560-ab66-458879b49cc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:09.248780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00663c44-6cf7-4560-ab66-458879b49cc3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:09.254662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 917/1825] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:08 2022] DELETE /identity/v3/users/12f0c1be623d4e9ca92823878ef0e1ab => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:09.259670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cf4b1-2b0f-4cd1-b804-fa45d8cfaccd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:09.263921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cf4b1-2b0f-4cd1-b804-fa45d8cfaccd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:09.263921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599cf4b1-2b0f-4cd1-b804-fa45d8cfaccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:09.284259 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-599cf4b1-2b0f-4cd1-b804-fa45d8cfaccd None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:09.285466 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-599cf4b1-2b0f-4cd1-b804-fa45d8cfaccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:09.344453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 918/1826] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:09.351251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 909/1827] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:09 2022] POST /identity/v3/users => generated 294 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:09.355138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cf4b1-2b0f-4cd1-b804-fa45d8cfaccd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:09.355557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00663c44-6cf7-4560-ab66-458879b49cc3 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:09.357849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-00663c44-6cf7-4560-ab66-458879b49cc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:09.367903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599cf4b1-2b0f-4cd1-b804-fa45d8cfaccd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:09.373654 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e9a17-3d80-4ce3-90cd-679ec9840313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:09.374263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e9a17-3d80-4ce3-90cd-679ec9840313 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:09.374536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e9a17-3d80-4ce3-90cd-679ec9840313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:09.374807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e9a17-3d80-4ce3-90cd-679ec9840313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:09.375458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e9a17-3d80-4ce3-90cd-679ec9840313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:09.377252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e9a17-3d80-4ce3-90cd-679ec9840313 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:09.388578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 919/1828] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:09.392384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e9a17-3d80-4ce3-90cd-679ec9840313 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:09.403200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e9a17-3d80-4ce3-90cd-679ec9840313 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:09.407946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f6269-cfa2-43f1-98fa-884ae217145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:09.408540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f6269-cfa2-43f1-98fa-884ae217145e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:09.408822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f6269-cfa2-43f1-98fa-884ae217145e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:09.409094 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f6269-cfa2-43f1-98fa-884ae217145e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:09.409730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f6269-cfa2-43f1-98fa-884ae217145e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:09.411960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47f6269-cfa2-43f1-98fa-884ae217145e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:09.422006 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 920/1829] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:09.424014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00663c44-6cf7-4560-ab66-458879b49cc3 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:09.426163 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f6269-cfa2-43f1-98fa-884ae217145e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:09.436125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f6269-cfa2-43f1-98fa-884ae217145e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:09.441567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717de74f-28f8-4b93-af64-713a02552e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:09.442271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717de74f-28f8-4b93-af64-713a02552e3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:09.443087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717de74f-28f8-4b93-af64-713a02552e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:09.443359 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717de74f-28f8-4b93-af64-713a02552e3f admin admin] PATH_INFO: `/v3/projects/5699fa991ac545ba9a0370fc6f2f20df/users/551aa45aba6c4feeb923023835c5ca1d/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:09.459876 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717de74f-28f8-4b93-af64-713a02552e3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5699fa991ac545ba9a0370fc6f2f20df, user_id=551aa45aba6c4feeb923023835c5ca1d, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:09.462988 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717de74f-28f8-4b93-af64-713a02552e3f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:09.483817 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a92977-0208-4ce8-8463-29a5bb4e1e17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:09.484448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a92977-0208-4ce8-8463-29a5bb4e1e17 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:09.484723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a92977-0208-4ce8-8463-29a5bb4e1e17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:09.484991 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a92977-0208-4ce8-8463-29a5bb4e1e17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:09.497487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a92977-0208-4ce8-8463-29a5bb4e1e17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:09.497487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a92977-0208-4ce8-8463-29a5bb4e1e17 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:09.505477 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 910/1830] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:09.549373 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 921/1831] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:09 2022] PUT /identity/v3/projects/5699fa991ac545ba9a0370fc6f2f20df/users/551aa45aba6c4feeb923023835c5ca1d/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:09.561358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e30bc-f0c8-43a3-b4a9-7e5dc22987f3 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:09.561649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e30bc-f0c8-43a3-b4a9-7e5dc22987f3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:09.561922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e30bc-f0c8-43a3-b4a9-7e5dc22987f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:09.625103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d08e30bc-f0c8-43a3-b4a9-7e5dc22987f3 None None] MFA Rules not processed for user `551aa45aba6c4feeb923023835c5ca1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:09.626586 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d08e30bc-f0c8-43a3-b4a9-7e5dc22987f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:09.761891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 911/1832] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:09.765393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717de74f-28f8-4b93-af64-713a02552e3f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:09.908291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:09.947359 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717de74f-28f8-4b93-af64-713a02552e3f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:09.953838 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844e45d-a3da-4107-b5b0-a28bd9fdfd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:09.954482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844e45d-a3da-4107-b5b0-a28bd9fdfd8e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:09.959681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844e45d-a3da-4107-b5b0-a28bd9fdfd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:09.959942 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:09.960041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1844e45d-a3da-4107-b5b0-a28bd9fdfd8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:09.960426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844e45d-a3da-4107-b5b0-a28bd9fdfd8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:09.962371 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1844e45d-a3da-4107-b5b0-a28bd9fdfd8e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:10.074663 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 922/1833] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:09 2022] POST /identity/v3/projects => generated 385 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:10.078437 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e30bc-f0c8-43a3-b4a9-7e5dc22987f3 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:10.090515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e30bc-f0c8-43a3-b4a9-7e5dc22987f3 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:10.148619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212158c-0579-458d-8826-6043f0bb01eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:10.149387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212158c-0579-458d-8826-6043f0bb01eb admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:10.149770 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212158c-0579-458d-8826-6043f0bb01eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:10.150149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3212158c-0579-458d-8826-6043f0bb01eb admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:10.150906 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212158c-0579-458d-8826-6043f0bb01eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:10.153090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3212158c-0579-458d-8826-6043f0bb01eb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:10.162826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844e45d-a3da-4107-b5b0-a28bd9fdfd8e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:10.164831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1844e45d-a3da-4107-b5b0-a28bd9fdfd8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:10.178752 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1844e45d-a3da-4107-b5b0-a28bd9fdfd8e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:10.184173 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:10.184968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:10.185606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:10.185606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] PATH_INFO: `/v3/projects/eb872d2a90d640fcb402f2671f62a912` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:10.187275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb872d2a90d640fcb402f2671f62a912)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:10.189810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:10.252964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 912/1834] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:10 2022] POST /identity/v3/users => generated 299 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:10.258858 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212158c-0579-458d-8826-6043f0bb01eb admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:10.289923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3212158c-0579-458d-8826-6043f0bb01eb admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:10.295655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926cde7-a8f4-4ce0-8726-28d02ebd3491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:10.296328 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926cde7-a8f4-4ce0-8726-28d02ebd3491 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:10.296617 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926cde7-a8f4-4ce0-8726-28d02ebd3491 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:10.297077 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b926cde7-a8f4-4ce0-8726-28d02ebd3491 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:10.297881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926cde7-a8f4-4ce0-8726-28d02ebd3491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:10.299474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b926cde7-a8f4-4ce0-8726-28d02ebd3491 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:10.311747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 913/1835] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:10.316621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926cde7-a8f4-4ce0-8726-28d02ebd3491 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:10.327484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b926cde7-a8f4-4ce0-8726-28d02ebd3491 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:10.332754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961eac-85aa-4421-9635-47093e0fa331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:10.334619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961eac-85aa-4421-9635-47093e0fa331 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:10.334960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961eac-85aa-4421-9635-47093e0fa331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:10.340804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf961eac-85aa-4421-9635-47093e0fa331 admin admin] PATH_INFO: `/v3/projects/c8e209357c6845f6b9b5d761c7481bdc/users/79024a6604b64c349b11b44fcaf8d297/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:10.350049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961eac-85aa-4421-9635-47093e0fa331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e209357c6845f6b9b5d761c7481bdc, user_id=79024a6604b64c349b11b44fcaf8d297, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:10.352744 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf961eac-85aa-4421-9635-47093e0fa331 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:10.447936 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 914/1836] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:10 2022] PUT /identity/v3/projects/c8e209357c6845f6b9b5d761c7481bdc/users/79024a6604b64c349b11b44fcaf8d297/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:10.451812 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961eac-85aa-4421-9635-47093e0fa331 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:10.464755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb872d2a90d640fcb402f2671f62a912', 'request_id': 'req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:10.472153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb872d2a90d640fcb402f2671f62a912', 'request_id': 'req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:10.522400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf961eac-85aa-4421-9635-47093e0fa331 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:10.579208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba7839-38dc-41ec-8df9-6f7c59509401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:10.579825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7839-38dc-41ec-8df9-6f7c59509401 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:10.580133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7839-38dc-41ec-8df9-6f7c59509401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:10.580572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba7839-38dc-41ec-8df9-6f7c59509401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:10.581039 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba7839-38dc-41ec-8df9-6f7c59509401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:10.582627 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba7839-38dc-41ec-8df9-6f7c59509401 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:10.592561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 915/1837] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:10.596723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba7839-38dc-41ec-8df9-6f7c59509401 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:10.606010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba7839-38dc-41ec-8df9-6f7c59509401 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:10.610579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3302d3e-6dda-4bbd-bcec-54fd0f016f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:10.611188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302d3e-6dda-4bbd-bcec-54fd0f016f45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:10.611465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302d3e-6dda-4bbd-bcec-54fd0f016f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:10.611733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3302d3e-6dda-4bbd-bcec-54fd0f016f45 admin admin] PATH_INFO: `/v3/projects/c8e209357c6845f6b9b5d761c7481bdc/users/79024a6604b64c349b11b44fcaf8d297/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:10.613685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3302d3e-6dda-4bbd-bcec-54fd0f016f45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e209357c6845f6b9b5d761c7481bdc, user_id=79024a6604b64c349b11b44fcaf8d297, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:10.616911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3302d3e-6dda-4bbd-bcec-54fd0f016f45 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:10.626683 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 916/1838] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:10 2022] PUT /identity/v3/projects/c8e209357c6845f6b9b5d761c7481bdc/users/79024a6604b64c349b11b44fcaf8d297/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:10.638941 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dc949-072d-42cf-bea1-443b8c945bb3 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:10.639266 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dc949-072d-42cf-bea1-443b8c945bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:10.639576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2dc949-072d-42cf-bea1-443b8c945bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:10.666382 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9b2dc949-072d-42cf-bea1-443b8c945bb3 None None] MFA Rules not processed for user `79024a6604b64c349b11b44fcaf8d297`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:10.667603 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9b2dc949-072d-42cf-bea1-443b8c945bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:10.735369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 917/1839] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:10.746888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dc949-072d-42cf-bea1-443b8c945bb3 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:10.748275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9b2dc949-072d-42cf-bea1-443b8c945bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:10.827699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2dc949-072d-42cf-bea1-443b8c945bb3 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:10.827699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113783f-eeb0-4622-b2c7-9cd47837a0af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:10.827699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113783f-eeb0-4622-b2c7-9cd47837a0af service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:10.827699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113783f-eeb0-4622-b2c7-9cd47837a0af service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:10.828144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113783f-eeb0-4622-b2c7-9cd47837a0af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:10.828144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113783f-eeb0-4622-b2c7-9cd47837a0af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:10.828144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f113783f-eeb0-4622-b2c7-9cd47837a0af service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:10.836541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 918/1840] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:11.422111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb872d2a90d640fcb402f2671f62a912', 'request_id': 'req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.433058 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] The token cache is being invalidate because project eb872d2a90d640fcb402f2671f62a912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:11.433443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.434107 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.435618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 923/1841] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:10 2022] DELETE /identity/v3/projects/eb872d2a90d640fcb402f2671f62a912 => generated 0 bytes in 1274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:11.440217 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113783f-eeb0-4622-b2c7-9cd47837a0af service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:11.521001 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f113783f-eeb0-4622-b2c7-9cd47837a0af service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:11.526818 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759731c9-976c-4062-85df-7dd86c220d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:11.527474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759731c9-976c-4062-85df-7dd86c220d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:11.527751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759731c9-976c-4062-85df-7dd86c220d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:11.528074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759731c9-976c-4062-85df-7dd86c220d9b admin admin] PATH_INFO: `/v3/users/37132e7a61c549d5bc0bf66ecbafa9ae` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:11.529245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759731c9-976c-4062-85df-7dd86c220d9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=37132e7a61c549d5bc0bf66ecbafa9ae)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:11.531373 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759731c9-976c-4062-85df-7dd86c220d9b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:11.774250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-759731c9-976c-4062-85df-7dd86c220d9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37132e7a61c549d5bc0bf66ecbafa9ae'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.786788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-759731c9-976c-4062-85df-7dd86c220d9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37132e7a61c549d5bc0bf66ecbafa9ae'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.789620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-759731c9-976c-4062-85df-7dd86c220d9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37132e7a61c549d5bc0bf66ecbafa9ae'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.789620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-759731c9-976c-4062-85df-7dd86c220d9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37132e7a61c549d5bc0bf66ecbafa9ae'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.794979 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-759731c9-976c-4062-85df-7dd86c220d9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37132e7a61c549d5bc0bf66ecbafa9ae'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:11.893465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 919/1842] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:11 2022] DELETE /identity/v3/users/37132e7a61c549d5bc0bf66ecbafa9ae => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:12.398398 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:12.400133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:12.431981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e0e15f-7444-4b4d-b8b8-50d6e72f4832 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:12.521926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02648d0d-5d22-45af-bfaf-2544b20e06ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:12.522725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02648d0d-5d22-45af-bfaf-2544b20e06ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:12.523145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02648d0d-5d22-45af-bfaf-2544b20e06ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:12.523584 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02648d0d-5d22-45af-bfaf-2544b20e06ed admin admin] PATH_INFO: `/v3/projects/8b89b88ff2cb4dc883121972282bd4ac` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:12.526081 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02648d0d-5d22-45af-bfaf-2544b20e06ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b89b88ff2cb4dc883121972282bd4ac)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:12.528187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02648d0d-5d22-45af-bfaf-2544b20e06ed admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:12.669316 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:12.674315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-02648d0d-5d22-45af-bfaf-2544b20e06ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b89b88ff2cb4dc883121972282bd4ac', 'request_id': 'req-02648d0d-5d22-45af-bfaf-2544b20e06ed'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:12.690060 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-02648d0d-5d22-45af-bfaf-2544b20e06ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b89b88ff2cb4dc883121972282bd4ac', 'request_id': 'req-02648d0d-5d22-45af-bfaf-2544b20e06ed'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:12.721720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759731c9-976c-4062-85df-7dd86c220d9b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:12.724012 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-759731c9-976c-4062-85df-7dd86c220d9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:12.783177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-02648d0d-5d22-45af-bfaf-2544b20e06ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b89b88ff2cb4dc883121972282bd4ac', 'request_id': 'req-02648d0d-5d22-45af-bfaf-2544b20e06ed'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:12.798850 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-02648d0d-5d22-45af-bfaf-2544b20e06ed admin admin] The token cache is being invalidate because project 8b89b88ff2cb4dc883121972282bd4ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:12.799149 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-02648d0d-5d22-45af-bfaf-2544b20e06ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:12.799836 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-02648d0d-5d22-45af-bfaf-2544b20e06ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:12.801398 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 924/1843] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:12 2022] DELETE /identity/v3/projects/8b89b88ff2cb4dc883121972282bd4ac => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:12.808201 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf30f24-296d-4fa9-bdd1-fea0dbd2b9c7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:12.812807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf30f24-296d-4fa9-bdd1-fea0dbd2b9c7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:12.812807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf30f24-296d-4fa9-bdd1-fea0dbd2b9c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:12.825176 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759731c9-976c-4062-85df-7dd86c220d9b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:12.838791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2bf30f24-296d-4fa9-bdd1-fea0dbd2b9c7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:12.841135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2bf30f24-296d-4fa9-bdd1-fea0dbd2b9c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:12.881697 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f05dd-df52-4593-b1b0-23cd9dcfbe8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:12.882945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f05dd-df52-4593-b1b0-23cd9dcfbe8a service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:12.882945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f05dd-df52-4593-b1b0-23cd9dcfbe8a service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:12.883167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f05dd-df52-4593-b1b0-23cd9dcfbe8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:12.889487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8b1f05dd-df52-4593-b1b0-23cd9dcfbe8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:12.921097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 925/1844] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:12.922496 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2d428-948e-477e-9652-4476b910bcec None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:12.922832 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2d428-948e-477e-9652-4476b910bcec None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:12.923048 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2d428-948e-477e-9652-4476b910bcec None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:12.925171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 926/1845] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 24 08:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:09:12.928718 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121bff1-a3bb-4d32-9cc1-8fc51241756b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:12.929138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121bff1-a3bb-4d32-9cc1-8fc51241756b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:12.929421 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121bff1-a3bb-4d32-9cc1-8fc51241756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:12.954329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6121bff1-a3bb-4d32-9cc1-8fc51241756b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:12.955576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6121bff1-a3bb-4d32-9cc1-8fc51241756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:12.965233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f05dd-df52-4593-b1b0-23cd9dcfbe8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:12.966422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 927/1846] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:12.967206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f05dd-df52-4593-b1b0-23cd9dcfbe8a service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:12.967955 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b56561-6f72-4072-af35-0b3e92144ca9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:12.968376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b56561-6f72-4072-af35-0b3e92144ca9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:12.968660 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b56561-6f72-4072-af35-0b3e92144ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:12.979760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 920/1847] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:12.980599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f05dd-df52-4593-b1b0-23cd9dcfbe8a service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:13.002504 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e8b56561-6f72-4072-af35-0b3e92144ca9 None None] MFA Rules not processed for user `9b99cff7a5f549adadee002f8ab1f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:13.005103 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e8b56561-6f72-4072-af35-0b3e92144ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:13.005472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f05dd-df52-4593-b1b0-23cd9dcfbe8a service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:13.011834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2beb3-7d74-4dd5-a33b-75e8cb238a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:13.013165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2beb3-7d74-4dd5-a33b-75e8cb238a02 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:13.013457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2beb3-7d74-4dd5-a33b-75e8cb238a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:13.013733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed2beb3-7d74-4dd5-a33b-75e8cb238a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:13.014670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2beb3-7d74-4dd5-a33b-75e8cb238a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:13.014977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2beb3-7d74-4dd5-a33b-75e8cb238a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:13.017062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed2beb3-7d74-4dd5-a33b-75e8cb238a02 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:13.037352 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 921/1848] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:13.038593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2beb3-7d74-4dd5-a33b-75e8cb238a02 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:13.055110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed2beb3-7d74-4dd5-a33b-75e8cb238a02 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:13.061066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8b347-ed3f-41f1-8e44-3fc4f05037ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:13.061821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8b347-ed3f-41f1-8e44-3fc4f05037ad admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:13.062376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8b347-ed3f-41f1-8e44-3fc4f05037ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:13.062833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef8b347-ed3f-41f1-8e44-3fc4f05037ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:13.063878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8b347-ed3f-41f1-8e44-3fc4f05037ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:13.065598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef8b347-ed3f-41f1-8e44-3fc4f05037ad admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:13.103070 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 928/1849] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 24 08:09:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:13.117268 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b56561-6f72-4072-af35-0b3e92144ca9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:13.126204 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e8b56561-6f72-4072-af35-0b3e92144ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:13.137729 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b56561-6f72-4072-af35-0b3e92144ca9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:13.145855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a68c0-9e06-4014-b263-f606af6e21f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:13.146895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a68c0-9e06-4014-b263-f606af6e21f2 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:13.147316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a68c0-9e06-4014-b263-f606af6e21f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:13.147726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a68c0-9e06-4014-b263-f606af6e21f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:13.165002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a68c0-9e06-4014-b263-f606af6e21f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:13.167521 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a68c0-9e06-4014-b263-f606af6e21f2 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:13.173280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 922/1850] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:13 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:13.177702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8b347-ed3f-41f1-8e44-3fc4f05037ad admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:13.187909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 929/1851] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:13.258272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef8b347-ed3f-41f1-8e44-3fc4f05037ad admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:13.263395 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6140d-b71d-4e9e-947f-ff6526d85a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:13.264207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6140d-b71d-4e9e-947f-ff6526d85a44 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:13.264608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6140d-b71d-4e9e-947f-ff6526d85a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:13.264884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6140d-b71d-4e9e-947f-ff6526d85a44 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:13.265518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6140d-b71d-4e9e-947f-ff6526d85a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:13.267531 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6140d-b71d-4e9e-947f-ff6526d85a44 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:13.350288 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:13.404526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 923/1852] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:13 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:13.405675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a68c0-9e06-4014-b263-f606af6e21f2 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:13.414874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a68c0-9e06-4014-b263-f606af6e21f2 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:13.426063 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4e364-38db-4607-b86b-1ebb358005b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:13.427428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4e364-38db-4607-b86b-1ebb358005b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:13.427920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4e364-38db-4607-b86b-1ebb358005b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:13.427920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4e364-38db-4607-b86b-1ebb358005b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:13.428574 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4e364-38db-4607-b86b-1ebb358005b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:13.431731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4e364-38db-4607-b86b-1ebb358005b6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:13.443749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 930/1853] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:13.447985 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6140d-b71d-4e9e-947f-ff6526d85a44 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:13.461274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6140d-b71d-4e9e-947f-ff6526d85a44 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:13.467546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa67041-dac3-4429-bdaa-f83cd1ebc614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:13.467546 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa67041-dac3-4429-bdaa-f83cd1ebc614 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:13.467787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa67041-dac3-4429-bdaa-f83cd1ebc614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:13.468105 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa67041-dac3-4429-bdaa-f83cd1ebc614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:13.468728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa67041-dac3-4429-bdaa-f83cd1ebc614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:13.470320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa67041-dac3-4429-bdaa-f83cd1ebc614 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:13.483296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 924/1854] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:13.492074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4e364-38db-4607-b86b-1ebb358005b6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:13.521436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4e364-38db-4607-b86b-1ebb358005b6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:13.528284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a17d5-d288-4dd9-8655-e9edcba89b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:13.529219 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a17d5-d288-4dd9-8655-e9edcba89b24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:13.529783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a17d5-d288-4dd9-8655-e9edcba89b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:13.530295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a17d5-d288-4dd9-8655-e9edcba89b24 admin admin] PATH_INFO: `/v3/projects/133a386248b34b23a266d79ed40e3dc9/users/c027658b841e4ecfa3787b55e677fe66/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:13.552284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a17d5-d288-4dd9-8655-e9edcba89b24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=133a386248b34b23a266d79ed40e3dc9, user_id=c027658b841e4ecfa3787b55e677fe66, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:13.555330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a17d5-d288-4dd9-8655-e9edcba89b24 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:13.613763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 931/1855] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:13 2022] PUT /identity/v3/projects/133a386248b34b23a266d79ed40e3dc9/users/c027658b841e4ecfa3787b55e677fe66/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:13.627097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecea7b-419a-4cd9-9d98-dc9011923078 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:13.627097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecea7b-419a-4cd9-9d98-dc9011923078 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:13.627097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaecea7b-419a-4cd9-9d98-dc9011923078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:13.691746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-aaecea7b-419a-4cd9-9d98-dc9011923078 None None] MFA Rules not processed for user `c027658b841e4ecfa3787b55e677fe66`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:13.693196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-aaecea7b-419a-4cd9-9d98-dc9011923078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:13.792993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 925/1856] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:13.842249 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a17d5-d288-4dd9-8655-e9edcba89b24 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:13.844043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5a2a17d5-d288-4dd9-8655-e9edcba89b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:13.935422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a17d5-d288-4dd9-8655-e9edcba89b24 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:13.945875 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713d83e6-6c18-4e2b-bfce-abf68c90cb1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:13.949396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d83e6-6c18-4e2b-bfce-abf68c90cb1d service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:13.952048 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d83e6-6c18-4e2b-bfce-abf68c90cb1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:13.952467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713d83e6-6c18-4e2b-bfce-abf68c90cb1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:13.982148 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d83e6-6c18-4e2b-bfce-abf68c90cb1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:13.985870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713d83e6-6c18-4e2b-bfce-abf68c90cb1d service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:14.002666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 932/1857] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:14.030453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecea7b-419a-4cd9-9d98-dc9011923078 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:14.099649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaecea7b-419a-4cd9-9d98-dc9011923078 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:14.104890 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887fe45-0dc1-4a20-a402-6bf1b965dabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:14.105558 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887fe45-0dc1-4a20-a402-6bf1b965dabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:14.105860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887fe45-0dc1-4a20-a402-6bf1b965dabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:14.106699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7887fe45-0dc1-4a20-a402-6bf1b965dabe admin admin] PATH_INFO: `/v3/users/c027658b841e4ecfa3787b55e677fe66` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:14.107923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887fe45-0dc1-4a20-a402-6bf1b965dabe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c027658b841e4ecfa3787b55e677fe66)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:14.109893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7887fe45-0dc1-4a20-a402-6bf1b965dabe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:14.390215 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7887fe45-0dc1-4a20-a402-6bf1b965dabe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c027658b841e4ecfa3787b55e677fe66'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:14.404566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7887fe45-0dc1-4a20-a402-6bf1b965dabe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c027658b841e4ecfa3787b55e677fe66'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:14.405296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7887fe45-0dc1-4a20-a402-6bf1b965dabe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c027658b841e4ecfa3787b55e677fe66'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:14.405936 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7887fe45-0dc1-4a20-a402-6bf1b965dabe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c027658b841e4ecfa3787b55e677fe66'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:14.413337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7887fe45-0dc1-4a20-a402-6bf1b965dabe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c027658b841e4ecfa3787b55e677fe66'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:14.417462 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:14.522528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 926/1858] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:14 2022] DELETE /identity/v3/users/c027658b841e4ecfa3787b55e677fe66 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:14.528287 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642800ae-6f13-4329-9ed3-7ee6a6b05b5f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:14.528287 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642800ae-6f13-4329-9ed3-7ee6a6b05b5f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:14.528287 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642800ae-6f13-4329-9ed3-7ee6a6b05b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:14.551310 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-642800ae-6f13-4329-9ed3-7ee6a6b05b5f None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:14.553023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-642800ae-6f13-4329-9ed3-7ee6a6b05b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:14.613290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 933/1859] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:14.623049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887fe45-0dc1-4a20-a402-6bf1b965dabe admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:14.626696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7887fe45-0dc1-4a20-a402-6bf1b965dabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:14.683013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7887fe45-0dc1-4a20-a402-6bf1b965dabe admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:14.686972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62c0a3-46c9-4754-b317-794cc9133c6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:14.687943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62c0a3-46c9-4754-b317-794cc9133c6f service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:14.688224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62c0a3-46c9-4754-b317-794cc9133c6f service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:14.688496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd62c0a3-46c9-4754-b317-794cc9133c6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:14.701052 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62c0a3-46c9-4754-b317-794cc9133c6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:14.702942 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd62c0a3-46c9-4754-b317-794cc9133c6f service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:14.714075 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 927/1860] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:15.155397 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:15.248700 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642800ae-6f13-4329-9ed3-7ee6a6b05b5f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:15.249590 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-642800ae-6f13-4329-9ed3-7ee6a6b05b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:15.275149 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642800ae-6f13-4329-9ed3-7ee6a6b05b5f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:15.285741 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e870ec-f5ba-4a28-b6bb-e1cd4e9ecbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:15.291161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e870ec-f5ba-4a28-b6bb-e1cd4e9ecbdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:15.291161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e870ec-f5ba-4a28-b6bb-e1cd4e9ecbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:15.291161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e870ec-f5ba-4a28-b6bb-e1cd4e9ecbdb admin admin] PATH_INFO: `/v3/users/2e6c9b9d62a648fc99c951449c046fab` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:15.291161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e870ec-f5ba-4a28-b6bb-e1cd4e9ecbdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e6c9b9d62a648fc99c951449c046fab)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:15.292017 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e870ec-f5ba-4a28-b6bb-e1cd4e9ecbdb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:15.353253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62c0a3-46c9-4754-b317-794cc9133c6f service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:15.355456 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cd62c0a3-46c9-4754-b317-794cc9133c6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:15.375741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd62c0a3-46c9-4754-b317-794cc9133c6f service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:15.389039 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c8638-d744-4be8-9985-3833a917b5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:15.389775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c8638-d744-4be8-9985-3833a917b5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:15.390125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c8638-d744-4be8-9985-3833a917b5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:15.390936 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c8638-d744-4be8-9985-3833a917b5c8 admin admin] PATH_INFO: `/v3/projects/133a386248b34b23a266d79ed40e3dc9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:15.392456 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c8638-d744-4be8-9985-3833a917b5c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=133a386248b34b23a266d79ed40e3dc9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:15.394460 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c8638-d744-4be8-9985-3833a917b5c8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:15.493239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-96e870ec-f5ba-4a28-b6bb-e1cd4e9ecbdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e6c9b9d62a648fc99c951449c046fab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.494167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-96e870ec-f5ba-4a28-b6bb-e1cd4e9ecbdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e6c9b9d62a648fc99c951449c046fab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.494854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-96e870ec-f5ba-4a28-b6bb-e1cd4e9ecbdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e6c9b9d62a648fc99c951449c046fab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.508687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-96e870ec-f5ba-4a28-b6bb-e1cd4e9ecbdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e6c9b9d62a648fc99c951449c046fab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.519372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-743c8638-d744-4be8-9985-3833a917b5c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '133a386248b34b23a266d79ed40e3dc9', 'request_id': 'req-743c8638-d744-4be8-9985-3833a917b5c8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.525998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-96e870ec-f5ba-4a28-b6bb-e1cd4e9ecbdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e6c9b9d62a648fc99c951449c046fab'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.527415 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-743c8638-d744-4be8-9985-3833a917b5c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '133a386248b34b23a266d79ed40e3dc9', 'request_id': 'req-743c8638-d744-4be8-9985-3833a917b5c8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.535556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-743c8638-d744-4be8-9985-3833a917b5c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '133a386248b34b23a266d79ed40e3dc9', 'request_id': 'req-743c8638-d744-4be8-9985-3833a917b5c8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.628389 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 934/1861] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:15 2022] DELETE /identity/v3/users/2e6c9b9d62a648fc99c951449c046fab => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:15.635358 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87137ed8-a6de-46b9-ba1e-fd0f56d8589b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:15.635546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87137ed8-a6de-46b9-ba1e-fd0f56d8589b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:15.635921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87137ed8-a6de-46b9-ba1e-fd0f56d8589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:15.663988 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-87137ed8-a6de-46b9-ba1e-fd0f56d8589b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:15.665855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-87137ed8-a6de-46b9-ba1e-fd0f56d8589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:15.730303 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 935/1862] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:15.741198 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87137ed8-a6de-46b9-ba1e-fd0f56d8589b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:15.742739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-87137ed8-a6de-46b9-ba1e-fd0f56d8589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:15.766516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-743c8638-d744-4be8-9985-3833a917b5c8 admin admin] The token cache is being invalidate because project 133a386248b34b23a266d79ed40e3dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:15.767511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-743c8638-d744-4be8-9985-3833a917b5c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.768775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-743c8638-d744-4be8-9985-3833a917b5c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:15.771780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 928/1863] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:15 2022] DELETE /identity/v3/projects/133a386248b34b23a266d79ed40e3dc9 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:15.777271 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8de880-a64a-4edf-aab2-f562b6d92bf4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:15.777597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8de880-a64a-4edf-aab2-f562b6d92bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:15.778069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8de880-a64a-4edf-aab2-f562b6d92bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:15.826228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87137ed8-a6de-46b9-ba1e-fd0f56d8589b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:15.826503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5c8de880-a64a-4edf-aab2-f562b6d92bf4 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:15.826580 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a820e9d-ef9c-4afa-89bf-ec7abeff6dd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:15.826679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5c8de880-a64a-4edf-aab2-f562b6d92bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:15.826755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a820e9d-ef9c-4afa-89bf-ec7abeff6dd4 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:15.826755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a820e9d-ef9c-4afa-89bf-ec7abeff6dd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:15.826755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a820e9d-ef9c-4afa-89bf-ec7abeff6dd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:15.826755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5a820e9d-ef9c-4afa-89bf-ec7abeff6dd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:15.834343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 929/1864] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:15.842287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15a50e-9cf4-48ba-b102-15b6547051bd None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:15.842578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15a50e-9cf4-48ba-b102-15b6547051bd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:15.842853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15a50e-9cf4-48ba-b102-15b6547051bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:15.854087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a820e9d-ef9c-4afa-89bf-ec7abeff6dd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:15.856747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a820e9d-ef9c-4afa-89bf-ec7abeff6dd4 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:15.867596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-df15a50e-9cf4-48ba-b102-15b6547051bd None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:15.869223 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-df15a50e-9cf4-48ba-b102-15b6547051bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:15.873704 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 936/1865] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:15.880887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 930/1866] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:15.885278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a820e9d-ef9c-4afa-89bf-ec7abeff6dd4 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:15.902357 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a820e9d-ef9c-4afa-89bf-ec7abeff6dd4 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:15.907810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27254d-c8a6-4b28-991f-994cf8535091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:15.908644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27254d-c8a6-4b28-991f-994cf8535091 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:15.909109 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27254d-c8a6-4b28-991f-994cf8535091 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:15.909539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e27254d-c8a6-4b28-991f-994cf8535091 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:15.910342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27254d-c8a6-4b28-991f-994cf8535091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:15.911446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27254d-c8a6-4b28-991f-994cf8535091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:15.914243 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e27254d-c8a6-4b28-991f-994cf8535091 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:15.933303 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 937/1867] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:15.934351 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15a50e-9cf4-48ba-b102-15b6547051bd None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:15.954666 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15a50e-9cf4-48ba-b102-15b6547051bd None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:15.960966 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c799a-17b7-442b-b023-ce966ac61a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:15.961709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c799a-17b7-442b-b023-ce966ac61a38 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:15.961983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c799a-17b7-442b-b023-ce966ac61a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:15.963894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c799a-17b7-442b-b023-ce966ac61a38 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:15.963894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c799a-17b7-442b-b023-ce966ac61a38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:15.964861 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c799a-17b7-442b-b023-ce966ac61a38 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:16.121019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 931/1868] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:15 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:16.125119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27254d-c8a6-4b28-991f-994cf8535091 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:16.135764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e27254d-c8a6-4b28-991f-994cf8535091 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:16.222684 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f4290-977f-46ec-80be-fe9d9bfa3e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:16.224136 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f4290-977f-46ec-80be-fe9d9bfa3e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:16.225121 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f4290-977f-46ec-80be-fe9d9bfa3e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:16.225121 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f4290-977f-46ec-80be-fe9d9bfa3e89 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:16.225592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f4290-977f-46ec-80be-fe9d9bfa3e89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:16.229078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f4290-977f-46ec-80be-fe9d9bfa3e89 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:16.258643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:16.332638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 938/1869] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:16 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:16.337105 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c799a-17b7-442b-b023-ce966ac61a38 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:16.347967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c799a-17b7-442b-b023-ce966ac61a38 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:16.354266 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68821c-1c65-49a1-ac5c-392d29d1ec97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:16.354874 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68821c-1c65-49a1-ac5c-392d29d1ec97 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:16.355156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68821c-1c65-49a1-ac5c-392d29d1ec97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:16.355430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e68821c-1c65-49a1-ac5c-392d29d1ec97 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:16.356282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68821c-1c65-49a1-ac5c-392d29d1ec97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:16.357969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e68821c-1c65-49a1-ac5c-392d29d1ec97 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:16.370898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 932/1870] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:16.384734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f4290-977f-46ec-80be-fe9d9bfa3e89 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:16.398969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68821c-1c65-49a1-ac5c-392d29d1ec97 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:16.400759 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8e68821c-1c65-49a1-ac5c-392d29d1ec97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:16.401849 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f4290-977f-46ec-80be-fe9d9bfa3e89 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:16.407227 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9679e25-df88-47d4-9b99-3345ad5f172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:16.409008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9679e25-df88-47d4-9b99-3345ad5f172c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:16.409008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9679e25-df88-47d4-9b99-3345ad5f172c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:16.409008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9679e25-df88-47d4-9b99-3345ad5f172c admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:16.409286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9679e25-df88-47d4-9b99-3345ad5f172c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:16.411589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9679e25-df88-47d4-9b99-3345ad5f172c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:16.415412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e68821c-1c65-49a1-ac5c-392d29d1ec97 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:16.420322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:16.420968 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:16.421246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:16.421510 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] PATH_INFO: `/v3/projects/645d04d4d20349be80afd247e3fa1060` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:16.422804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=645d04d4d20349be80afd247e3fa1060)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:16.424891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:16.429964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 939/1871] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:16 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:16.435805 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9679e25-df88-47d4-9b99-3345ad5f172c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:16.446365 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9679e25-df88-47d4-9b99-3345ad5f172c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:16.458377 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb7d0f6-5df6-44a5-a51c-ce05797cda93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:16.459163 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7d0f6-5df6-44a5-a51c-ce05797cda93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:16.459442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7d0f6-5df6-44a5-a51c-ce05797cda93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:16.460126 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb7d0f6-5df6-44a5-a51c-ce05797cda93 admin admin] PATH_INFO: `/v3/projects/f2ad7c1fc8db4e85b7f56f971a96a53f/users/41a7157020134a0fa2bf7ae1f3395096/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:16.486601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7d0f6-5df6-44a5-a51c-ce05797cda93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ad7c1fc8db4e85b7f56f971a96a53f, user_id=41a7157020134a0fa2bf7ae1f3395096, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:16.490104 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb7d0f6-5df6-44a5-a51c-ce05797cda93 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:16.572988 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 940/1872] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:16 2022] PUT /identity/v3/projects/f2ad7c1fc8db4e85b7f56f971a96a53f/users/41a7157020134a0fa2bf7ae1f3395096/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:16.582068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '645d04d4d20349be80afd247e3fa1060', 'request_id': 'req-702b5153-a141-408a-bc3d-6695509d58c6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:16.584038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e1937-db51-403c-978e-d02c7f5b9ad9 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:16.584327 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e1937-db51-403c-978e-d02c7f5b9ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:16.584607 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e1937-db51-403c-978e-d02c7f5b9ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:16.589691 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '645d04d4d20349be80afd247e3fa1060', 'request_id': 'req-702b5153-a141-408a-bc3d-6695509d58c6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:16.595661 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '645d04d4d20349be80afd247e3fa1060', 'request_id': 'req-702b5153-a141-408a-bc3d-6695509d58c6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:16.614809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0e0e1937-db51-403c-978e-d02c7f5b9ad9 None None] MFA Rules not processed for user `41a7157020134a0fa2bf7ae1f3395096`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:16.615794 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0e0e1937-db51-403c-978e-d02c7f5b9ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:16.675750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] The token cache is being invalidate because project 645d04d4d20349be80afd247e3fa1060 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:16.676414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:16.677259 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:16.680706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 933/1873] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:16 2022] DELETE /identity/v3/projects/645d04d4d20349be80afd247e3fa1060 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:16.689770 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:16.693479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:16.716162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 941/1874] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:16.728395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e1937-db51-403c-978e-d02c7f5b9ad9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:16.729799 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0e0e1937-db51-403c-978e-d02c7f5b9ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:16.765607 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b5153-a141-408a-bc3d-6695509d58c6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:16.771885 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084391cb-7d64-4607-930d-820fd629af5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:16.773825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084391cb-7d64-4607-930d-820fd629af5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:16.774261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084391cb-7d64-4607-930d-820fd629af5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:16.774540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084391cb-7d64-4607-930d-820fd629af5b admin admin] PATH_INFO: `/v3/users/0e2455f0d3794adbb94e73ed48e72999` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:16.775878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084391cb-7d64-4607-930d-820fd629af5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e2455f0d3794adbb94e73ed48e72999)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:16.778218 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084391cb-7d64-4607-930d-820fd629af5b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:16.798295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e1937-db51-403c-978e-d02c7f5b9ad9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:16.802726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204ad68-cdfa-4fa8-8eb0-a25d934d9168 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:16.803407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ad68-cdfa-4fa8-8eb0-a25d934d9168 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:16.803764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ad68-cdfa-4fa8-8eb0-a25d934d9168 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:16.804065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3204ad68-cdfa-4fa8-8eb0-a25d934d9168 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:16.812650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204ad68-cdfa-4fa8-8eb0-a25d934d9168 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:16.814058 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3204ad68-cdfa-4fa8-8eb0-a25d934d9168 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:16.823776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 942/1875] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:17.003021 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-084391cb-7d64-4607-930d-820fd629af5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e2455f0d3794adbb94e73ed48e72999'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:17.017050 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-084391cb-7d64-4607-930d-820fd629af5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e2455f0d3794adbb94e73ed48e72999'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:17.017898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-084391cb-7d64-4607-930d-820fd629af5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e2455f0d3794adbb94e73ed48e72999'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:17.018519 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-084391cb-7d64-4607-930d-820fd629af5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e2455f0d3794adbb94e73ed48e72999'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:17.025457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-084391cb-7d64-4607-930d-820fd629af5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e2455f0d3794adbb94e73ed48e72999'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:17.103121 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 934/1876] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:16 2022] DELETE /identity/v3/users/0e2455f0d3794adbb94e73ed48e72999 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:17.607493 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204ad68-cdfa-4fa8-8eb0-a25d934d9168 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:17.622394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3204ad68-cdfa-4fa8-8eb0-a25d934d9168 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:17.693368 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:17.693368 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:17.693591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:17.693774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1 admin admin] PATH_INFO: `/v3/projects/2fcdf5d9e2034e8992ea9941d320a47d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:17.694975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fcdf5d9e2034e8992ea9941d320a47d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:17.697032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:17.807945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fcdf5d9e2034e8992ea9941d320a47d', 'request_id': 'req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:17.814278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fcdf5d9e2034e8992ea9941d320a47d', 'request_id': 'req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:17.908886 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fcdf5d9e2034e8992ea9941d320a47d', 'request_id': 'req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:17.919634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1 admin admin] The token cache is being invalidate because project 2fcdf5d9e2034e8992ea9941d320a47d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:17.919954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:17.920578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e9f175ed-fa46-4e0f-a146-4f58c6d308c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:17.922074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 943/1877] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:17 2022] DELETE /identity/v3/projects/2fcdf5d9e2034e8992ea9941d320a47d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:17.926951 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd647a91-51bd-4766-bae2-8a5eb3baab62 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:17.927407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd647a91-51bd-4766-bae2-8a5eb3baab62 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:17.927498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd647a91-51bd-4766-bae2-8a5eb3baab62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:17.948905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-bd647a91-51bd-4766-bae2-8a5eb3baab62 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:17.950130 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-bd647a91-51bd-4766-bae2-8a5eb3baab62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:18.009200 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 935/1878] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:18.016973 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fda95b-f389-45c7-a5cd-ce0ea7522a5f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:18.017570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fda95b-f389-45c7-a5cd-ce0ea7522a5f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:18.018099 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fda95b-f389-45c7-a5cd-ce0ea7522a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:18.019420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:18.039761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b4fda95b-f389-45c7-a5cd-ce0ea7522a5f None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:18.041016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b4fda95b-f389-45c7-a5cd-ce0ea7522a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:18.049066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 944/1879] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:18.053825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd647a91-51bd-4766-bae2-8a5eb3baab62 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:18.064135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd647a91-51bd-4766-bae2-8a5eb3baab62 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:18.069786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08052d-2fb5-4045-93ad-6d35c7a456bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:18.070409 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08052d-2fb5-4045-93ad-6d35c7a456bb admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:18.070683 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08052d-2fb5-4045-93ad-6d35c7a456bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:18.070949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08052d-2fb5-4045-93ad-6d35c7a456bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:18.074112 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08052d-2fb5-4045-93ad-6d35c7a456bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:18.074112 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08052d-2fb5-4045-93ad-6d35c7a456bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:18.074112 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08052d-2fb5-4045-93ad-6d35c7a456bb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:18.085050 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 936/1880] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:18.089489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fda95b-f389-45c7-a5cd-ce0ea7522a5f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:18.092138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:18.099007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fda95b-f389-45c7-a5cd-ce0ea7522a5f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:18.103471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cca4d2-6d58-43a9-8d6a-46e25bd0d5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:18.104096 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca4d2-6d58-43a9-8d6a-46e25bd0d5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:18.104375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca4d2-6d58-43a9-8d6a-46e25bd0d5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:18.104645 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cca4d2-6d58-43a9-8d6a-46e25bd0d5a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:18.105272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cca4d2-6d58-43a9-8d6a-46e25bd0d5a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:18.107178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09cca4d2-6d58-43a9-8d6a-46e25bd0d5a5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:18.229057 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 945/1881] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:18 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:18.233114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08052d-2fb5-4045-93ad-6d35c7a456bb admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:18.246634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08052d-2fb5-4045-93ad-6d35c7a456bb admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:18.313678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3119819-a3eb-43ca-a338-63102b20f50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:18.314420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3119819-a3eb-43ca-a338-63102b20f50e admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:18.314797 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3119819-a3eb-43ca-a338-63102b20f50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:18.315138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3119819-a3eb-43ca-a338-63102b20f50e admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:18.315995 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3119819-a3eb-43ca-a338-63102b20f50e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:18.318854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3119819-a3eb-43ca-a338-63102b20f50e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:18.431494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 937/1882] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:18 2022] POST /identity/v3/users => generated 290 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:18.432923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cca4d2-6d58-43a9-8d6a-46e25bd0d5a5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:18.446139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cca4d2-6d58-43a9-8d6a-46e25bd0d5a5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:18.451452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227bef3-fd23-4e7b-a1de-ca2717627c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:18.452157 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227bef3-fd23-4e7b-a1de-ca2717627c75 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:18.452490 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227bef3-fd23-4e7b-a1de-ca2717627c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:18.452810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227bef3-fd23-4e7b-a1de-ca2717627c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:18.453524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227bef3-fd23-4e7b-a1de-ca2717627c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:18.455255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227bef3-fd23-4e7b-a1de-ca2717627c75 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:18.466126 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 946/1883] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:18.470286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3119819-a3eb-43ca-a338-63102b20f50e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:18.481620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3119819-a3eb-43ca-a338-63102b20f50e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:18.490361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55056bf0-7a7c-4d78-9f0e-293fb0c90f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:18.490982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55056bf0-7a7c-4d78-9f0e-293fb0c90f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:18.491259 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55056bf0-7a7c-4d78-9f0e-293fb0c90f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:18.491532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55056bf0-7a7c-4d78-9f0e-293fb0c90f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:18.492205 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55056bf0-7a7c-4d78-9f0e-293fb0c90f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:18.493778 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55056bf0-7a7c-4d78-9f0e-293fb0c90f60 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:18.508251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 938/1884] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:18.512041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227bef3-fd23-4e7b-a1de-ca2717627c75 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:18.524037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227bef3-fd23-4e7b-a1de-ca2717627c75 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:18.528817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27c34-0b07-46e1-a41c-1a7d3629025b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:18.529491 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27c34-0b07-46e1-a41c-1a7d3629025b admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:18.529769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27c34-0b07-46e1-a41c-1a7d3629025b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:18.535122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d27c34-0b07-46e1-a41c-1a7d3629025b admin admin] PATH_INFO: `/v3/projects/5663f9906325409d8fe9a0661113b1fb/users/cc48f3e4e9d24b7d92314b6999a6dcba/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:18.546988 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d27c34-0b07-46e1-a41c-1a7d3629025b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5663f9906325409d8fe9a0661113b1fb, user_id=cc48f3e4e9d24b7d92314b6999a6dcba, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:18.549622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d27c34-0b07-46e1-a41c-1a7d3629025b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:18.643952 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 947/1885] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:18 2022] PUT /identity/v3/projects/5663f9906325409d8fe9a0661113b1fb/users/cc48f3e4e9d24b7d92314b6999a6dcba/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:18.652163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd39985-4383-429c-9df7-4efa4f5ee1a5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:18.652451 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd39985-4383-429c-9df7-4efa4f5ee1a5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:18.652826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd39985-4383-429c-9df7-4efa4f5ee1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:18.690253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-dcd39985-4383-429c-9df7-4efa4f5ee1a5 None None] MFA Rules not processed for user `cc48f3e4e9d24b7d92314b6999a6dcba`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:18.692303 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dcd39985-4383-429c-9df7-4efa4f5ee1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:18.758368 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27c34-0b07-46e1-a41c-1a7d3629025b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:18.760785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-96d27c34-0b07-46e1-a41c-1a7d3629025b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:18.794567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 939/1886] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:18.799542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd39985-4383-429c-9df7-4efa4f5ee1a5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:18.856818 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d27c34-0b07-46e1-a41c-1a7d3629025b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:18.861301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97142ed1-1fde-48fa-b53b-df8fe8a6dbf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:18.862192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97142ed1-1fde-48fa-b53b-df8fe8a6dbf1 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:18.862741 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97142ed1-1fde-48fa-b53b-df8fe8a6dbf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:18.863009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97142ed1-1fde-48fa-b53b-df8fe8a6dbf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:18.866249 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-97142ed1-1fde-48fa-b53b-df8fe8a6dbf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:18.889322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd39985-4383-429c-9df7-4efa4f5ee1a5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:18.917265 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7b668-e754-4c53-b189-ccc5698eaf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:18.923631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7b668-e754-4c53-b189-ccc5698eaf23 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:18.926165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7b668-e754-4c53-b189-ccc5698eaf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:18.926903 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7b668-e754-4c53-b189-ccc5698eaf23 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:18.927683 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7b668-e754-4c53-b189-ccc5698eaf23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:18.931574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7b668-e754-4c53-b189-ccc5698eaf23 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:18.949083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97142ed1-1fde-48fa-b53b-df8fe8a6dbf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:18.950550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97142ed1-1fde-48fa-b53b-df8fe8a6dbf1 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:18.964428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 948/1887] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:18 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:19.032348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 940/1888] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:18 2022] POST /identity/v3/projects => generated 381 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:19.037556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97142ed1-1fde-48fa-b53b-df8fe8a6dbf1 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:19.051144 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97142ed1-1fde-48fa-b53b-df8fe8a6dbf1 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:19.118688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f407c23-37fd-445d-82d9-9e9ace955af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:19.119471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f407c23-37fd-445d-82d9-9e9ace955af3 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:19.119885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f407c23-37fd-445d-82d9-9e9ace955af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:19.120270 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f407c23-37fd-445d-82d9-9e9ace955af3 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:19.121107 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f407c23-37fd-445d-82d9-9e9ace955af3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:19.123134 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f407c23-37fd-445d-82d9-9e9ace955af3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:19.295910 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 949/1889] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:19 2022] POST /identity/v3/users => generated 297 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:19.298470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7b668-e754-4c53-b189-ccc5698eaf23 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:19.309940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7b668-e754-4c53-b189-ccc5698eaf23 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:19.315533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f6d4d-5cf9-45ba-aad8-929e41294a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:19.316427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6d4d-5cf9-45ba-aad8-929e41294a9b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:19.316869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6d4d-5cf9-45ba-aad8-929e41294a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:19.317926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6d4d-5cf9-45ba-aad8-929e41294a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:19.318645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f6d4d-5cf9-45ba-aad8-929e41294a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:19.320345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f6d4d-5cf9-45ba-aad8-929e41294a9b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:19.338122 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 941/1890] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:19.342246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f407c23-37fd-445d-82d9-9e9ace955af3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:19.353068 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f407c23-37fd-445d-82d9-9e9ace955af3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:19.357877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653afd5-0aa4-4489-b460-62859c6f22f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:19.358543 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653afd5-0aa4-4489-b460-62859c6f22f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:19.358825 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653afd5-0aa4-4489-b460-62859c6f22f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:19.359098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653afd5-0aa4-4489-b460-62859c6f22f4 admin admin] PATH_INFO: `/v3/projects/e7b8e45aa31045bcb71fe4bf0ce6fabe/users/7ff967bb2ed648de98d4c5235f8dea4c/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:19.388031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653afd5-0aa4-4489-b460-62859c6f22f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b8e45aa31045bcb71fe4bf0ce6fabe, user_id=7ff967bb2ed648de98d4c5235f8dea4c, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:19.390865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653afd5-0aa4-4489-b460-62859c6f22f4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:19.517188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 950/1891] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:19 2022] PUT /identity/v3/projects/e7b8e45aa31045bcb71fe4bf0ce6fabe/users/7ff967bb2ed648de98d4c5235f8dea4c/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:19.523182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f6d4d-5cf9-45ba-aad8-929e41294a9b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:19.533515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f6d4d-5cf9-45ba-aad8-929e41294a9b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:19.604678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430f5b9c-a128-4d47-b8ca-d60a4f01fc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:19.605365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f5b9c-a128-4d47-b8ca-d60a4f01fc88 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:19.605749 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f5b9c-a128-4d47-b8ca-d60a4f01fc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:19.606088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430f5b9c-a128-4d47-b8ca-d60a4f01fc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:19.606894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f5b9c-a128-4d47-b8ca-d60a4f01fc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:19.608698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430f5b9c-a128-4d47-b8ca-d60a4f01fc88 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:19.620522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 942/1892] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:19 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:19.625117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653afd5-0aa4-4489-b460-62859c6f22f4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:19.643230 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653afd5-0aa4-4489-b460-62859c6f22f4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:19.652953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594f67-c873-41cc-8c8b-e3ad95b8663c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:19.653868 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594f67-c873-41cc-8c8b-e3ad95b8663c admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:19.654322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594f67-c873-41cc-8c8b-e3ad95b8663c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:19.654585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd594f67-c873-41cc-8c8b-e3ad95b8663c admin admin] PATH_INFO: `/v3/projects/e7b8e45aa31045bcb71fe4bf0ce6fabe/users/7ff967bb2ed648de98d4c5235f8dea4c/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:19.656734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd594f67-c873-41cc-8c8b-e3ad95b8663c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7b8e45aa31045bcb71fe4bf0ce6fabe, user_id=7ff967bb2ed648de98d4c5235f8dea4c, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:19.659633 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd594f67-c873-41cc-8c8b-e3ad95b8663c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:19.671570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 951/1893] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:19 2022] PUT /identity/v3/projects/e7b8e45aa31045bcb71fe4bf0ce6fabe/users/7ff967bb2ed648de98d4c5235f8dea4c/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:19.682403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0828c8-fdf1-4c2d-9059-cda5be727c9d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:19.682812 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0828c8-fdf1-4c2d-9059-cda5be727c9d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:19.683099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0828c8-fdf1-4c2d-9059-cda5be727c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:19.711674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9a0828c8-fdf1-4c2d-9059-cda5be727c9d None None] MFA Rules not processed for user `7ff967bb2ed648de98d4c5235f8dea4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:19.713000 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9a0828c8-fdf1-4c2d-9059-cda5be727c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:19.781626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 943/1894] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:19.806895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:20.331675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594f67-c873-41cc-8c8b-e3ad95b8663c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:20.331675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fd594f67-c873-41cc-8c8b-e3ad95b8663c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:20.392787 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd594f67-c873-41cc-8c8b-e3ad95b8663c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:20.397457 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb05db6-b206-4dae-8419-d8880197ad95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:20.398364 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb05db6-b206-4dae-8419-d8880197ad95 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:20.398749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb05db6-b206-4dae-8419-d8880197ad95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:20.399123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb05db6-b206-4dae-8419-d8880197ad95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:20.418326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb05db6-b206-4dae-8419-d8880197ad95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:20.418326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb05db6-b206-4dae-8419-d8880197ad95 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:20.425812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 952/1895] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:20 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:20.498655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:21.078868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0828c8-fdf1-4c2d-9059-cda5be727c9d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:21.156390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0828c8-fdf1-4c2d-9059-cda5be727c9d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:21.162331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d055bc9-9837-4fd6-b6dc-1b00eb1812fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:21.162987 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055bc9-9837-4fd6-b6dc-1b00eb1812fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:21.163266 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055bc9-9837-4fd6-b6dc-1b00eb1812fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:21.163532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d055bc9-9837-4fd6-b6dc-1b00eb1812fe admin admin] PATH_INFO: `/v3/users/cc48f3e4e9d24b7d92314b6999a6dcba` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:21.164760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d055bc9-9837-4fd6-b6dc-1b00eb1812fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc48f3e4e9d24b7d92314b6999a6dcba)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:21.167821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d055bc9-9837-4fd6-b6dc-1b00eb1812fe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:21.360266 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb05db6-b206-4dae-8419-d8880197ad95 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:21.361863 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6cb05db6-b206-4dae-8419-d8880197ad95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:21.380070 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb05db6-b206-4dae-8419-d8880197ad95 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:21.385795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56866d4d-326b-4b45-8e7a-205edb543863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:21.386613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56866d4d-326b-4b45-8e7a-205edb543863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:21.387468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56866d4d-326b-4b45-8e7a-205edb543863 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:21.388747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56866d4d-326b-4b45-8e7a-205edb543863 admin admin] PATH_INFO: `/v3/users/41a7157020134a0fa2bf7ae1f3395096` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:21.391217 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56866d4d-326b-4b45-8e7a-205edb543863 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41a7157020134a0fa2bf7ae1f3395096)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:21.393593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56866d4d-326b-4b45-8e7a-205edb543863 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:21.507053 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5d055bc9-9837-4fd6-b6dc-1b00eb1812fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc48f3e4e9d24b7d92314b6999a6dcba'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:21.525021 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5d055bc9-9837-4fd6-b6dc-1b00eb1812fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc48f3e4e9d24b7d92314b6999a6dcba'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:21.526009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5d055bc9-9837-4fd6-b6dc-1b00eb1812fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc48f3e4e9d24b7d92314b6999a6dcba'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:21.526791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5d055bc9-9837-4fd6-b6dc-1b00eb1812fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc48f3e4e9d24b7d92314b6999a6dcba'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:21.534276 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5d055bc9-9837-4fd6-b6dc-1b00eb1812fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc48f3e4e9d24b7d92314b6999a6dcba'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:21.566148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:21.589405 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56866d4d-326b-4b45-8e7a-205edb543863 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41a7157020134a0fa2bf7ae1f3395096'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:21.590282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56866d4d-326b-4b45-8e7a-205edb543863 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41a7157020134a0fa2bf7ae1f3395096'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:21.591195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56866d4d-326b-4b45-8e7a-205edb543863 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41a7157020134a0fa2bf7ae1f3395096'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:21.596193 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 944/1896] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:21 2022] DELETE /identity/v3/users/cc48f3e4e9d24b7d92314b6999a6dcba => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:21.601942 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9e442-abbd-4547-854c-a3b7fa659fde None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:21.602407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9e442-abbd-4547-854c-a3b7fa659fde None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:21.602923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9e442-abbd-4547-854c-a3b7fa659fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:21.608435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56866d4d-326b-4b45-8e7a-205edb543863 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41a7157020134a0fa2bf7ae1f3395096'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:21.622832 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-56866d4d-326b-4b45-8e7a-205edb543863 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41a7157020134a0fa2bf7ae1f3395096'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:21.643021 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-42d9e442-abbd-4547-854c-a3b7fa659fde None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:21.644409 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-42d9e442-abbd-4547-854c-a3b7fa659fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:21.685830 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 953/1897] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:21 2022] DELETE /identity/v3/users/41a7157020134a0fa2bf7ae1f3395096 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:21.690424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469f0fb-498d-4a5a-ad42-fbaba1f18c5b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:21.690843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469f0fb-498d-4a5a-ad42-fbaba1f18c5b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:21.691143 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1469f0fb-498d-4a5a-ad42-fbaba1f18c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:21.711813 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1469f0fb-498d-4a5a-ad42-fbaba1f18c5b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:21.713424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1469f0fb-498d-4a5a-ad42-fbaba1f18c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:21.717145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 945/1898] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:21.731066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9e442-abbd-4547-854c-a3b7fa659fde None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:21.732519 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-42d9e442-abbd-4547-854c-a3b7fa659fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:21.782897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 954/1899] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:21.793522 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469f0fb-498d-4a5a-ad42-fbaba1f18c5b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:21.797420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d9e442-abbd-4547-854c-a3b7fa659fde None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:21.852064 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1469f0fb-498d-4a5a-ad42-fbaba1f18c5b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:21.856227 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be757d-2f87-46f2-a1fa-05580fa374c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:21.857052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be757d-2f87-46f2-a1fa-05580fa374c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:21.857477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be757d-2f87-46f2-a1fa-05580fa374c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:21.857900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89be757d-2f87-46f2-a1fa-05580fa374c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:21.858947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b07597-accd-41af-b454-3b055c7add03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:21.859570 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07597-accd-41af-b454-3b055c7add03 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:21.859868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07597-accd-41af-b454-3b055c7add03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:21.860180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b07597-accd-41af-b454-3b055c7add03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:21.869755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be757d-2f87-46f2-a1fa-05580fa374c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:21.875658 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89be757d-2f87-46f2-a1fa-05580fa374c5 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:21.875800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b07597-accd-41af-b454-3b055c7add03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:21.875800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b07597-accd-41af-b454-3b055c7add03 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:21.882114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 955/1900] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:21.889091 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 946/1901] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:22.205386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:22.593085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be757d-2f87-46f2-a1fa-05580fa374c5 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:22.594525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-89be757d-2f87-46f2-a1fa-05580fa374c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:22.618174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89be757d-2f87-46f2-a1fa-05580fa374c5 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:22.624549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b07597-accd-41af-b454-3b055c7add03 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:22.626752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c8b07597-accd-41af-b454-3b055c7add03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:22.641717 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:22.646460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:22.646460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:22.646460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] PATH_INFO: `/v3/projects/5663f9906325409d8fe9a0661113b1fb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:22.646460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=5663f9906325409d8fe9a0661113b1fb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:22.648732 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:22.656170 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b07597-accd-41af-b454-3b055c7add03 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:22.664828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:22.665469 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:22.665915 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:22.666622 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73 admin admin] PATH_INFO: `/v3/projects/f2ad7c1fc8db4e85b7f56f971a96a53f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:22.668186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ad7c1fc8db4e85b7f56f971a96a53f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:22.670784 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:22.801474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:22.842037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5663f9906325409d8fe9a0661113b1fb', 'request_id': 'req-aa762651-6d10-4af8-a9d8-6670cc4397ce'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:22.844829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ad7c1fc8db4e85b7f56f971a96a53f', 'request_id': 'req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:22.853124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ad7c1fc8db4e85b7f56f971a96a53f', 'request_id': 'req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:22.872922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ad7c1fc8db4e85b7f56f971a96a53f', 'request_id': 'req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:22.874104 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5663f9906325409d8fe9a0661113b1fb', 'request_id': 'req-aa762651-6d10-4af8-a9d8-6670cc4397ce'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:22.967656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73 admin admin] The token cache is being invalidate because project f2ad7c1fc8db4e85b7f56f971a96a53f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:22.968080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:22.968833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-3b224d6c-feb8-4e3d-b8f4-8ea47eaf6b73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:22.978267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 947/1902] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:22 2022] DELETE /identity/v3/projects/f2ad7c1fc8db4e85b7f56f971a96a53f => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:22.978267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726de7-cc8c-469a-885f-1eb679eaa7cb None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:22.978267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726de7-cc8c-469a-885f-1eb679eaa7cb None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:22.978267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65726de7-cc8c-469a-885f-1eb679eaa7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:23.001521 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-65726de7-cc8c-469a-885f-1eb679eaa7cb None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:23.001521 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-65726de7-cc8c-469a-885f-1eb679eaa7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:23.054602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5663f9906325409d8fe9a0661113b1fb', 'request_id': 'req-aa762651-6d10-4af8-a9d8-6670cc4397ce'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:23.074899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] The token cache is being invalidate because project 5663f9906325409d8fe9a0661113b1fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:23.076581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:23.077515 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:23.079992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 956/1903] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:22 2022] DELETE /identity/v3/projects/5663f9906325409d8fe9a0661113b1fb => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:23.084090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:23.086307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 948/1904] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:23.086481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:23.093824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4ccf9-a570-4ea1-97f1-267e73127511 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:23.094115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4ccf9-a570-4ea1-97f1-267e73127511 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:23.094391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b4ccf9-a570-4ea1-97f1-267e73127511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:23.124189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-14b4ccf9-a570-4ea1-97f1-267e73127511 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:23.124189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-14b4ccf9-a570-4ea1-97f1-267e73127511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:23.134191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 949/1905] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:23.142525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4ccf9-a570-4ea1-97f1-267e73127511 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:23.155051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b4ccf9-a570-4ea1-97f1-267e73127511 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:23.165929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edf534-8876-4a0d-929a-5029df8915d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:23.167025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edf534-8876-4a0d-929a-5029df8915d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:23.167653 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edf534-8876-4a0d-929a-5029df8915d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:23.168089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edf534-8876-4a0d-929a-5029df8915d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:23.168891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edf534-8876-4a0d-929a-5029df8915d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:23.178637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edf534-8876-4a0d-929a-5029df8915d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:23.178637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41edf534-8876-4a0d-929a-5029df8915d2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:23.209092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 950/1906] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:09:23.210869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa762651-6d10-4af8-a9d8-6670cc4397ce admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:23.214263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edf534-8876-4a0d-929a-5029df8915d2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:23.224946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435c9bc-5dbc-4076-94e6-6e0a497eb634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:23.225620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435c9bc-5dbc-4076-94e6-6e0a497eb634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:23.225949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435c9bc-5dbc-4076-94e6-6e0a497eb634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:23.226223 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435c9bc-5dbc-4076-94e6-6e0a497eb634 admin admin] PATH_INFO: `/v3/users/7ff967bb2ed648de98d4c5235f8dea4c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:23.228754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435c9bc-5dbc-4076-94e6-6e0a497eb634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff967bb2ed648de98d4c5235f8dea4c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:23.235505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8435c9bc-5dbc-4076-94e6-6e0a497eb634 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:23.239208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edf534-8876-4a0d-929a-5029df8915d2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:23.248072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5420c9f-c61d-4d8d-b8e1-e3cc6137fc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:23.250738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5420c9f-c61d-4d8d-b8e1-e3cc6137fc53 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:23.251010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5420c9f-c61d-4d8d-b8e1-e3cc6137fc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:23.251293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5420c9f-c61d-4d8d-b8e1-e3cc6137fc53 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:23.259938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5420c9f-c61d-4d8d-b8e1-e3cc6137fc53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:23.262290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5420c9f-c61d-4d8d-b8e1-e3cc6137fc53 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:23.273269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:23.406904 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 951/1907] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:23 2022] POST /identity/v3/projects => generated 363 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:23.407822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5420c9f-c61d-4d8d-b8e1-e3cc6137fc53 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:23.449668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8435c9bc-5dbc-4076-94e6-6e0a497eb634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff967bb2ed648de98d4c5235f8dea4c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:23.450558 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8435c9bc-5dbc-4076-94e6-6e0a497eb634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff967bb2ed648de98d4c5235f8dea4c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:23.451284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8435c9bc-5dbc-4076-94e6-6e0a497eb634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff967bb2ed648de98d4c5235f8dea4c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:23.461539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8435c9bc-5dbc-4076-94e6-6e0a497eb634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff967bb2ed648de98d4c5235f8dea4c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:23.486097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8435c9bc-5dbc-4076-94e6-6e0a497eb634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff967bb2ed648de98d4c5235f8dea4c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:23.495241 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5420c9f-c61d-4d8d-b8e1-e3cc6137fc53 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:23.501125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e378f-0a2b-4f90-a57d-1d0c751f65ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:23.501976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e378f-0a2b-4f90-a57d-1d0c751f65ea admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:23.502359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e378f-0a2b-4f90-a57d-1d0c751f65ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:23.502734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e378f-0a2b-4f90-a57d-1d0c751f65ea admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:23.503496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e378f-0a2b-4f90-a57d-1d0c751f65ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:23.505814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e378f-0a2b-4f90-a57d-1d0c751f65ea admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:23.607273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 957/1908] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:23 2022] DELETE /identity/v3/users/7ff967bb2ed648de98d4c5235f8dea4c => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:23.642001 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 952/1909] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:23 2022] POST /identity/v3/users => generated 282 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:23.646430 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435c9bc-5dbc-4076-94e6-6e0a497eb634 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:23.648211 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8435c9bc-5dbc-4076-94e6-6e0a497eb634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:23.670627 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e378f-0a2b-4f90-a57d-1d0c751f65ea admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:23.672725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-339e378f-0a2b-4f90-a57d-1d0c751f65ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:23.694144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e378f-0a2b-4f90-a57d-1d0c751f65ea admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:23.756340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fe39e-c221-4dc0-848c-62459cdc5b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:23.756749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435c9bc-5dbc-4076-94e6-6e0a497eb634 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:23.757160 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fe39e-c221-4dc0-848c-62459cdc5b6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:23.757878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fe39e-c221-4dc0-848c-62459cdc5b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:23.757878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fe39e-c221-4dc0-848c-62459cdc5b6f admin admin] PATH_INFO: `/v3/users/70e35fabd2ad456caaf73f164f95b0fd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:23.759158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fe39e-c221-4dc0-848c-62459cdc5b6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=70e35fabd2ad456caaf73f164f95b0fd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:23.761353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fe39e-c221-4dc0-848c-62459cdc5b6f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:23.769621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb780c52-e645-4011-b2cc-3ab5c32f209e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:23.769621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb780c52-e645-4011-b2cc-3ab5c32f209e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:23.769621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb780c52-e645-4011-b2cc-3ab5c32f209e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:23.769621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb780c52-e645-4011-b2cc-3ab5c32f209e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:23.770011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb780c52-e645-4011-b2cc-3ab5c32f209e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:23.770011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb780c52-e645-4011-b2cc-3ab5c32f209e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:23.786730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 958/1910] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:23.790506 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb780c52-e645-4011-b2cc-3ab5c32f209e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:23.813637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb780c52-e645-4011-b2cc-3ab5c32f209e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:23.820008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5c794-bb70-4bc1-bb3c-1c794debc3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:23.820914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5c794-bb70-4bc1-bb3c-1c794debc3ad admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:23.821407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5c794-bb70-4bc1-bb3c-1c794debc3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:23.835021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe5c794-bb70-4bc1-bb3c-1c794debc3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:23.835021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5c794-bb70-4bc1-bb3c-1c794debc3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:23.835021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe5c794-bb70-4bc1-bb3c-1c794debc3ad admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:23.849156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 959/1911] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:23 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:23.853164 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5c794-bb70-4bc1-bb3c-1c794debc3ad admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:23.870390 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe5c794-bb70-4bc1-bb3c-1c794debc3ad admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:23.879315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22566deb-4155-4f28-b386-f53a5dbba293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:23.880358 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22566deb-4155-4f28-b386-f53a5dbba293 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:23.881323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22566deb-4155-4f28-b386-f53a5dbba293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:23.882039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22566deb-4155-4f28-b386-f53a5dbba293 admin admin] PATH_INFO: `/v3/projects/2b4f73ce37fb40f38e6f9b2617c6c948/users/de944fe62c994fb88b2e79a1b2767d62/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:23.903252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22566deb-4155-4f28-b386-f53a5dbba293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b4f73ce37fb40f38e6f9b2617c6c948, user_id=de944fe62c994fb88b2e79a1b2767d62, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:23.907477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22566deb-4155-4f28-b386-f53a5dbba293 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:24.006297 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-103fe39e-c221-4dc0-848c-62459cdc5b6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70e35fabd2ad456caaf73f164f95b0fd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:24.018937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 960/1912] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:23 2022] PUT /identity/v3/projects/2b4f73ce37fb40f38e6f9b2617c6c948/users/de944fe62c994fb88b2e79a1b2767d62/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:24.034454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7b5df-20fb-4c76-bf7f-681b37c0f6ff None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:24.034961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7b5df-20fb-4c76-bf7f-681b37c0f6ff None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:24.035759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7b5df-20fb-4c76-bf7f-681b37c0f6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:24.050903 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-103fe39e-c221-4dc0-848c-62459cdc5b6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70e35fabd2ad456caaf73f164f95b0fd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:24.052775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-103fe39e-c221-4dc0-848c-62459cdc5b6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70e35fabd2ad456caaf73f164f95b0fd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:24.054119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-103fe39e-c221-4dc0-848c-62459cdc5b6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70e35fabd2ad456caaf73f164f95b0fd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:24.072474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-103fe39e-c221-4dc0-848c-62459cdc5b6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70e35fabd2ad456caaf73f164f95b0fd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:24.080016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2bf7b5df-20fb-4c76-bf7f-681b37c0f6ff None None] MFA Rules not processed for user `de944fe62c994fb88b2e79a1b2767d62`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:24.082038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2bf7b5df-20fb-4c76-bf7f-681b37c0f6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:24.232478 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 961/1913] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:24.243802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 953/1914] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:23 2022] DELETE /identity/v3/users/70e35fabd2ad456caaf73f164f95b0fd => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:24.245948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7b5df-20fb-4c76-bf7f-681b37c0f6ff None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:24.248326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54770db-2a94-4f4f-be41-74424864bd8b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:24.248612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54770db-2a94-4f4f-be41-74424864bd8b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:24.249030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54770db-2a94-4f4f-be41-74424864bd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:24.250992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2bf7b5df-20fb-4c76-bf7f-681b37c0f6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:24.297247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a54770db-2a94-4f4f-be41-74424864bd8b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:24.298821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a54770db-2a94-4f4f-be41-74424864bd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:24.345024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7b5df-20fb-4c76-bf7f-681b37c0f6ff None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:24.376922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 954/1915] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:24.392671 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54770db-2a94-4f4f-be41-74424864bd8b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:24.394190 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a54770db-2a94-4f4f-be41-74424864bd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:24.426726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011a01f0-9f2a-4bcd-8968-bb2afb1ce865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:24.427542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a01f0-9f2a-4bcd-8968-bb2afb1ce865 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:24.427928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a01f0-9f2a-4bcd-8968-bb2afb1ce865 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:24.428206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a01f0-9f2a-4bcd-8968-bb2afb1ce865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:24.468285 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54770db-2a94-4f4f-be41-74424864bd8b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:24.476910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3266c-9193-4479-bd53-0f786698c413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:24.477722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3266c-9193-4479-bd53-0f786698c413 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:24.477965 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3266c-9193-4479-bd53-0f786698c413 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:24.479403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3266c-9193-4479-bd53-0f786698c413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:24.502587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3266c-9193-4479-bd53-0f786698c413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:24.502587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3266c-9193-4479-bd53-0f786698c413 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:24.524089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 955/1916] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:24.524950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3266c-9193-4479-bd53-0f786698c413 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:24.526380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c9a3266c-9193-4479-bd53-0f786698c413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:24.560399 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a01f0-9f2a-4bcd-8968-bb2afb1ce865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:24.562990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3266c-9193-4479-bd53-0f786698c413 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:24.565108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011a01f0-9f2a-4bcd-8968-bb2afb1ce865 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:24.578102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7673f815-214f-4c62-87e7-422367c4ee68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:24.578102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673f815-214f-4c62-87e7-422367c4ee68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:24.578102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673f815-214f-4c62-87e7-422367c4ee68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:24.578102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7673f815-214f-4c62-87e7-422367c4ee68 admin admin] PATH_INFO: `/v3/projects/e7b8e45aa31045bcb71fe4bf0ce6fabe` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:24.584217 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673f815-214f-4c62-87e7-422367c4ee68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7b8e45aa31045bcb71fe4bf0ce6fabe)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:24.586307 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 962/1917] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:24.589003 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7673f815-214f-4c62-87e7-422367c4ee68 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:24.797095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7673f815-214f-4c62-87e7-422367c4ee68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7b8e45aa31045bcb71fe4bf0ce6fabe', 'request_id': 'req-7673f815-214f-4c62-87e7-422367c4ee68'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:24.807049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7673f815-214f-4c62-87e7-422367c4ee68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7b8e45aa31045bcb71fe4bf0ce6fabe', 'request_id': 'req-7673f815-214f-4c62-87e7-422367c4ee68'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:24.813504 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7673f815-214f-4c62-87e7-422367c4ee68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7b8e45aa31045bcb71fe4bf0ce6fabe', 'request_id': 'req-7673f815-214f-4c62-87e7-422367c4ee68'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:24.904082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7673f815-214f-4c62-87e7-422367c4ee68 admin admin] The token cache is being invalidate because project e7b8e45aa31045bcb71fe4bf0ce6fabe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:24.904382 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7673f815-214f-4c62-87e7-422367c4ee68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:24.905064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7673f815-214f-4c62-87e7-422367c4ee68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:24.907295 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 956/1918] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:24 2022] DELETE /identity/v3/projects/e7b8e45aa31045bcb71fe4bf0ce6fabe => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:24.912798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a5d72-efb4-451d-a8f2-7cf3980faad3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:24.913314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a5d72-efb4-451d-a8f2-7cf3980faad3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:24.914038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477a5d72-efb4-451d-a8f2-7cf3980faad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:24.938846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-477a5d72-efb4-451d-a8f2-7cf3980faad3 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:24.938846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-477a5d72-efb4-451d-a8f2-7cf3980faad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:25.010753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:25.043038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 963/1919] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:25.045326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a60858-79cb-42f8-9bd4-ea55b220dfae None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:25.049666 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a60858-79cb-42f8-9bd4-ea55b220dfae None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:25.050155 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a60858-79cb-42f8-9bd4-ea55b220dfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:25.080221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-41a60858-79cb-42f8-9bd4-ea55b220dfae None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:25.081950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-41a60858-79cb-42f8-9bd4-ea55b220dfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:25.091536 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 957/1920] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:25.097250 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a5d72-efb4-451d-a8f2-7cf3980faad3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:25.114653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477a5d72-efb4-451d-a8f2-7cf3980faad3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:25.118870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfb980-1b7f-42b3-b9c8-ad3973040df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:25.120048 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb980-1b7f-42b3-b9c8-ad3973040df3 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:25.120342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb980-1b7f-42b3-b9c8-ad3973040df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:25.120705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dfb980-1b7f-42b3-b9c8-ad3973040df3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:25.121481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfb980-1b7f-42b3-b9c8-ad3973040df3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:25.121794 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfb980-1b7f-42b3-b9c8-ad3973040df3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:25.123375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dfb980-1b7f-42b3-b9c8-ad3973040df3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:25.142702 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 964/1921] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:25.143323 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a60858-79cb-42f8-9bd4-ea55b220dfae None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:25.154074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a60858-79cb-42f8-9bd4-ea55b220dfae None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:25.162858 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac2c70-f49c-406d-9493-f8843f8005dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:25.163720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac2c70-f49c-406d-9493-f8843f8005dd admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:25.164062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac2c70-f49c-406d-9493-f8843f8005dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:25.164515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ac2c70-f49c-406d-9493-f8843f8005dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:25.165230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac2c70-f49c-406d-9493-f8843f8005dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:25.167706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ac2c70-f49c-406d-9493-f8843f8005dd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:25.180616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfb980-1b7f-42b3-b9c8-ad3973040df3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:25.183078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-76dfb980-1b7f-42b3-b9c8-ad3973040df3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:25.201155 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dfb980-1b7f-42b3-b9c8-ad3973040df3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:25.230071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:25.241130 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:25.241468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:25.241753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] PATH_INFO: `/v3/projects/43e12dca7d63471c8deb3883b0da16db` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:25.243829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43e12dca7d63471c8deb3883b0da16db)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:25.250201 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:25.281731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 958/1922] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:25 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:25.283561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac2c70-f49c-406d-9493-f8843f8005dd admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:25.401160 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ac2c70-f49c-406d-9493-f8843f8005dd admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:25.423746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041828a-2d7f-4315-a1ac-1d192ffa1aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:25.424339 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041828a-2d7f-4315-a1ac-1d192ffa1aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:25.424623 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041828a-2d7f-4315-a1ac-1d192ffa1aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:25.425301 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8041828a-2d7f-4315-a1ac-1d192ffa1aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:25.426533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041828a-2d7f-4315-a1ac-1d192ffa1aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:25.428552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8041828a-2d7f-4315-a1ac-1d192ffa1aa6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:25.461729 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43e12dca7d63471c8deb3883b0da16db', 'request_id': 'req-da613af8-a74e-4908-855a-5a31ec525992'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:25.469714 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43e12dca7d63471c8deb3883b0da16db', 'request_id': 'req-da613af8-a74e-4908-855a-5a31ec525992'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:25.527126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 959/1923] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:25 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:25.531313 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041828a-2d7f-4315-a1ac-1d192ffa1aa6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:25.542148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8041828a-2d7f-4315-a1ac-1d192ffa1aa6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:25.579384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43e12dca7d63471c8deb3883b0da16db', 'request_id': 'req-da613af8-a74e-4908-855a-5a31ec525992'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:25.601188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] The token cache is being invalidate because project 43e12dca7d63471c8deb3883b0da16db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:25.601633 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:25.603201 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:25.607976 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 965/1924] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:25 2022] DELETE /identity/v3/projects/43e12dca7d63471c8deb3883b0da16db => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:25.609037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:25.609313 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bc049-6cca-48bb-8da9-f51909f9f440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:25.610113 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bc049-6cca-48bb-8da9-f51909f9f440 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:25.610400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bc049-6cca-48bb-8da9-f51909f9f440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:25.610801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:25.610916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9bc049-6cca-48bb-8da9-f51909f9f440 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:25.611468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bc049-6cca-48bb-8da9-f51909f9f440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:25.613197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9bc049-6cca-48bb-8da9-f51909f9f440 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:25.633512 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 960/1925] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:25.633700 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da613af8-a74e-4908-855a-5a31ec525992 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:25.634828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49860191-8c2e-4268-87d9-7696c050459e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:25.635109 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49860191-8c2e-4268-87d9-7696c050459e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:25.635394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49860191-8c2e-4268-87d9-7696c050459e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:25.635670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49860191-8c2e-4268-87d9-7696c050459e admin admin] PATH_INFO: `/v3/users/551aa45aba6c4feeb923023835c5ca1d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:25.636881 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49860191-8c2e-4268-87d9-7696c050459e admin admin] RBAC: Authorizing `identity:delete_user(user_id=551aa45aba6c4feeb923023835c5ca1d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:25.637011 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bc049-6cca-48bb-8da9-f51909f9f440 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:25.639042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49860191-8c2e-4268-87d9-7696c050459e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:25.639282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ff9bc049-6cca-48bb-8da9-f51909f9f440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:25.650788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:25.657689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9bc049-6cca-48bb-8da9-f51909f9f440 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:25.671639 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef058a4-48f9-449e-938e-1c01f6e248bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:25.672432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef058a4-48f9-449e-938e-1c01f6e248bb admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:25.672725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef058a4-48f9-449e-938e-1c01f6e248bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:25.672983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef058a4-48f9-449e-938e-1c01f6e248bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:25.673642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef058a4-48f9-449e-938e-1c01f6e248bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:25.675528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef058a4-48f9-449e-938e-1c01f6e248bb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:25.686499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 961/1926] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:25.690926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef058a4-48f9-449e-938e-1c01f6e248bb admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:25.702699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef058a4-48f9-449e-938e-1c01f6e248bb admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:25.706813 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec4c6c-06f3-4c7e-a2ca-f282de8322a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:25.708051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec4c6c-06f3-4c7e-a2ca-f282de8322a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:25.708352 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec4c6c-06f3-4c7e-a2ca-f282de8322a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:25.708697 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec4c6c-06f3-4c7e-a2ca-f282de8322a2 admin admin] PATH_INFO: `/v3/projects/2751bb2fc76d484f8cb286cf50c08da3/users/eb3bcfd40e7a4d24b97f6f4b8bf90a2e/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:25.725271 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec4c6c-06f3-4c7e-a2ca-f282de8322a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2751bb2fc76d484f8cb286cf50c08da3, user_id=eb3bcfd40e7a4d24b97f6f4b8bf90a2e, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:25.728137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec4c6c-06f3-4c7e-a2ca-f282de8322a2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:25.810178 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 962/1927] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:25 2022] PUT /identity/v3/projects/2751bb2fc76d484f8cb286cf50c08da3/users/eb3bcfd40e7a4d24b97f6f4b8bf90a2e/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:25.821467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73536b03-d5f5-47e4-b298-e2279bf0842f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:25.821753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73536b03-d5f5-47e4-b298-e2279bf0842f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:25.822016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73536b03-d5f5-47e4-b298-e2279bf0842f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:25.867059 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49860191-8c2e-4268-87d9-7696c050459e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '551aa45aba6c4feeb923023835c5ca1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:25.868083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49860191-8c2e-4268-87d9-7696c050459e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '551aa45aba6c4feeb923023835c5ca1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:25.868943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49860191-8c2e-4268-87d9-7696c050459e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '551aa45aba6c4feeb923023835c5ca1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:25.877680 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-73536b03-d5f5-47e4-b298-e2279bf0842f None None] MFA Rules not processed for user `eb3bcfd40e7a4d24b97f6f4b8bf90a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:25.878675 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-73536b03-d5f5-47e4-b298-e2279bf0842f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:25.886126 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49860191-8c2e-4268-87d9-7696c050459e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '551aa45aba6c4feeb923023835c5ca1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:25.908118 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-49860191-8c2e-4268-87d9-7696c050459e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '551aa45aba6c4feeb923023835c5ca1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:25.990837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 966/1928] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:25 2022] DELETE /identity/v3/users/551aa45aba6c4feeb923023835c5ca1d => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:26.054283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 963/1929] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:26.055767 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49860191-8c2e-4268-87d9-7696c050459e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:26.057639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-49860191-8c2e-4268-87d9-7696c050459e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:26.146928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49860191-8c2e-4268-87d9-7696c050459e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:26.152123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584ac57-d07a-4bba-9bcd-1c002117b0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:26.152934 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584ac57-d07a-4bba-9bcd-1c002117b0aa admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:26.153221 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584ac57-d07a-4bba-9bcd-1c002117b0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:26.153496 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4584ac57-d07a-4bba-9bcd-1c002117b0aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:26.154206 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584ac57-d07a-4bba-9bcd-1c002117b0aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:26.156072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4584ac57-d07a-4bba-9bcd-1c002117b0aa admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:26.369512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 967/1930] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:26 2022] POST /identity/v3/projects => generated 373 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:26.379494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73536b03-d5f5-47e4-b298-e2279bf0842f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:26.495898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73536b03-d5f5-47e4-b298-e2279bf0842f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:26.626163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e5622-2437-4963-9a6d-6563d05f8d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:26.627889 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e5622-2437-4963-9a6d-6563d05f8d2f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:26.627889 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e5622-2437-4963-9a6d-6563d05f8d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:26.628500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876e5622-2437-4963-9a6d-6563d05f8d2f admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:26.629496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e5622-2437-4963-9a6d-6563d05f8d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:26.631609 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876e5622-2437-4963-9a6d-6563d05f8d2f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:26.653105 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584ac57-d07a-4bba-9bcd-1c002117b0aa admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:26.654967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4584ac57-d07a-4bba-9bcd-1c002117b0aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:26.673655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4584ac57-d07a-4bba-9bcd-1c002117b0aa admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:26.675019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:26.676091 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:26.676678 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:26.677092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] PATH_INFO: `/v3/projects/5699fa991ac545ba9a0370fc6f2f20df` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:26.678933 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=5699fa991ac545ba9a0370fc6f2f20df)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:26.680560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:26.740642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 964/1931] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:26 2022] POST /identity/v3/users => generated 293 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:26.744485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e5622-2437-4963-9a6d-6563d05f8d2f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:26.758023 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876e5622-2437-4963-9a6d-6563d05f8d2f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:26.763010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9aca99-fec7-432f-b9a7-8f9e0901d2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:26.763634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aca99-fec7-432f-b9a7-8f9e0901d2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:26.763950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aca99-fec7-432f-b9a7-8f9e0901d2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:26.764391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9aca99-fec7-432f-b9a7-8f9e0901d2c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:26.765039 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9aca99-fec7-432f-b9a7-8f9e0901d2c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:26.766682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9aca99-fec7-432f-b9a7-8f9e0901d2c6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:26.778247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 965/1932] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:26.782323 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9aca99-fec7-432f-b9a7-8f9e0901d2c6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:26.792786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9aca99-fec7-432f-b9a7-8f9e0901d2c6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:26.795279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:26.799389 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee707136-84b9-4d63-9c2e-5a8e5afb1ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:26.800069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee707136-84b9-4d63-9c2e-5a8e5afb1ca0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:26.800351 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee707136-84b9-4d63-9c2e-5a8e5afb1ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:26.800623 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee707136-84b9-4d63-9c2e-5a8e5afb1ca0 admin admin] PATH_INFO: `/v3/projects/67464b80a4164fb9be2307e3cd3e4a10/users/2c1d35feec2342b3ae9b59302c7d7557/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:26.811372 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5699fa991ac545ba9a0370fc6f2f20df', 'request_id': 'req-86573de3-4bff-4c2c-afeb-c576927467fd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:26.817230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee707136-84b9-4d63-9c2e-5a8e5afb1ca0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67464b80a4164fb9be2307e3cd3e4a10, user_id=2c1d35feec2342b3ae9b59302c7d7557, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:26.821177 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee707136-84b9-4d63-9c2e-5a8e5afb1ca0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:26.830562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5699fa991ac545ba9a0370fc6f2f20df', 'request_id': 'req-86573de3-4bff-4c2c-afeb-c576927467fd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:26.913576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5699fa991ac545ba9a0370fc6f2f20df', 'request_id': 'req-86573de3-4bff-4c2c-afeb-c576927467fd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:26.919348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 966/1933] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:26 2022] PUT /identity/v3/projects/67464b80a4164fb9be2307e3cd3e4a10/users/2c1d35feec2342b3ae9b59302c7d7557/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:26.923905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee707136-84b9-4d63-9c2e-5a8e5afb1ca0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:26.925719 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] The token cache is being invalidate because project 5699fa991ac545ba9a0370fc6f2f20df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:26.926048 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:26.926968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:26.928518 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 968/1934] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:26 2022] DELETE /identity/v3/projects/5699fa991ac545ba9a0370fc6f2f20df => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:26.932402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:26.933727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:27.000512 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee707136-84b9-4d63-9c2e-5a8e5afb1ca0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:27.005930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17302901-4713-4350-b994-b01d18117351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:27.006696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17302901-4713-4350-b994-b01d18117351 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:27.006975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17302901-4713-4350-b994-b01d18117351 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:27.007245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17302901-4713-4350-b994-b01d18117351 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:27.007904 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17302901-4713-4350-b994-b01d18117351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:27.009498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17302901-4713-4350-b994-b01d18117351 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:27.016323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86573de3-4bff-4c2c-afeb-c576927467fd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:27.023291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 967/1935] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:27.024952 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fb29e-d1fd-40db-bce7-ba65197c045e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:27.025604 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb29e-d1fd-40db-bce7-ba65197c045e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:27.025881 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb29e-d1fd-40db-bce7-ba65197c045e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:27.026161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fb29e-d1fd-40db-bce7-ba65197c045e admin admin] PATH_INFO: `/v3/users/79024a6604b64c349b11b44fcaf8d297` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:27.027815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fb29e-d1fd-40db-bce7-ba65197c045e admin admin] RBAC: Authorizing `identity:delete_user(user_id=79024a6604b64c349b11b44fcaf8d297)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:27.029421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17302901-4713-4350-b994-b01d18117351 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:27.029981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fb29e-d1fd-40db-bce7-ba65197c045e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:27.031286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-17302901-4713-4350-b994-b01d18117351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:27.047279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17302901-4713-4350-b994-b01d18117351 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:27.053342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae6636-7979-4182-979b-3efc3fcacea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:27.054593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae6636-7979-4182-979b-3efc3fcacea6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:27.054982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae6636-7979-4182-979b-3efc3fcacea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:27.055332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae6636-7979-4182-979b-3efc3fcacea6 admin admin] PATH_INFO: `/v3/projects/67464b80a4164fb9be2307e3cd3e4a10/users/2c1d35feec2342b3ae9b59302c7d7557/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:27.058149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae6636-7979-4182-979b-3efc3fcacea6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=67464b80a4164fb9be2307e3cd3e4a10, user_id=2c1d35feec2342b3ae9b59302c7d7557, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:27.061653 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aae6636-7979-4182-979b-3efc3fcacea6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:27.073337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 968/1936] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:27 2022] PUT /identity/v3/projects/67464b80a4164fb9be2307e3cd3e4a10/users/2c1d35feec2342b3ae9b59302c7d7557/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:27.084046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972abdb3-0dab-450a-8cb9-1512e0fb2de0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:27.084949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972abdb3-0dab-450a-8cb9-1512e0fb2de0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:27.085316 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972abdb3-0dab-450a-8cb9-1512e0fb2de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:27.117637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-972abdb3-0dab-450a-8cb9-1512e0fb2de0 None None] MFA Rules not processed for user `2c1d35feec2342b3ae9b59302c7d7557`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:27.118866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-972abdb3-0dab-450a-8cb9-1512e0fb2de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:27.193309 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 969/1937] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:27 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:27.204663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972abdb3-0dab-450a-8cb9-1512e0fb2de0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:27.206019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-972abdb3-0dab-450a-8cb9-1512e0fb2de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:27.264684 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972abdb3-0dab-450a-8cb9-1512e0fb2de0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:27.268552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af3b8c-3acc-4821-b620-fbe71bee94e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:27.270127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af3b8c-3acc-4821-b620-fbe71bee94e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:27.270127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af3b8c-3acc-4821-b620-fbe71bee94e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:27.270495 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01af3b8c-3acc-4821-b620-fbe71bee94e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:27.275801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-01af3b8c-3acc-4821-b620-fbe71bee94e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:27.278037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:27.286210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e72fb29e-d1fd-40db-bce7-ba65197c045e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79024a6604b64c349b11b44fcaf8d297'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:27.286904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e72fb29e-d1fd-40db-bce7-ba65197c045e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79024a6604b64c349b11b44fcaf8d297'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:27.287880 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e72fb29e-d1fd-40db-bce7-ba65197c045e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79024a6604b64c349b11b44fcaf8d297'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:27.296651 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e72fb29e-d1fd-40db-bce7-ba65197c045e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79024a6604b64c349b11b44fcaf8d297'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:27.314892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e72fb29e-d1fd-40db-bce7-ba65197c045e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79024a6604b64c349b11b44fcaf8d297'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:27.342790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af3b8c-3acc-4821-b620-fbe71bee94e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:27.344260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01af3b8c-3acc-4821-b620-fbe71bee94e2 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:27.354076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 970/1938] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:27.433854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 969/1939] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:26 2022] DELETE /identity/v3/users/79024a6604b64c349b11b44fcaf8d297 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:27.869507 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af3b8c-3acc-4821-b620-fbe71bee94e2 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:27.929743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01af3b8c-3acc-4821-b620-fbe71bee94e2 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:27.984178 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:27.984733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:27.985016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:27.985290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2 admin admin] PATH_INFO: `/v3/projects/c8e209357c6845f6b9b5d761c7481bdc` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:27.986426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e209357c6845f6b9b5d761c7481bdc)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:27.988373 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:28.142566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e209357c6845f6b9b5d761c7481bdc', 'request_id': 'req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:28.149498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e209357c6845f6b9b5d761c7481bdc', 'request_id': 'req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:28.157599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e209357c6845f6b9b5d761c7481bdc', 'request_id': 'req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:28.330952 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2 admin admin] The token cache is being invalidate because project c8e209357c6845f6b9b5d761c7481bdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:28.331429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:28.332167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e7e893a0-9ebc-4013-9ab0-0ccb997aa9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:28.334435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 971/1940] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:27 2022] DELETE /identity/v3/projects/c8e209357c6845f6b9b5d761c7481bdc => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:28.340623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e620907-01c9-447f-8181-301b06ce2a3b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:28.341129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e620907-01c9-447f-8181-301b06ce2a3b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:28.341129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e620907-01c9-447f-8181-301b06ce2a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:28.360566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7e620907-01c9-447f-8181-301b06ce2a3b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:28.361755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7e620907-01c9-447f-8181-301b06ce2a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:28.450724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd675e1-9790-4c16-a1a7-810295ec28ff None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:28.451005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd675e1-9790-4c16-a1a7-810295ec28ff None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:28.451280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd675e1-9790-4c16-a1a7-810295ec28ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:28.451931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 970/1941] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:28.480357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3cd675e1-9790-4c16-a1a7-810295ec28ff None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:28.481580 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3cd675e1-9790-4c16-a1a7-810295ec28ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:28.491383 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 972/1942] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:28.495895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e620907-01c9-447f-8181-301b06ce2a3b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:28.506638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e620907-01c9-447f-8181-301b06ce2a3b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:28.513809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:28.517231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b5aeb-1e06-41a8-b15e-42facda42024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:28.521245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b5aeb-1e06-41a8-b15e-42facda42024 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:28.521245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b5aeb-1e06-41a8-b15e-42facda42024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:28.521245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b5aeb-1e06-41a8-b15e-42facda42024 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:28.521245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b5aeb-1e06-41a8-b15e-42facda42024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:28.521245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b5aeb-1e06-41a8-b15e-42facda42024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:28.521956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b5aeb-1e06-41a8-b15e-42facda42024 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:28.539969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 971/1943] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:28.541322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd675e1-9790-4c16-a1a7-810295ec28ff None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:28.551786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd675e1-9790-4c16-a1a7-810295ec28ff None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:28.557420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead46fd1-2109-48fe-9c87-a2bf91513635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:28.558198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead46fd1-2109-48fe-9c87-a2bf91513635 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:28.558307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead46fd1-2109-48fe-9c87-a2bf91513635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:28.558560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead46fd1-2109-48fe-9c87-a2bf91513635 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:28.559202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead46fd1-2109-48fe-9c87-a2bf91513635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:28.561797 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead46fd1-2109-48fe-9c87-a2bf91513635 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:28.674060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 973/1944] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:28 2022] POST /identity/v3/projects => generated 407 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:28.678510 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b5aeb-1e06-41a8-b15e-42facda42024 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:28.688752 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b5aeb-1e06-41a8-b15e-42facda42024 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:28.745013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e5631-dd3f-448e-b034-fb938a40ee3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:28.745704 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e5631-dd3f-448e-b034-fb938a40ee3f admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:28.745982 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e5631-dd3f-448e-b034-fb938a40ee3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:28.746255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e5631-dd3f-448e-b034-fb938a40ee3f admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:28.746871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e5631-dd3f-448e-b034-fb938a40ee3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:28.748834 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e5631-dd3f-448e-b034-fb938a40ee3f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:28.888955 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 972/1945] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:28 2022] POST /identity/v3/users => generated 304 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:28.890983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead46fd1-2109-48fe-9c87-a2bf91513635 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:28.902986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead46fd1-2109-48fe-9c87-a2bf91513635 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:28.908384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff466df-8788-45d4-8549-18a3cf725c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:28.909093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff466df-8788-45d4-8549-18a3cf725c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:28.909437 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff466df-8788-45d4-8549-18a3cf725c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:28.909778 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff466df-8788-45d4-8549-18a3cf725c40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:28.910492 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff466df-8788-45d4-8549-18a3cf725c40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:28.912443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff466df-8788-45d4-8549-18a3cf725c40 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:28.922524 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 974/1946] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:28.926846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e5631-dd3f-448e-b034-fb938a40ee3f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:28.935108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:28.939561 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e5631-dd3f-448e-b034-fb938a40ee3f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:28.944816 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b476754-075e-46a8-8234-3f54866bb89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:28.945411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476754-075e-46a8-8234-3f54866bb89c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:28.945690 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476754-075e-46a8-8234-3f54866bb89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:28.945960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b476754-075e-46a8-8234-3f54866bb89c admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:28.946633 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b476754-075e-46a8-8234-3f54866bb89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:28.948456 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b476754-075e-46a8-8234-3f54866bb89c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:28.960783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 973/1947] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:28.965053 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff466df-8788-45d4-8549-18a3cf725c40 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:28.975146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff466df-8788-45d4-8549-18a3cf725c40 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:28.980276 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c67cd-7926-4648-8ff7-5b1b90488b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:28.981757 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c67cd-7926-4648-8ff7-5b1b90488b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:28.981757 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c67cd-7926-4648-8ff7-5b1b90488b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:28.981757 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753c67cd-7926-4648-8ff7-5b1b90488b36 admin admin] PATH_INFO: `/v3/projects/37488546fac74284bb4d0131a1d47315/users/7564acfba2f7469c893742388b49ab55/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:28.998000 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c67cd-7926-4648-8ff7-5b1b90488b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37488546fac74284bb4d0131a1d47315, user_id=7564acfba2f7469c893742388b49ab55, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:29.000823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753c67cd-7926-4648-8ff7-5b1b90488b36 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:29.086079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 975/1948] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:28 2022] PUT /identity/v3/projects/37488546fac74284bb4d0131a1d47315/users/7564acfba2f7469c893742388b49ab55/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:29.097499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87241af8-3375-4572-822b-7b9374776f0b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:29.097794 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87241af8-3375-4572-822b-7b9374776f0b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:29.098058 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87241af8-3375-4572-822b-7b9374776f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:29.126170 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-87241af8-3375-4572-822b-7b9374776f0b None None] MFA Rules not processed for user `7564acfba2f7469c893742388b49ab55`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:29.127387 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-87241af8-3375-4572-822b-7b9374776f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:29.200267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 974/1949] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:29 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:29.204632 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c67cd-7926-4648-8ff7-5b1b90488b36 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:29.294383 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753c67cd-7926-4648-8ff7-5b1b90488b36 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:29.299552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90729a-43cd-4380-8e1b-a818f3eb7c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:29.300235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90729a-43cd-4380-8e1b-a818f3eb7c67 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:29.300565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90729a-43cd-4380-8e1b-a818f3eb7c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:29.300875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d90729a-43cd-4380-8e1b-a818f3eb7c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:29.301513 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90729a-43cd-4380-8e1b-a818f3eb7c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:29.307280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d90729a-43cd-4380-8e1b-a818f3eb7c67 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:29.399166 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 976/1950] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:29 2022] POST /identity/v3/projects => generated 407 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:29.401603 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87241af8-3375-4572-822b-7b9374776f0b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:29.413427 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87241af8-3375-4572-822b-7b9374776f0b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:29.501048 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab96a5-e842-438d-b260-e3dfe1fa647e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:29.501508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab96a5-e842-438d-b260-e3dfe1fa647e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:29.502996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab96a5-e842-438d-b260-e3dfe1fa647e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:29.502996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab96a5-e842-438d-b260-e3dfe1fa647e admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:29.502996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab96a5-e842-438d-b260-e3dfe1fa647e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:29.508726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ab96a5-e842-438d-b260-e3dfe1fa647e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:29.624158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 975/1951] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:29 2022] POST /identity/v3/users => generated 310 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:29.628111 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90729a-43cd-4380-8e1b-a818f3eb7c67 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:29.642593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d90729a-43cd-4380-8e1b-a818f3eb7c67 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:29.661784 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3554f5c-02e7-4f34-8809-8eb5a8f68397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:29.662440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554f5c-02e7-4f34-8809-8eb5a8f68397 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:29.663002 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554f5c-02e7-4f34-8809-8eb5a8f68397 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:29.663337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3554f5c-02e7-4f34-8809-8eb5a8f68397 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:29.664186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3554f5c-02e7-4f34-8809-8eb5a8f68397 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:29.665946 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3554f5c-02e7-4f34-8809-8eb5a8f68397 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:29.691885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:29.694368 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 977/1952] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:29.697786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab96a5-e842-438d-b260-e3dfe1fa647e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:29.712043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ab96a5-e842-438d-b260-e3dfe1fa647e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:29.720786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d0095-d72b-4e28-9c82-0730a7e468e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:29.721697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d0095-d72b-4e28-9c82-0730a7e468e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:29.721987 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d0095-d72b-4e28-9c82-0730a7e468e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:29.722631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d0095-d72b-4e28-9c82-0730a7e468e7 admin admin] PATH_INFO: `/v3/projects/20a92712a7524fb887ced972d0ebc283/users/f5c03c9052284aaba9653a5d17598b81/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:29.741381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d0095-d72b-4e28-9c82-0730a7e468e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a92712a7524fb887ced972d0ebc283, user_id=f5c03c9052284aaba9653a5d17598b81, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:29.744434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d0095-d72b-4e28-9c82-0730a7e468e7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:29.822702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:29.830182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 976/1953] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:29 2022] PUT /identity/v3/projects/20a92712a7524fb887ced972d0ebc283/users/f5c03c9052284aaba9653a5d17598b81/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:29.834839 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3554f5c-02e7-4f34-8809-8eb5a8f68397 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:29.846394 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3554f5c-02e7-4f34-8809-8eb5a8f68397 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:29.907198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2845578-2073-4120-98da-b80dcdb31cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:29.907905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2845578-2073-4120-98da-b80dcdb31cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:29.908100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2845578-2073-4120-98da-b80dcdb31cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:29.908376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2845578-2073-4120-98da-b80dcdb31cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:29.909014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2845578-2073-4120-98da-b80dcdb31cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:29.910613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2845578-2073-4120-98da-b80dcdb31cf0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:29.920551 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 978/1954] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:29 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:29.924918 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d0095-d72b-4e28-9c82-0730a7e468e7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:29.935370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d0095-d72b-4e28-9c82-0730a7e468e7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:29.940292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16810b-cf5d-4be5-9384-2b023523cead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:29.940941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16810b-cf5d-4be5-9384-2b023523cead admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:29.941224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16810b-cf5d-4be5-9384-2b023523cead admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:29.941498 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d16810b-cf5d-4be5-9384-2b023523cead admin admin] PATH_INFO: `/v3/projects/20a92712a7524fb887ced972d0ebc283/users/f5c03c9052284aaba9653a5d17598b81/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:29.943997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16810b-cf5d-4be5-9384-2b023523cead admin admin] RBAC: Authorizing `identity:create_grant(project_id=20a92712a7524fb887ced972d0ebc283, user_id=f5c03c9052284aaba9653a5d17598b81, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:29.946667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d16810b-cf5d-4be5-9384-2b023523cead admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:29.957038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 977/1955] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:29 2022] PUT /identity/v3/projects/20a92712a7524fb887ced972d0ebc283/users/f5c03c9052284aaba9653a5d17598b81/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:29.969319 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb5416-7d9f-4fd3-9a47-cd1c171b1324 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:29.969600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb5416-7d9f-4fd3-9a47-cd1c171b1324 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:29.969871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb5416-7d9f-4fd3-9a47-cd1c171b1324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:30.002688 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-dcdb5416-7d9f-4fd3-9a47-cd1c171b1324 None None] MFA Rules not processed for user `f5c03c9052284aaba9653a5d17598b81`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:30.003991 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dcdb5416-7d9f-4fd3-9a47-cd1c171b1324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:30.131707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 979/1956] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:29 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:30.354530 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16810b-cf5d-4be5-9384-2b023523cead admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:30.356761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7d16810b-cf5d-4be5-9384-2b023523cead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:30.453174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d16810b-cf5d-4be5-9384-2b023523cead admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:30.459193 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff9663-0601-4237-94ee-39b94f3f6abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:30.460095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff9663-0601-4237-94ee-39b94f3f6abb service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:30.460357 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff9663-0601-4237-94ee-39b94f3f6abb service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:30.460943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff9663-0601-4237-94ee-39b94f3f6abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:30.476034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff9663-0601-4237-94ee-39b94f3f6abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:30.477515 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff9663-0601-4237-94ee-39b94f3f6abb service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:30.489631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 978/1957] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:30 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:30.572548 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb5416-7d9f-4fd3-9a47-cd1c171b1324 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:30.574141 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dcdb5416-7d9f-4fd3-9a47-cd1c171b1324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:30.644209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb5416-7d9f-4fd3-9a47-cd1c171b1324 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:30.648885 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315045d9-07f0-4806-9bc9-539d0263b6e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:30.649664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315045d9-07f0-4806-9bc9-539d0263b6e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:30.649939 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315045d9-07f0-4806-9bc9-539d0263b6e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:30.650209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315045d9-07f0-4806-9bc9-539d0263b6e6 admin admin] PATH_INFO: `/v3/users/eb3bcfd40e7a4d24b97f6f4b8bf90a2e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:30.651410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315045d9-07f0-4806-9bc9-539d0263b6e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb3bcfd40e7a4d24b97f6f4b8bf90a2e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:30.653461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315045d9-07f0-4806-9bc9-539d0263b6e6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:30.870018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-315045d9-07f0-4806-9bc9-539d0263b6e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb3bcfd40e7a4d24b97f6f4b8bf90a2e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:30.884225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-315045d9-07f0-4806-9bc9-539d0263b6e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb3bcfd40e7a4d24b97f6f4b8bf90a2e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:30.884941 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-315045d9-07f0-4806-9bc9-539d0263b6e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb3bcfd40e7a4d24b97f6f4b8bf90a2e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:30.885567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-315045d9-07f0-4806-9bc9-539d0263b6e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb3bcfd40e7a4d24b97f6f4b8bf90a2e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:30.900367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff9663-0601-4237-94ee-39b94f3f6abb service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:30.900543 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-315045d9-07f0-4806-9bc9-539d0263b6e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb3bcfd40e7a4d24b97f6f4b8bf90a2e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:30.909821 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff9663-0601-4237-94ee-39b94f3f6abb service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:30.914931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c022d43-35d1-4e28-83db-910ce8315aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:30.915619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c022d43-35d1-4e28-83db-910ce8315aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:30.915953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c022d43-35d1-4e28-83db-910ce8315aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:30.916228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c022d43-35d1-4e28-83db-910ce8315aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:30.918002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1c022d43-35d1-4e28-83db-910ce8315aa7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:30.942851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:30.983281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c022d43-35d1-4e28-83db-910ce8315aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:30.984749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c022d43-35d1-4e28-83db-910ce8315aa7 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:30.994343 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 979/1958] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:30 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:31.007935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 980/1959] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:30 2022] DELETE /identity/v3/users/eb3bcfd40e7a4d24b97f6f4b8bf90a2e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:31.012228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a8d41-339b-4e70-8dd7-1a7aa93cb5a7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:31.012698 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a8d41-339b-4e70-8dd7-1a7aa93cb5a7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:31.012982 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3a8d41-339b-4e70-8dd7-1a7aa93cb5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:31.034108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9f3a8d41-339b-4e70-8dd7-1a7aa93cb5a7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:31.035686 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9f3a8d41-339b-4e70-8dd7-1a7aa93cb5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:31.081928 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:31.111957 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 980/1960] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:31.123005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315045d9-07f0-4806-9bc9-539d0263b6e6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:31.124491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-315045d9-07f0-4806-9bc9-539d0263b6e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:31.184606 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315045d9-07f0-4806-9bc9-539d0263b6e6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:31.188841 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1faf5-1a8c-4890-8051-8c8b506c5c00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:31.189496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1faf5-1a8c-4890-8051-8c8b506c5c00 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:31.189775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1faf5-1a8c-4890-8051-8c8b506c5c00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:31.190047 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd1faf5-1a8c-4890-8051-8c8b506c5c00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:31.200304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1faf5-1a8c-4890-8051-8c8b506c5c00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:31.201661 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd1faf5-1a8c-4890-8051-8c8b506c5c00 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:31.212599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 981/1961] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:31.583565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a8d41-339b-4e70-8dd7-1a7aa93cb5a7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:31.585287 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9f3a8d41-339b-4e70-8dd7-1a7aa93cb5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:31.606070 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3a8d41-339b-4e70-8dd7-1a7aa93cb5a7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:31.619970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:31.622652 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:31.622652 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:31.622652 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] PATH_INFO: `/v3/projects/2751bb2fc76d484f8cb286cf50c08da3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:31.622919 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2751bb2fc76d484f8cb286cf50c08da3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:31.624713 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:31.634782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:31.770370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2751bb2fc76d484f8cb286cf50c08da3', 'request_id': 'req-2b2ca127-624b-4e2d-b108-c7a460e93971'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:31.777640 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2751bb2fc76d484f8cb286cf50c08da3', 'request_id': 'req-2b2ca127-624b-4e2d-b108-c7a460e93971'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:31.832868 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:31.889518 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2751bb2fc76d484f8cb286cf50c08da3', 'request_id': 'req-2b2ca127-624b-4e2d-b108-c7a460e93971'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:31.900997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] The token cache is being invalidate because project 2751bb2fc76d484f8cb286cf50c08da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:31.901295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:31.901960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:31.906752 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 981/1962] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:31 2022] DELETE /identity/v3/projects/2751bb2fc76d484f8cb286cf50c08da3 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:31.907576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1faf5-1a8c-4890-8051-8c8b506c5c00 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:31.919553 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd1faf5-1a8c-4890-8051-8c8b506c5c00 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:31.981357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e876ab0-bcf4-4cde-b5e5-1ddb2b52a727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:31.981993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e876ab0-bcf4-4cde-b5e5-1ddb2b52a727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:31.982273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e876ab0-bcf4-4cde-b5e5-1ddb2b52a727 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:31.982545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e876ab0-bcf4-4cde-b5e5-1ddb2b52a727 admin admin] PATH_INFO: `/v3/users/2c1d35feec2342b3ae9b59302c7d7557` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:31.983701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e876ab0-bcf4-4cde-b5e5-1ddb2b52a727 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c1d35feec2342b3ae9b59302c7d7557)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:31.985732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e876ab0-bcf4-4cde-b5e5-1ddb2b52a727 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:32.334175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0e876ab0-bcf4-4cde-b5e5-1ddb2b52a727 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c1d35feec2342b3ae9b59302c7d7557'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:32.350519 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0e876ab0-bcf4-4cde-b5e5-1ddb2b52a727 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c1d35feec2342b3ae9b59302c7d7557'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:32.351260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0e876ab0-bcf4-4cde-b5e5-1ddb2b52a727 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c1d35feec2342b3ae9b59302c7d7557'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:32.351916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0e876ab0-bcf4-4cde-b5e5-1ddb2b52a727 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c1d35feec2342b3ae9b59302c7d7557'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:32.359055 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0e876ab0-bcf4-4cde-b5e5-1ddb2b52a727 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c1d35feec2342b3ae9b59302c7d7557'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:32.447466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 982/1963] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:31 2022] DELETE /identity/v3/users/2c1d35feec2342b3ae9b59302c7d7557 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:32.899026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:32.900491 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:32.913280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ca127-624b-4e2d-b108-c7a460e93971 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:32.977307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:32.980615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:32.981331 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:32.987009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:32.987009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27 admin admin] PATH_INFO: `/v3/projects/67464b80a4164fb9be2307e3cd3e4a10` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:32.987009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67464b80a4164fb9be2307e3cd3e4a10)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:32.987009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:33.141575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67464b80a4164fb9be2307e3cd3e4a10', 'request_id': 'req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:33.148815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67464b80a4164fb9be2307e3cd3e4a10', 'request_id': 'req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:33.228811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:33.230146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67464b80a4164fb9be2307e3cd3e4a10', 'request_id': 'req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:33.246235 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27 admin admin] The token cache is being invalidate because project 67464b80a4164fb9be2307e3cd3e4a10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:33.246541 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:33.247219 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-bbed1a1c-672f-4e4a-99ca-7d1af6db4e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:33.248817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 982/1964] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:32 2022] DELETE /identity/v3/projects/67464b80a4164fb9be2307e3cd3e4a10 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:33.253907 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365410-736c-4a07-8e08-b975b50deea2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:33.254434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365410-736c-4a07-8e08-b975b50deea2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:33.254648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19365410-736c-4a07-8e08-b975b50deea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:33.275196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-19365410-736c-4a07-8e08-b975b50deea2 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:33.276493 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-19365410-736c-4a07-8e08-b975b50deea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:33.337603 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 983/1965] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:33.346337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2c840-4962-47ea-b96e-3f41ecb79c41 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:33.346651 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2c840-4962-47ea-b96e-3f41ecb79c41 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:33.346930 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2c840-4962-47ea-b96e-3f41ecb79c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:33.377388 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-67b2c840-4962-47ea-b96e-3f41ecb79c41 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:33.378734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-67b2c840-4962-47ea-b96e-3f41ecb79c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:33.388892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 983/1966] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:33.393153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19365410-736c-4a07-8e08-b975b50deea2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:33.410575 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19365410-736c-4a07-8e08-b975b50deea2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:33.417909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e68d0-2e9c-4249-9d6b-49ebdfdb760f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:33.418579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e68d0-2e9c-4249-9d6b-49ebdfdb760f admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:33.418937 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e68d0-2e9c-4249-9d6b-49ebdfdb760f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:33.419119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e68d0-2e9c-4249-9d6b-49ebdfdb760f admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:33.419773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e68d0-2e9c-4249-9d6b-49ebdfdb760f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:33.420583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e68d0-2e9c-4249-9d6b-49ebdfdb760f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:33.424030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e68d0-2e9c-4249-9d6b-49ebdfdb760f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:33.437799 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 984/1967] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:09:33.442088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2c840-4962-47ea-b96e-3f41ecb79c41 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:33.452256 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2c840-4962-47ea-b96e-3f41ecb79c41 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:33.457435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824523b1-6a9d-44a5-9193-51fabd40f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:33.458122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824523b1-6a9d-44a5-9193-51fabd40f7dd admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:33.459002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824523b1-6a9d-44a5-9193-51fabd40f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:33.459283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824523b1-6a9d-44a5-9193-51fabd40f7dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:33.459922 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824523b1-6a9d-44a5-9193-51fabd40f7dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:33.461814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824523b1-6a9d-44a5-9193-51fabd40f7dd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:33.547349 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 984/1968] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:33 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:33.563739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e68d0-2e9c-4249-9d6b-49ebdfdb760f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:33.563739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e68d0-2e9c-4249-9d6b-49ebdfdb760f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:33.621527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bcaf4-b7d4-4fa5-addf-5db61e73a9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:33.622153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bcaf4-b7d4-4fa5-addf-5db61e73a9bd admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:33.622432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bcaf4-b7d4-4fa5-addf-5db61e73a9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:33.622700 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6bcaf4-b7d4-4fa5-addf-5db61e73a9bd admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:33.623362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bcaf4-b7d4-4fa5-addf-5db61e73a9bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:33.625300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6bcaf4-b7d4-4fa5-addf-5db61e73a9bd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:33.651336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:33.731783 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 985/1969] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:33 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:33.735855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824523b1-6a9d-44a5-9193-51fabd40f7dd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:33.746883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824523b1-6a9d-44a5-9193-51fabd40f7dd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:33.751519 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c9410-7d07-47f7-9ca9-1d415c717603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:33.752150 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c9410-7d07-47f7-9ca9-1d415c717603 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:33.754396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c9410-7d07-47f7-9ca9-1d415c717603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:33.754396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c9410-7d07-47f7-9ca9-1d415c717603 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:33.754396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c9410-7d07-47f7-9ca9-1d415c717603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:33.754996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c9410-7d07-47f7-9ca9-1d415c717603 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:33.765015 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 985/1970] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:33.768917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bcaf4-b7d4-4fa5-addf-5db61e73a9bd admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:33.779664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6bcaf4-b7d4-4fa5-addf-5db61e73a9bd admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:33.788754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f22ca43-1c98-40d9-82da-92ee8093571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:33.788754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ca43-1c98-40d9-82da-92ee8093571c admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:33.788754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ca43-1c98-40d9-82da-92ee8093571c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:33.788754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22ca43-1c98-40d9-82da-92ee8093571c admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:33.789103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22ca43-1c98-40d9-82da-92ee8093571c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:33.789103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f22ca43-1c98-40d9-82da-92ee8093571c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:33.799335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 986/1971] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:33.803625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c9410-7d07-47f7-9ca9-1d415c717603 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:33.813687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c9410-7d07-47f7-9ca9-1d415c717603 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:33.818675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4214fd7-6a59-402f-83c8-1a2e0f45021f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:33.819367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4214fd7-6a59-402f-83c8-1a2e0f45021f admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:33.819648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4214fd7-6a59-402f-83c8-1a2e0f45021f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:33.819958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4214fd7-6a59-402f-83c8-1a2e0f45021f admin admin] PATH_INFO: `/v3/projects/689c66f05c934510b7c5efd5809cd04c/users/1be27d540cdb46ffaa8558ceaa4e38f2/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:33.828240 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:33.835272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4214fd7-6a59-402f-83c8-1a2e0f45021f admin admin] RBAC: Authorizing `identity:create_grant(project_id=689c66f05c934510b7c5efd5809cd04c, user_id=1be27d540cdb46ffaa8558ceaa4e38f2, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:33.837951 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4214fd7-6a59-402f-83c8-1a2e0f45021f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:33.904193 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 986/1972] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:33 2022] PUT /identity/v3/projects/689c66f05c934510b7c5efd5809cd04c/users/1be27d540cdb46ffaa8558ceaa4e38f2/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:33.915281 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5445fd-48ff-4289-86be-8731a907635f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:33.915628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5445fd-48ff-4289-86be-8731a907635f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:33.915930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5445fd-48ff-4289-86be-8731a907635f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:33.944435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-5a5445fd-48ff-4289-86be-8731a907635f None None] MFA Rules not processed for user `1be27d540cdb46ffaa8558ceaa4e38f2`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:33.945653 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5a5445fd-48ff-4289-86be-8731a907635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:34.015463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 987/1973] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:34.037195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4214fd7-6a59-402f-83c8-1a2e0f45021f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:34.039079 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a4214fd7-6a59-402f-83c8-1a2e0f45021f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:34.105623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4214fd7-6a59-402f-83c8-1a2e0f45021f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:34.109426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a8d3e-fbf8-44b6-bf48-4bbb5b5b70e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:34.110095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a8d3e-fbf8-44b6-bf48-4bbb5b5b70e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:34.110380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a8d3e-fbf8-44b6-bf48-4bbb5b5b70e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:34.110776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a8d3e-fbf8-44b6-bf48-4bbb5b5b70e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:34.120162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a8d3e-fbf8-44b6-bf48-4bbb5b5b70e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:34.121589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a8d3e-fbf8-44b6-bf48-4bbb5b5b70e3 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:34.131190 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 987/1974] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:34 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:34.908167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:34.966303 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:36.009553 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:36.284265 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:36.982127 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:37.474591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:37.885766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:38.159754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:38.541959 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5445fd-48ff-4289-86be-8731a907635f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:38.543151 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5a5445fd-48ff-4289-86be-8731a907635f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:38.618921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5445fd-48ff-4289-86be-8731a907635f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:38.624902 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d794e-6449-4525-8e78-8f4a74bd5bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:38.625685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d794e-6449-4525-8e78-8f4a74bd5bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:38.626101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d794e-6449-4525-8e78-8f4a74bd5bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:38.626376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d794e-6449-4525-8e78-8f4a74bd5bc7 admin admin] PATH_INFO: `/v3/users/7564acfba2f7469c893742388b49ab55` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:38.627551 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d794e-6449-4525-8e78-8f4a74bd5bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7564acfba2f7469c893742388b49ab55)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:38.630427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7d794e-6449-4525-8e78-8f4a74bd5bc7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:38.907837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0a7d794e-6449-4525-8e78-8f4a74bd5bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7564acfba2f7469c893742388b49ab55'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:38.916623 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0a7d794e-6449-4525-8e78-8f4a74bd5bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7564acfba2f7469c893742388b49ab55'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:38.917687 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0a7d794e-6449-4525-8e78-8f4a74bd5bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7564acfba2f7469c893742388b49ab55'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:38.918552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0a7d794e-6449-4525-8e78-8f4a74bd5bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7564acfba2f7469c893742388b49ab55'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:38.928836 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0a7d794e-6449-4525-8e78-8f4a74bd5bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7564acfba2f7469c893742388b49ab55'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:38.993829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 988/1975] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:38 2022] DELETE /identity/v3/users/7564acfba2f7469c893742388b49ab55 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:38.995716 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39c534-bcdb-48e9-beb1-1a175aa395b2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:38.996220 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39c534-bcdb-48e9-beb1-1a175aa395b2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:38.996646 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39c534-bcdb-48e9-beb1-1a175aa395b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:39.003985 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:39.030635 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fc39c534-bcdb-48e9-beb1-1a175aa395b2 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:39.032481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fc39c534-bcdb-48e9-beb1-1a175aa395b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:39.141067 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 988/1976] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:39.151835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d794e-6449-4525-8e78-8f4a74bd5bc7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:39.159615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0a7d794e-6449-4525-8e78-8f4a74bd5bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:39.211305 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:39.266210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39c534-bcdb-48e9-beb1-1a175aa395b2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:39.269213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fc39c534-bcdb-48e9-beb1-1a175aa395b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:39.286501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d794e-6449-4525-8e78-8f4a74bd5bc7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:39.289031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39c534-bcdb-48e9-beb1-1a175aa395b2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:39.295095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c0a33-7e53-4c4a-a5f2-b425eb6ebd6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:39.296689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c0a33-7e53-4c4a-a5f2-b425eb6ebd6a service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:39.296689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c0a33-7e53-4c4a-a5f2-b425eb6ebd6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:39.296689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c0a33-7e53-4c4a-a5f2-b425eb6ebd6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:39.303567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800b5e2-635a-40b6-ab85-2c1c26d5f0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:39.304290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b5e2-635a-40b6-ab85-2c1c26d5f0ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:39.304756 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b5e2-635a-40b6-ab85-2c1c26d5f0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:39.306267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8800b5e2-635a-40b6-ab85-2c1c26d5f0ff admin admin] PATH_INFO: `/v3/users/3bc656159ecc4f81bee227bca1f3175e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:39.308862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800b5e2-635a-40b6-ab85-2c1c26d5f0ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc656159ecc4f81bee227bca1f3175e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:39.321745 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c0a33-7e53-4c4a-a5f2-b425eb6ebd6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:39.321935 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8800b5e2-635a-40b6-ab85-2c1c26d5f0ff admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:39.324983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c0a33-7e53-4c4a-a5f2-b425eb6ebd6a service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:39.360998 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 989/1977] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:39.389092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:39.549277 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8800b5e2-635a-40b6-ab85-2c1c26d5f0ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc656159ecc4f81bee227bca1f3175e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:39.549970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8800b5e2-635a-40b6-ab85-2c1c26d5f0ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc656159ecc4f81bee227bca1f3175e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:39.550561 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8800b5e2-635a-40b6-ab85-2c1c26d5f0ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc656159ecc4f81bee227bca1f3175e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:39.572389 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8800b5e2-635a-40b6-ab85-2c1c26d5f0ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc656159ecc4f81bee227bca1f3175e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:39.603921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8800b5e2-635a-40b6-ab85-2c1c26d5f0ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc656159ecc4f81bee227bca1f3175e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:39.694002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 989/1978] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:39 2022] DELETE /identity/v3/users/3bc656159ecc4f81bee227bca1f3175e => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:39.699209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf9279-ee87-451f-80d6-1bfbfc5b2314 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:39.699707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf9279-ee87-451f-80d6-1bfbfc5b2314 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:39.703641 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800b5e2-635a-40b6-ab85-2c1c26d5f0ff admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:39.705619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8800b5e2-635a-40b6-ab85-2c1c26d5f0ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:39.707507 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf9279-ee87-451f-80d6-1bfbfc5b2314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:39.729708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7dcf9279-ee87-451f-80d6-1bfbfc5b2314 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:39.730920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7dcf9279-ee87-451f-80d6-1bfbfc5b2314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:39.782443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8800b5e2-635a-40b6-ab85-2c1c26d5f0ff admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:39.788274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57bbe5-5a8d-476c-888f-441bd9da5790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:39.788918 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57bbe5-5a8d-476c-888f-441bd9da5790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:39.789195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57bbe5-5a8d-476c-888f-441bd9da5790 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:39.789464 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57bbe5-5a8d-476c-888f-441bd9da5790 admin admin] PATH_INFO: `/v3/users/cd7e2148a240426b925e49b8e1b48156` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:39.790603 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57bbe5-5a8d-476c-888f-441bd9da5790 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7e2148a240426b925e49b8e1b48156)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:39.792873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57bbe5-5a8d-476c-888f-441bd9da5790 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:39.796300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 990/1979] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:39.802042 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf9279-ee87-451f-80d6-1bfbfc5b2314 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:39.803141 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7dcf9279-ee87-451f-80d6-1bfbfc5b2314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:39.816568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf9279-ee87-451f-80d6-1bfbfc5b2314 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:39.822155 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:39.822941 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:39.823251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:39.823696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] PATH_INFO: `/v3/projects/37488546fac74284bb4d0131a1d47315` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:39.824993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37488546fac74284bb4d0131a1d47315)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:39.827094 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:39.972593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2e57bbe5-5a8d-476c-888f-441bd9da5790 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7e2148a240426b925e49b8e1b48156'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:39.972934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37488546fac74284bb4d0131a1d47315', 'request_id': 'req-a308729d-9e65-400d-a163-18f87920c431'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:39.973245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2e57bbe5-5a8d-476c-888f-441bd9da5790 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7e2148a240426b925e49b8e1b48156'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:39.974513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2e57bbe5-5a8d-476c-888f-441bd9da5790 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7e2148a240426b925e49b8e1b48156'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:39.979836 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37488546fac74284bb4d0131a1d47315', 'request_id': 'req-a308729d-9e65-400d-a163-18f87920c431'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:39.981549 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2e57bbe5-5a8d-476c-888f-441bd9da5790 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7e2148a240426b925e49b8e1b48156'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:39.985883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37488546fac74284bb4d0131a1d47315', 'request_id': 'req-a308729d-9e65-400d-a163-18f87920c431'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:39.993670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2e57bbe5-5a8d-476c-888f-441bd9da5790 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7e2148a240426b925e49b8e1b48156'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.060603 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] The token cache is being invalidate because project 37488546fac74284bb4d0131a1d47315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:40.061104 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.061842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.063342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 991/1980] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:39 2022] DELETE /identity/v3/projects/37488546fac74284bb4d0131a1d47315 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:40.064137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:40.065390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:40.120048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a308729d-9e65-400d-a163-18f87920c431 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:40.123653 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb43cd-4d63-42d7-b255-523b592d1ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:40.124291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb43cd-4d63-42d7-b255-523b592d1ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:40.130637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb43cd-4d63-42d7-b255-523b592d1ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:40.130637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eb43cd-4d63-42d7-b255-523b592d1ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:40.130637 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c5eb43cd-4d63-42d7-b255-523b592d1ae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:40.193970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 990/1981] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:39 2022] DELETE /identity/v3/users/cd7e2148a240426b925e49b8e1b48156 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:40.193970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57bbe5-5a8d-476c-888f-441bd9da5790 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:40.193970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2e57bbe5-5a8d-476c-888f-441bd9da5790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:40.197711 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb43cd-4d63-42d7-b255-523b592d1ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:40.199598 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:40.200248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5eb43cd-4d63-42d7-b255-523b592d1ae2 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:40.212167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 992/1982] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:40.270038 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb43cd-4d63-42d7-b255-523b592d1ae2 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:40.271837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c5eb43cd-4d63-42d7-b255-523b592d1ae2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:40.282902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57bbe5-5a8d-476c-888f-441bd9da5790 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:40.288822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eb43cd-4d63-42d7-b255-523b592d1ae2 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:40.289773 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1f1f5-b825-4679-abf8-357812eb90d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:40.290710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1f1f5-b825-4679-abf8-357812eb90d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:40.291172 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1f1f5-b825-4679-abf8-357812eb90d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:40.291948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1f1f5-b825-4679-abf8-357812eb90d5 admin admin] PATH_INFO: `/v3/users/f5c03c9052284aaba9653a5d17598b81` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:40.292329 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d350856-043f-4c57-a928-08916818021c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:40.293202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d350856-043f-4c57-a928-08916818021c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:40.293556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d350856-043f-4c57-a928-08916818021c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:40.293843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1f1f5-b825-4679-abf8-357812eb90d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5c03c9052284aaba9653a5d17598b81)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:40.293987 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d350856-043f-4c57-a928-08916818021c admin admin] PATH_INFO: `/v3/users/1be27d540cdb46ffaa8558ceaa4e38f2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:40.295366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d350856-043f-4c57-a928-08916818021c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1be27d540cdb46ffaa8558ceaa4e38f2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:40.296428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1f1f5-b825-4679-abf8-357812eb90d5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:40.297526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d350856-043f-4c57-a928-08916818021c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:40.513463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:40.553856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4d350856-043f-4c57-a928-08916818021c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1be27d540cdb46ffaa8558ceaa4e38f2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.572690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4d350856-043f-4c57-a928-08916818021c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1be27d540cdb46ffaa8558ceaa4e38f2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.573428 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4d350856-043f-4c57-a928-08916818021c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1be27d540cdb46ffaa8558ceaa4e38f2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.574404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4d350856-043f-4c57-a928-08916818021c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1be27d540cdb46ffaa8558ceaa4e38f2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.581331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4d350856-043f-4c57-a928-08916818021c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1be27d540cdb46ffaa8558ceaa4e38f2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.669637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7fd1f1f5-b825-4679-abf8-357812eb90d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5c03c9052284aaba9653a5d17598b81'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.670322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7fd1f1f5-b825-4679-abf8-357812eb90d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5c03c9052284aaba9653a5d17598b81'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.670930 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7fd1f1f5-b825-4679-abf8-357812eb90d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5c03c9052284aaba9653a5d17598b81'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.683076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 993/1983] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:40 2022] DELETE /identity/v3/users/1be27d540cdb46ffaa8558ceaa4e38f2 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:40.683296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7fd1f1f5-b825-4679-abf8-357812eb90d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5c03c9052284aaba9653a5d17598b81'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.683402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d350856-043f-4c57-a928-08916818021c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:40.683402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4d350856-043f-4c57-a928-08916818021c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:40.697028 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7fd1f1f5-b825-4679-abf8-357812eb90d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5c03c9052284aaba9653a5d17598b81'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.758753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d350856-043f-4c57-a928-08916818021c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:40.765681 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:40.766335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:40.766614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:40.766884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] PATH_INFO: `/v3/projects/8763f79f5df848b3937bf5bcce20b9aa` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:40.768132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8763f79f5df848b3937bf5bcce20b9aa)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:40.770036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:40.814755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 991/1984] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:40 2022] DELETE /identity/v3/users/f5c03c9052284aaba9653a5d17598b81 => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:40.816197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101b469-534c-4839-b172-23cede680933 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:40.816485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101b469-534c-4839-b172-23cede680933 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:40.816762 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1101b469-534c-4839-b172-23cede680933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:40.841582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1101b469-534c-4839-b172-23cede680933 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:40.841582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1101b469-534c-4839-b172-23cede680933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:40.899191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 992/1985] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:40.900111 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101b469-534c-4839-b172-23cede680933 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:40.901533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1101b469-534c-4839-b172-23cede680933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:40.920360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1101b469-534c-4839-b172-23cede680933 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:40.922363 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8763f79f5df848b3937bf5bcce20b9aa', 'request_id': 'req-962f376e-4c72-497f-8f31-be2c3b94f034'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.928501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8763f79f5df848b3937bf5bcce20b9aa', 'request_id': 'req-962f376e-4c72-497f-8f31-be2c3b94f034'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.936629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8763f79f5df848b3937bf5bcce20b9aa', 'request_id': 'req-962f376e-4c72-497f-8f31-be2c3b94f034'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:40.978997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:40.979546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:40.979873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:40.980168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] PATH_INFO: `/v3/projects/bea0f69a2fb9490c93ef1c0ecb2a373a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:40.981407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bea0f69a2fb9490c93ef1c0ecb2a373a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:40.983335 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:41.050844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] The token cache is being invalidate because project 8763f79f5df848b3937bf5bcce20b9aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:41.051132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.052195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.053823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 994/1986] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:40 2022] DELETE /identity/v3/projects/8763f79f5df848b3937bf5bcce20b9aa => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:41.054682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:41.056152 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:41.117004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962f376e-4c72-497f-8f31-be2c3b94f034 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:41.125799 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bea0f69a2fb9490c93ef1c0ecb2a373a', 'request_id': 'req-92276176-ca15-40de-aacf-d980797347e3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.132864 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bea0f69a2fb9490c93ef1c0ecb2a373a', 'request_id': 'req-92276176-ca15-40de-aacf-d980797347e3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.166995 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a355f8d6-7235-47b0-a9b2-73959a176c0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:41.167616 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355f8d6-7235-47b0-a9b2-73959a176c0d service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:41.167932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355f8d6-7235-47b0-a9b2-73959a176c0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:41.168206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a355f8d6-7235-47b0-a9b2-73959a176c0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:41.169967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a355f8d6-7235-47b0-a9b2-73959a176c0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:41.232317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355f8d6-7235-47b0-a9b2-73959a176c0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:41.233660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a355f8d6-7235-47b0-a9b2-73959a176c0d service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:41.243793 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 995/1987] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:41.245303 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd716d-f1be-4ca1-b220-29249848e24f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:41.245592 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd716d-f1be-4ca1-b220-29249848e24f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:41.245874 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd716d-f1be-4ca1-b220-29249848e24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:41.266714 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d5fd716d-f1be-4ca1-b220-29249848e24f None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:41.267950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d5fd716d-f1be-4ca1-b220-29249848e24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:41.276304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 996/1988] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:41.277890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bea0f69a2fb9490c93ef1c0ecb2a373a', 'request_id': 'req-92276176-ca15-40de-aacf-d980797347e3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.284895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32145396-a0cc-47a4-aee1-050c14ea6b2c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:41.285359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32145396-a0cc-47a4-aee1-050c14ea6b2c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:41.285899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32145396-a0cc-47a4-aee1-050c14ea6b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:41.289314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] The token cache is being invalidate because project bea0f69a2fb9490c93ef1c0ecb2a373a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:41.289817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.290900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.292760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 993/1989] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:40 2022] DELETE /identity/v3/projects/bea0f69a2fb9490c93ef1c0ecb2a373a => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:41.298135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:41.299730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:41.308475 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-32145396-a0cc-47a4-aee1-050c14ea6b2c None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:41.309697 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-32145396-a0cc-47a4-aee1-050c14ea6b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:41.316871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92276176-ca15-40de-aacf-d980797347e3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:41.326815 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81725e68-7285-4a6c-9304-17edaccd629a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:41.327787 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81725e68-7285-4a6c-9304-17edaccd629a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:41.328273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81725e68-7285-4a6c-9304-17edaccd629a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:41.328757 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81725e68-7285-4a6c-9304-17edaccd629a admin admin] PATH_INFO: `/v3/users/7b37e6c1bcf042a18b5ecd14488deff2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:41.329960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81725e68-7285-4a6c-9304-17edaccd629a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b37e6c1bcf042a18b5ecd14488deff2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:41.331956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81725e68-7285-4a6c-9304-17edaccd629a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:41.335488 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 997/1990] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:41.337194 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:41.339128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32145396-a0cc-47a4-aee1-050c14ea6b2c None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:41.341607 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-32145396-a0cc-47a4-aee1-050c14ea6b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:41.358718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32145396-a0cc-47a4-aee1-050c14ea6b2c None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:41.364477 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:41.365158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:41.365448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:41.365712 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] PATH_INFO: `/v3/projects/20a92712a7524fb887ced972d0ebc283` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:41.366897 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20a92712a7524fb887ced972d0ebc283)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:41.368836 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:41.517597 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:41.537263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20a92712a7524fb887ced972d0ebc283', 'request_id': 'req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.541555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-81725e68-7285-4a6c-9304-17edaccd629a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b37e6c1bcf042a18b5ecd14488deff2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.544109 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-81725e68-7285-4a6c-9304-17edaccd629a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b37e6c1bcf042a18b5ecd14488deff2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.544228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20a92712a7524fb887ced972d0ebc283', 'request_id': 'req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.544834 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-81725e68-7285-4a6c-9304-17edaccd629a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b37e6c1bcf042a18b5ecd14488deff2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.550193 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20a92712a7524fb887ced972d0ebc283', 'request_id': 'req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.556605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-81725e68-7285-4a6c-9304-17edaccd629a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b37e6c1bcf042a18b5ecd14488deff2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.574835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-81725e68-7285-4a6c-9304-17edaccd629a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b37e6c1bcf042a18b5ecd14488deff2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.627401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] The token cache is being invalidate because project 20a92712a7524fb887ced972d0ebc283 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:41.627764 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.628574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.630382 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 998/1991] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:41 2022] DELETE /identity/v3/projects/20a92712a7524fb887ced972d0ebc283 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:41.631226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:41.632652 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:41.691465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 994/1992] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:41 2022] DELETE /identity/v3/users/7b37e6c1bcf042a18b5ecd14488deff2 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:41.692981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f032c59-fe99-4561-9537-bcfbed709b15 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:41.693268 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f032c59-fe99-4561-9537-bcfbed709b15 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:41.693538 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f032c59-fe99-4561-9537-bcfbed709b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:41.706590 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d4bdc-6d0b-4dd0-bfa7-febd394cf457 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:41.716177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2f032c59-fe99-4561-9537-bcfbed709b15 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:41.719290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2f032c59-fe99-4561-9537-bcfbed709b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:41.781430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f837290b-1cfc-4d81-962b-c734b719655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:41.782074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837290b-1cfc-4d81-962b-c734b719655e admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:41.782429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837290b-1cfc-4d81-962b-c734b719655e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:41.782610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f837290b-1cfc-4d81-962b-c734b719655e admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:41.783460 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837290b-1cfc-4d81-962b-c734b719655e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:41.783766 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837290b-1cfc-4d81-962b-c734b719655e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:41.785205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 995/1993] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:41.786605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f032c59-fe99-4561-9537-bcfbed709b15 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:41.788336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2f032c59-fe99-4561-9537-bcfbed709b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:41.789531 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f837290b-1cfc-4d81-962b-c734b719655e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:41.803015 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f032c59-fe99-4561-9537-bcfbed709b15 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:41.811010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 999/1994] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:41.811172 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:41.811172 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:41.811656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a467d-2694-4016-9a3f-2d8e91a18241 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:41.811754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:41.811861 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a467d-2694-4016-9a3f-2d8e91a18241 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:41.811951 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] PATH_INFO: `/v3/projects/689c66f05c934510b7c5efd5809cd04c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:41.812047 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992a467d-2694-4016-9a3f-2d8e91a18241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:41.812134 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=689c66f05c934510b7c5efd5809cd04c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:41.814969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:41.845430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-992a467d-2694-4016-9a3f-2d8e91a18241 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:41.846656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-992a467d-2694-4016-9a3f-2d8e91a18241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:41.857091 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1000/1995] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:41.857983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a467d-2694-4016-9a3f-2d8e91a18241 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:41.869426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992a467d-2694-4016-9a3f-2d8e91a18241 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:41.874992 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6ee77-363e-4ff6-8603-b2379fe4bb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:41.875602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6ee77-363e-4ff6-8603-b2379fe4bb5a admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:41.876071 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6ee77-363e-4ff6-8603-b2379fe4bb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:41.876343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df6ee77-363e-4ff6-8603-b2379fe4bb5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:41.877025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6ee77-363e-4ff6-8603-b2379fe4bb5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:41.879015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df6ee77-363e-4ff6-8603-b2379fe4bb5a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:41.984564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689c66f05c934510b7c5efd5809cd04c', 'request_id': 'req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:41.993099 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689c66f05c934510b7c5efd5809cd04c', 'request_id': 'req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:42.001791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1001/1996] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:41 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:42.003486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6ee77-363e-4ff6-8603-b2379fe4bb5a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:42.068717 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df6ee77-363e-4ff6-8603-b2379fe4bb5a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:42.073429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c504f-c60f-4695-a785-2aabb27de049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:42.074053 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c504f-c60f-4695-a785-2aabb27de049 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.074334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c504f-c60f-4695-a785-2aabb27de049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.074609 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c504f-c60f-4695-a785-2aabb27de049 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.075262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c504f-c60f-4695-a785-2aabb27de049 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:42.075602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c504f-c60f-4695-a785-2aabb27de049 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:42.077226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c504f-c60f-4695-a785-2aabb27de049 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:42.090128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1002/1997] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:42.091963 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c504f-c60f-4695-a785-2aabb27de049 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:42.092487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689c66f05c934510b7c5efd5809cd04c', 'request_id': 'req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:42.104497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c504f-c60f-4695-a785-2aabb27de049 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:42.109330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] The token cache is being invalidate because project 689c66f05c934510b7c5efd5809cd04c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:42.109457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5153b1b-9f13-43b8-b411-957f5b683233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:42.109616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:42.109999 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153b1b-9f13-43b8-b411-957f5b683233 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.110279 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:42.110380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153b1b-9f13-43b8-b411-957f5b683233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.110553 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5153b1b-9f13-43b8-b411-957f5b683233 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.111182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5153b1b-9f13-43b8-b411-957f5b683233 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:42.112637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 996/1998] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:41 2022] DELETE /identity/v3/projects/689c66f05c934510b7c5efd5809cd04c => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:42.125195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5153b1b-9f13-43b8-b411-957f5b683233 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:42.125360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:42.125360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:42.203369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1003/1999] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:42 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:42.204709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5153b1b-9f13-43b8-b411-957f5b683233 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:42.209873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b5153b1b-9f13-43b8-b411-957f5b683233 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:42.221916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e0ed1-dd68-40c7-811c-8748dbf4b1ca admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:42.229619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5153b1b-9f13-43b8-b411-957f5b683233 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:42.229834 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfde0c-22b1-478d-8868-6623cd7e324c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:42.230321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfde0c-22b1-478d-8868-6623cd7e324c admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.230608 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfde0c-22b1-478d-8868-6623cd7e324c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.230889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfde0c-22b1-478d-8868-6623cd7e324c admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.232333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfde0c-22b1-478d-8868-6623cd7e324c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:42.234760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfde0c-22b1-478d-8868-6623cd7e324c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:42.238248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:42.239604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.240129 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.240618 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] PATH_INFO: `/v3/projects/eb0d5305535348e3929a1333d8d3a4a0` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.242876 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb0d5305535348e3929a1333d8d3a4a0)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:42.247802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:42.347781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:42.357053 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 997/2000] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:42 2022] POST /identity/v3/projects => generated 377 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:42.358011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfde0c-22b1-478d-8868-6623cd7e324c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:42.359770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-14dfde0c-22b1-478d-8868-6623cd7e324c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:42.376760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb0d5305535348e3929a1333d8d3a4a0', 'request_id': 'req-d0459ba3-6a59-4919-81b0-dc84b088d758'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:42.384423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb0d5305535348e3929a1333d8d3a4a0', 'request_id': 'req-d0459ba3-6a59-4919-81b0-dc84b088d758'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:42.391018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb0d5305535348e3929a1333d8d3a4a0', 'request_id': 'req-d0459ba3-6a59-4919-81b0-dc84b088d758'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:42.433878 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:42.437668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfde0c-22b1-478d-8868-6623cd7e324c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:42.478326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] The token cache is being invalidate because project eb0d5305535348e3929a1333d8d3a4a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:42.478961 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:42.479756 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:42.481793 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1004/2001] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:42 2022] DELETE /identity/v3/projects/eb0d5305535348e3929a1333d8d3a4a0 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:42.482767 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:42.485779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:42.495957 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764f065-64bb-4b89-9076-13715c248d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:42.496592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764f065-64bb-4b89-9076-13715c248d46 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.497642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764f065-64bb-4b89-9076-13715c248d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.497925 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764f065-64bb-4b89-9076-13715c248d46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.498649 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764f065-64bb-4b89-9076-13715c248d46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:42.500295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764f065-64bb-4b89-9076-13715c248d46 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:42.510975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 998/2002] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:42.512073 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb353c3-29aa-406d-a27e-493a9de6f4d6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.512949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb353c3-29aa-406d-a27e-493a9de6f4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.513236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb353c3-29aa-406d-a27e-493a9de6f4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.534030 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fcb353c3-29aa-406d-a27e-493a9de6f4d6 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:42.535303 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fcb353c3-29aa-406d-a27e-493a9de6f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:42.543759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 999/2003] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:42.544504 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb353c3-29aa-406d-a27e-493a9de6f4d6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:42.548961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fcb353c3-29aa-406d-a27e-493a9de6f4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:42.557125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0459ba3-6a59-4919-81b0-dc84b088d758 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:42.562082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb353c3-29aa-406d-a27e-493a9de6f4d6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:42.562776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822027b-335c-48c5-9359-108dc0631036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:42.563396 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822027b-335c-48c5-9359-108dc0631036 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.563680 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822027b-335c-48c5-9359-108dc0631036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.563990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822027b-335c-48c5-9359-108dc0631036 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.564621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822027b-335c-48c5-9359-108dc0631036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:42.566576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822027b-335c-48c5-9359-108dc0631036 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:42.566701 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73c7430-837d-4c0e-b06c-467fc4615066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:42.567747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c7430-837d-4c0e-b06c-467fc4615066 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.568054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c7430-837d-4c0e-b06c-467fc4615066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.568345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73c7430-837d-4c0e-b06c-467fc4615066 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.568960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c7430-837d-4c0e-b06c-467fc4615066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:42.570522 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73c7430-837d-4c0e-b06c-467fc4615066 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:42.580389 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1000/2004] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:42.581711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23ac94-92ee-477e-888d-332c9a9bcf8b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.581995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23ac94-92ee-477e-888d-332c9a9bcf8b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.582267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23ac94-92ee-477e-888d-332c9a9bcf8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.601502 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6b23ac94-92ee-477e-888d-332c9a9bcf8b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:42.602712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6b23ac94-92ee-477e-888d-332c9a9bcf8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:42.613797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1001/2005] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:42.613797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23ac94-92ee-477e-888d-332c9a9bcf8b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:42.621147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23ac94-92ee-477e-888d-332c9a9bcf8b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:42.625677 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abf80c-87cb-42bb-be9e-9df52298b2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:42.626301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abf80c-87cb-42bb-be9e-9df52298b2ad admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.626587 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abf80c-87cb-42bb-be9e-9df52298b2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.626863 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abf80c-87cb-42bb-be9e-9df52298b2ad admin admin] PATH_INFO: `/v3/projects/f570100239714ed6be46f0ef5fd39e52/users/b0f38e5a95e34a2d847136a4b6b32c66/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.641205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abf80c-87cb-42bb-be9e-9df52298b2ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=f570100239714ed6be46f0ef5fd39e52, user_id=b0f38e5a95e34a2d847136a4b6b32c66, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:42.643864 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abf80c-87cb-42bb-be9e-9df52298b2ad admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:42.655724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1005/2006] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:42 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:42.656672 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822027b-335c-48c5-9359-108dc0631036 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:42.666046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822027b-335c-48c5-9359-108dc0631036 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:42.670568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5b28a-345c-42ab-ad50-0953d78ca575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:42.671138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5b28a-345c-42ab-ad50-0953d78ca575 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.671416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5b28a-345c-42ab-ad50-0953d78ca575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.671687 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c5b28a-345c-42ab-ad50-0953d78ca575 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.672352 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5b28a-345c-42ab-ad50-0953d78ca575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:42.672655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5b28a-345c-42ab-ad50-0953d78ca575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:42.674210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c5b28a-345c-42ab-ad50-0953d78ca575 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:42.685692 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1006/2007] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:42.686725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5b28a-345c-42ab-ad50-0953d78ca575 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:42.696624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c5b28a-345c-42ab-ad50-0953d78ca575 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:42.701217 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4140b9-1cec-4a22-912a-611489ac73da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:42.701774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4140b9-1cec-4a22-912a-611489ac73da admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.702046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4140b9-1cec-4a22-912a-611489ac73da admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.702311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4140b9-1cec-4a22-912a-611489ac73da admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.702914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4140b9-1cec-4a22-912a-611489ac73da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:42.704458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4140b9-1cec-4a22-912a-611489ac73da admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:42.714562 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1007/2008] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:42.715359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4140b9-1cec-4a22-912a-611489ac73da admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:42.724626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4140b9-1cec-4a22-912a-611489ac73da admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:42.729608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418025a0-8db0-4e6d-94a4-44606175725c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:42.730665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418025a0-8db0-4e6d-94a4-44606175725c admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.730665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418025a0-8db0-4e6d-94a4-44606175725c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.730665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418025a0-8db0-4e6d-94a4-44606175725c admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.731276 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418025a0-8db0-4e6d-94a4-44606175725c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:42.734594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418025a0-8db0-4e6d-94a4-44606175725c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:42.736984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1002/2009] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:42 2022] PUT /identity/v3/projects/f570100239714ed6be46f0ef5fd39e52/users/b0f38e5a95e34a2d847136a4b6b32c66/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:42.738062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abf80c-87cb-42bb-be9e-9df52298b2ad admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:42.811713 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abf80c-87cb-42bb-be9e-9df52298b2ad admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:42.816653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd4a56-1072-4358-bf13-34ac89a4efc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:42.818033 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd4a56-1072-4358-bf13-34ac89a4efc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.818363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd4a56-1072-4358-bf13-34ac89a4efc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.818643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bd4a56-1072-4358-bf13-34ac89a4efc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.819290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd4a56-1072-4358-bf13-34ac89a4efc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:42.820965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bd4a56-1072-4358-bf13-34ac89a4efc6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:42.823450 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1008/2010] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:42 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:42.824545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a5b2a-4cd4-41dd-9e38-80bb760fcd30 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.825905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a5b2a-4cd4-41dd-9e38-80bb760fcd30 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.826194 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a5b2a-4cd4-41dd-9e38-80bb760fcd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.831617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1003/2011] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:42 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:42.832538 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd4a56-1072-4358-bf13-34ac89a4efc6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:42.844448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bd4a56-1072-4358-bf13-34ac89a4efc6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:42.853433 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-786a5b2a-4cd4-41dd-9e38-80bb760fcd30 None None] MFA Rules not processed for user `b0f38e5a95e34a2d847136a4b6b32c66`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:42.854686 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-786a5b2a-4cd4-41dd-9e38-80bb760fcd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:42.903982 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf41fa-2b56-47ca-b4f0-bd05607d0761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:42.904593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf41fa-2b56-47ca-b4f0-bd05607d0761 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.904873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf41fa-2b56-47ca-b4f0-bd05607d0761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.905146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf41fa-2b56-47ca-b4f0-bd05607d0761 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.905765 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf41fa-2b56-47ca-b4f0-bd05607d0761 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:42.907784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf41fa-2b56-47ca-b4f0-bd05607d0761 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:42.921893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1009/2012] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:42.922929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a5b2a-4cd4-41dd-9e38-80bb760fcd30 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:42.935102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a5b2a-4cd4-41dd-9e38-80bb760fcd30 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:42.940217 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81a2d6-9431-4efb-be6a-cdf73f1e9f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:42.941012 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81a2d6-9431-4efb-be6a-cdf73f1e9f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:42.941292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81a2d6-9431-4efb-be6a-cdf73f1e9f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:42.941565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81a2d6-9431-4efb-be6a-cdf73f1e9f32 admin admin] PATH_INFO: `/v3/projects/5f573711e73f4c1a9688932c8971e3e9/users/ee09e0c282bb418b9578d6235ed5fae2/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:42.959805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81a2d6-9431-4efb-be6a-cdf73f1e9f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f573711e73f4c1a9688932c8971e3e9, user_id=ee09e0c282bb418b9578d6235ed5fae2, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:42.962734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81a2d6-9431-4efb-be6a-cdf73f1e9f32 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:42.988512 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1004/2013] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:42 2022] POST /identity/v3/users => generated 282 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:42.989668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf41fa-2b56-47ca-b4f0-bd05607d0761 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:43.000067 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf41fa-2b56-47ca-b4f0-bd05607d0761 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:43.004990 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a4227-867c-4363-ae5e-ceb06ee909fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:43.005648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a4227-867c-4363-ae5e-ceb06ee909fb admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:43.005926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a4227-867c-4363-ae5e-ceb06ee909fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:43.006196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a4227-867c-4363-ae5e-ceb06ee909fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:43.007225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a4227-867c-4363-ae5e-ceb06ee909fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:43.008843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356a4227-867c-4363-ae5e-ceb06ee909fb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:43.062399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1010/2014] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:42 2022] PUT /identity/v3/projects/5f573711e73f4c1a9688932c8971e3e9/users/ee09e0c282bb418b9578d6235ed5fae2/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:43.073844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81a2d6-9431-4efb-be6a-cdf73f1e9f32 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:43.142127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81a2d6-9431-4efb-be6a-cdf73f1e9f32 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:43.149792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b969ce-4880-4f94-b346-1dcbe6b37904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:43.150529 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b969ce-4880-4f94-b346-1dcbe6b37904 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:43.150801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b969ce-4880-4f94-b346-1dcbe6b37904 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:43.151069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b969ce-4880-4f94-b346-1dcbe6b37904 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:43.151719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b969ce-4880-4f94-b346-1dcbe6b37904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:43.153425 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b969ce-4880-4f94-b346-1dcbe6b37904 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:43.163295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1005/2015] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:42 2022] POST /identity/v3/projects => generated 373 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:43.164660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1011/2016] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:43.165521 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b969ce-4880-4f94-b346-1dcbe6b37904 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:43.165763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a56c-9e4b-493f-82ba-9cc0d790a6c5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:43.166243 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a56c-9e4b-493f-82ba-9cc0d790a6c5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:43.166711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1a56c-9e4b-493f-82ba-9cc0d790a6c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:43.176110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b969ce-4880-4f94-b346-1dcbe6b37904 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:43.214948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-32e1a56c-9e4b-493f-82ba-9cc0d790a6c5 None None] MFA Rules not processed for user `ee09e0c282bb418b9578d6235ed5fae2`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:43.216291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-32e1a56c-9e4b-493f-82ba-9cc0d790a6c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:43.248936 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bd212-e505-45e5-9f0b-0d75c9505099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:43.249590 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bd212-e505-45e5-9f0b-0d75c9505099 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:43.249845 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bd212-e505-45e5-9f0b-0d75c9505099 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:43.250114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392bd212-e505-45e5-9f0b-0d75c9505099 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:43.251682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bd212-e505-45e5-9f0b-0d75c9505099 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:43.253673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392bd212-e505-45e5-9f0b-0d75c9505099 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:43.331474 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1006/2017] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:43.331474 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1a56c-9e4b-493f-82ba-9cc0d790a6c5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:43.345617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1a56c-9e4b-493f-82ba-9cc0d790a6c5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:43.349219 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455af70-236a-4554-a346-425903ac6191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:43.349945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455af70-236a-4554-a346-425903ac6191 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:43.350786 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455af70-236a-4554-a346-425903ac6191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:43.351073 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455af70-236a-4554-a346-425903ac6191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:43.352407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455af70-236a-4554-a346-425903ac6191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:43.353993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455af70-236a-4554-a346-425903ac6191 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:43.365461 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1007/2018] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:43.366275 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455af70-236a-4554-a346-425903ac6191 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:43.383137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455af70-236a-4554-a346-425903ac6191 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:43.394941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff999e-a9cb-48ab-a029-e8e2bd2d6837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:43.397531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff999e-a9cb-48ab-a029-e8e2bd2d6837 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:43.397531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff999e-a9cb-48ab-a029-e8e2bd2d6837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:43.397531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff999e-a9cb-48ab-a029-e8e2bd2d6837 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:43.397750 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff999e-a9cb-48ab-a029-e8e2bd2d6837 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:43.399781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff999e-a9cb-48ab-a029-e8e2bd2d6837 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:43.422857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1012/2019] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:43 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:43.423785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bd212-e505-45e5-9f0b-0d75c9505099 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:43.433897 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392bd212-e505-45e5-9f0b-0d75c9505099 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:43.442615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b08f3-ed8f-4fac-906b-3cfbde8790f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:43.443543 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b08f3-ed8f-4fac-906b-3cfbde8790f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:43.444372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b08f3-ed8f-4fac-906b-3cfbde8790f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:43.444372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1b08f3-ed8f-4fac-906b-3cfbde8790f9 admin admin] PATH_INFO: `/v3/projects/3fec860522a3492db2f626f242337650/users/275d3eb14af1468da4e167a1d7afa3dc/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:43.462529 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b08f3-ed8f-4fac-906b-3cfbde8790f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fec860522a3492db2f626f242337650, user_id=275d3eb14af1468da4e167a1d7afa3dc, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:43.467566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1b08f3-ed8f-4fac-906b-3cfbde8790f9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:43.519741 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1008/2020] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:43 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:43.520885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff999e-a9cb-48ab-a029-e8e2bd2d6837 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:43.542720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:43.548251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1013/2021] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:43 2022] PUT /identity/v3/projects/3fec860522a3492db2f626f242337650/users/275d3eb14af1468da4e167a1d7afa3dc/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:43.549201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b08f3-ed8f-4fac-906b-3cfbde8790f9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:43.586474 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff999e-a9cb-48ab-a029-e8e2bd2d6837 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:43.614507 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1b08f3-ed8f-4fac-906b-3cfbde8790f9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:43.620605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f88954-00d1-4a9f-82d5-03a012a95207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:43.621366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f88954-00d1-4a9f-82d5-03a012a95207 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:43.621740 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f88954-00d1-4a9f-82d5-03a012a95207 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:43.622114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f88954-00d1-4a9f-82d5-03a012a95207 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:43.623037 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f88954-00d1-4a9f-82d5-03a012a95207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:43.625093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f88954-00d1-4a9f-82d5-03a012a95207 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:43.628986 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:43.649290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d21719-0656-4722-8d4f-ab9596ea85bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:43.649974 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d21719-0656-4722-8d4f-ab9596ea85bb admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:43.650255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d21719-0656-4722-8d4f-ab9596ea85bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:43.650528 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d21719-0656-4722-8d4f-ab9596ea85bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:43.651190 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d21719-0656-4722-8d4f-ab9596ea85bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:43.652804 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d21719-0656-4722-8d4f-ab9596ea85bb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:43.663574 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1009/2022] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:43.665018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baf9fe-7811-4806-a3ec-a2933dfd0b97 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:43.665288 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baf9fe-7811-4806-a3ec-a2933dfd0b97 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:43.665564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baf9fe-7811-4806-a3ec-a2933dfd0b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:43.695783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-66baf9fe-7811-4806-a3ec-a2933dfd0b97 None None] MFA Rules not processed for user `275d3eb14af1468da4e167a1d7afa3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:43.697065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-66baf9fe-7811-4806-a3ec-a2933dfd0b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:43.736254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1014/2023] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:43 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:43.737101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f88954-00d1-4a9f-82d5-03a012a95207 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:43.751569 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f88954-00d1-4a9f-82d5-03a012a95207 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:43.757168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fe7f-434b-434d-88ee-4e9acf0ceb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:43.758000 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fe7f-434b-434d-88ee-4e9acf0ceb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:43.758286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fe7f-434b-434d-88ee-4e9acf0ceb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:43.758569 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fe7f-434b-434d-88ee-4e9acf0ceb26 admin admin] PATH_INFO: `/v3/projects/6591fb7c3a534c3e93dc179c7d5c7b0c/users/2b1a1bca2a9e49a58c9649fa1111da06/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:43.771592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1010/2024] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:43.772536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66baf9fe-7811-4806-a3ec-a2933dfd0b97 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:43.776444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137fe7f-434b-434d-88ee-4e9acf0ceb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6591fb7c3a534c3e93dc179c7d5c7b0c, user_id=2b1a1bca2a9e49a58c9649fa1111da06, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:43.779139 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137fe7f-434b-434d-88ee-4e9acf0ceb26 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:43.783112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66baf9fe-7811-4806-a3ec-a2933dfd0b97 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:43.787862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43be77e-dc62-426c-841a-4105e0b4d01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:43.788470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43be77e-dc62-426c-841a-4105e0b4d01f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:43.788751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43be77e-dc62-426c-841a-4105e0b4d01f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:43.792636 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43be77e-dc62-426c-841a-4105e0b4d01f admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:43.792636 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43be77e-dc62-426c-841a-4105e0b4d01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:43.792636 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43be77e-dc62-426c-841a-4105e0b4d01f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:43.800888 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1011/2025] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:43.802146 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43be77e-dc62-426c-841a-4105e0b4d01f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:43.811525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43be77e-dc62-426c-841a-4105e0b4d01f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:43.816133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f189b-9d2a-4059-961d-548400d4d0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:43.816682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f189b-9d2a-4059-961d-548400d4d0a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:43.817051 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f189b-9d2a-4059-961d-548400d4d0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:43.817911 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5f189b-9d2a-4059-961d-548400d4d0a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:43.818548 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f189b-9d2a-4059-961d-548400d4d0a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:43.820459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5f189b-9d2a-4059-961d-548400d4d0a3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:43.868624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1015/2026] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:43 2022] PUT /identity/v3/projects/6591fb7c3a534c3e93dc179c7d5c7b0c/users/2b1a1bca2a9e49a58c9649fa1111da06/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:43.870552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fe7f-434b-434d-88ee-4e9acf0ceb26 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:43.893902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1012/2027] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:43 2022] POST /identity/v3/projects => generated 363 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:43.897080 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f189b-9d2a-4059-961d-548400d4d0a3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:43.950572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fe7f-434b-434d-88ee-4e9acf0ceb26 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:43.969686 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5f189b-9d2a-4059-961d-548400d4d0a3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:43.977087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170819eb-acda-427a-ad89-1a90685e3f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:43.977702 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170819eb-acda-427a-ad89-1a90685e3f24 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:43.978019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170819eb-acda-427a-ad89-1a90685e3f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:43.978740 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170819eb-acda-427a-ad89-1a90685e3f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:43.978935 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170819eb-acda-427a-ad89-1a90685e3f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:43.980714 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170819eb-acda-427a-ad89-1a90685e3f24 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:43.995100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1013/2028] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:43.995100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170819eb-acda-427a-ad89-1a90685e3f24 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:44.006554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170819eb-acda-427a-ad89-1a90685e3f24 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:44.011467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6af9a6f-c4b2-480c-a738-d77fab0c6aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.012185 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9a6f-c4b2-480c-a738-d77fab0c6aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.012469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9a6f-c4b2-480c-a738-d77fab0c6aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.012742 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6af9a6f-c4b2-480c-a738-d77fab0c6aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.013355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af9a6f-c4b2-480c-a738-d77fab0c6aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.015263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6af9a6f-c4b2-480c-a738-d77fab0c6aa8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.023956 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:44.027581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8343636-300b-4de3-8545-3dae9bbf058f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.028243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8343636-300b-4de3-8545-3dae9bbf058f admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.032689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8343636-300b-4de3-8545-3dae9bbf058f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.032689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8343636-300b-4de3-8545-3dae9bbf058f admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.032689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8343636-300b-4de3-8545-3dae9bbf058f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.032689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8343636-300b-4de3-8545-3dae9bbf058f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.041891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1016/2029] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:43 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:44.042718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8343636-300b-4de3-8545-3dae9bbf058f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:44.050297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:44.055480 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8343636-300b-4de3-8545-3dae9bbf058f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:44.057306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11ca86-c789-4d56-a528-c83d773ffa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.057935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ca86-c789-4d56-a528-c83d773ffa3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.058213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ca86-c789-4d56-a528-c83d773ffa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.058483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11ca86-c789-4d56-a528-c83d773ffa3f admin admin] PATH_INFO: `/v3/projects/6591fb7c3a534c3e93dc179c7d5c7b0c/users/2b1a1bca2a9e49a58c9649fa1111da06/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.060531 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11ca86-c789-4d56-a528-c83d773ffa3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6591fb7c3a534c3e93dc179c7d5c7b0c, user_id=2b1a1bca2a9e49a58c9649fa1111da06, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.063417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11ca86-c789-4d56-a528-c83d773ffa3f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.074392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1017/2030] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:44 2022] PUT /identity/v3/projects/6591fb7c3a534c3e93dc179c7d5c7b0c/users/2b1a1bca2a9e49a58c9649fa1111da06/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:44.075147 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11ca86-c789-4d56-a528-c83d773ffa3f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:44.136720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1014/2031] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:43 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:44.139792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11ca86-c789-4d56-a528-c83d773ffa3f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:44.141154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98563-7a6e-4d11-b626-6f590f82ae51 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.141516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98563-7a6e-4d11-b626-6f590f82ae51 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.141903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af98563-7a6e-4d11-b626-6f590f82ae51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.146256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3167d8-50b0-40cc-af92-a6709504a958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.147388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3167d8-50b0-40cc-af92-a6709504a958 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.147914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3167d8-50b0-40cc-af92-a6709504a958 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.148416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3167d8-50b0-40cc-af92-a6709504a958 admin admin] PATH_INFO: `/v3/projects/02f7e38914054c4099be8cb329ae7c2a/users/27dca3920e344c28bfad127722fb4f1d/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.162732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3167d8-50b0-40cc-af92-a6709504a958 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f7e38914054c4099be8cb329ae7c2a, user_id=27dca3920e344c28bfad127722fb4f1d, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.165412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3167d8-50b0-40cc-af92-a6709504a958 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.171129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9af98563-7a6e-4d11-b626-6f590f82ae51 None None] MFA Rules not processed for user `2b1a1bca2a9e49a58c9649fa1111da06`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:44.172419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9af98563-7a6e-4d11-b626-6f590f82ae51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:44.246293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1015/2032] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:44.247344 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af98563-7a6e-4d11-b626-6f590f82ae51 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:44.269933 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1018/2033] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:44 2022] PUT /identity/v3/projects/02f7e38914054c4099be8cb329ae7c2a/users/27dca3920e344c28bfad127722fb4f1d/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:44.270231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af98563-7a6e-4d11-b626-6f590f82ae51 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:44.271926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3167d8-50b0-40cc-af92-a6709504a958 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:44.274449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7b3167d8-50b0-40cc-af92-a6709504a958 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:44.327929 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7d373f-ea19-42a1-aeb2-85dc42d3ed6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.328559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d373f-ea19-42a1-aeb2-85dc42d3ed6e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.328844 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d373f-ea19-42a1-aeb2-85dc42d3ed6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.329495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7d373f-ea19-42a1-aeb2-85dc42d3ed6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.329798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d373f-ea19-42a1-aeb2-85dc42d3ed6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.331424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7d373f-ea19-42a1-aeb2-85dc42d3ed6e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.339593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3167d8-50b0-40cc-af92-a6709504a958 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:44.343221 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1016/2034] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:44.344715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:44.348839 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7313-5a45-40ec-8368-734dcec750f8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.348839 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7313-5a45-40ec-8368-734dcec750f8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.348839 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7313-5a45-40ec-8368-734dcec750f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.349339 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d05b3-0a65-4177-b7ff-360503a47296 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.349339 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d05b3-0a65-4177-b7ff-360503a47296 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.349339 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d05b3-0a65-4177-b7ff-360503a47296 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.349339 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6d05b3-0a65-4177-b7ff-360503a47296 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.381310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:44.404721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-68bb7313-5a45-40ec-8368-734dcec750f8 None None] MFA Rules not processed for user `27dca3920e344c28bfad127722fb4f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:44.407049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-68bb7313-5a45-40ec-8368-734dcec750f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:44.449432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d05b3-0a65-4177-b7ff-360503a47296 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.450877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6d05b3-0a65-4177-b7ff-360503a47296 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.461974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1019/2035] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:44.462861 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d05b3-0a65-4177-b7ff-360503a47296 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:44.467343 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:44.474892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6d05b3-0a65-4177-b7ff-360503a47296 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:44.480313 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1694bc-1215-4878-b419-7f42dccb97c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.481020 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1694bc-1215-4878-b419-7f42dccb97c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.481312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1694bc-1215-4878-b419-7f42dccb97c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.481580 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1694bc-1215-4878-b419-7f42dccb97c8 admin admin] PATH_INFO: `/v3/projects/0f825653b6c84ab3b108886af6dac2a0/users/521048746664444382e9669fa88cbb72/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.484380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1017/2036] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:44.489850 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb7313-5a45-40ec-8368-734dcec750f8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:44.498693 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1694bc-1215-4878-b419-7f42dccb97c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f825653b6c84ab3b108886af6dac2a0, user_id=521048746664444382e9669fa88cbb72, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.500240 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb7313-5a45-40ec-8368-734dcec750f8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:44.501369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1694bc-1215-4878-b419-7f42dccb97c8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.505525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd15b4-0817-4e82-970b-07be3055941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.506130 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd15b4-0817-4e82-970b-07be3055941f admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.506404 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd15b4-0817-4e82-970b-07be3055941f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.506670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd15b4-0817-4e82-970b-07be3055941f admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.507314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd15b4-0817-4e82-970b-07be3055941f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.509214 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afd15b4-0817-4e82-970b-07be3055941f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.569883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1020/2037] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:44 2022] PUT /identity/v3/projects/0f825653b6c84ab3b108886af6dac2a0/users/521048746664444382e9669fa88cbb72/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:44.573829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1694bc-1215-4878-b419-7f42dccb97c8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:44.623666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1018/2038] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:44 2022] POST /identity/v3/projects => generated 379 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:44.628317 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd15b4-0817-4e82-970b-07be3055941f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:44.637548 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1694bc-1215-4878-b419-7f42dccb97c8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:44.695313 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd15b4-0817-4e82-970b-07be3055941f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:44.699369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d6ada-e0e8-4519-8e66-46dca4bcfacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.700080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d6ada-e0e8-4519-8e66-46dca4bcfacf admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.700358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d6ada-e0e8-4519-8e66-46dca4bcfacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.700532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829942c-d058-4a20-a261-f0fabba31034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.700658 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d6ada-e0e8-4519-8e66-46dca4bcfacf admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.701234 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829942c-d058-4a20-a261-f0fabba31034 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.701345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d6ada-e0e8-4519-8e66-46dca4bcfacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.701421 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829942c-d058-4a20-a261-f0fabba31034 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.701671 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9829942c-d058-4a20-a261-f0fabba31034 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.702298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829942c-d058-4a20-a261-f0fabba31034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.702814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d6ada-e0e8-4519-8e66-46dca4bcfacf admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.704471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9829942c-d058-4a20-a261-f0fabba31034 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.713599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1021/2039] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:44.717897 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d6ada-e0e8-4519-8e66-46dca4bcfacf admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:44.729881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d6ada-e0e8-4519-8e66-46dca4bcfacf admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:44.734817 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10282f-b6d2-4fd3-8bb5-13ed73c1000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.735484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10282f-b6d2-4fd3-8bb5-13ed73c1000e admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.735765 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10282f-b6d2-4fd3-8bb5-13ed73c1000e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.736075 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10282f-b6d2-4fd3-8bb5-13ed73c1000e admin admin] PATH_INFO: `/v3/projects/0f825653b6c84ab3b108886af6dac2a0/users/521048746664444382e9669fa88cbb72/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.740265 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10282f-b6d2-4fd3-8bb5-13ed73c1000e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f825653b6c84ab3b108886af6dac2a0, user_id=521048746664444382e9669fa88cbb72, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.741508 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10282f-b6d2-4fd3-8bb5-13ed73c1000e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.751810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1022/2040] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:44 2022] PUT /identity/v3/projects/0f825653b6c84ab3b108886af6dac2a0/users/521048746664444382e9669fa88cbb72/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:44.758950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:44.763026 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36bb31-2ccb-45ec-a8b6-ad4a94d5f6fd None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.763309 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36bb31-2ccb-45ec-a8b6-ad4a94d5f6fd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.763615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c36bb31-2ccb-45ec-a8b6-ad4a94d5f6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.791266 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4c36bb31-2ccb-45ec-a8b6-ad4a94d5f6fd None None] MFA Rules not processed for user `521048746664444382e9669fa88cbb72`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:44.792530 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4c36bb31-2ccb-45ec-a8b6-ad4a94d5f6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:44.799584 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1019/2041] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:44 2022] POST /identity/v3/users => generated 296 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:44.804120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829942c-d058-4a20-a261-f0fabba31034 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:44.814982 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9829942c-d058-4a20-a261-f0fabba31034 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:44.817122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:44.877735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1023/2042] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:44.889228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36bb31-2ccb-45ec-a8b6-ad4a94d5f6fd None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:44.890367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05587370-eb18-4ce1-a606-092ac47efef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.890981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587370-eb18-4ce1-a606-092ac47efef4 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.891257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587370-eb18-4ce1-a606-092ac47efef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.891530 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587370-eb18-4ce1-a606-092ac47efef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.892198 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05587370-eb18-4ce1-a606-092ac47efef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.893771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05587370-eb18-4ce1-a606-092ac47efef4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.906792 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1020/2043] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:44.907883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05587370-eb18-4ce1-a606-092ac47efef4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:44.918617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05587370-eb18-4ce1-a606-092ac47efef4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:44.923436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b65499-761d-4eab-8526-f6fb53a17614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.924208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65499-761d-4eab-8526-f6fb53a17614 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.924481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65499-761d-4eab-8526-f6fb53a17614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.924759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b65499-761d-4eab-8526-f6fb53a17614 admin admin] PATH_INFO: `/v3/projects/30fcd36d4ea64d4f9bd1ebfd4ef8cf9b/users/acb671dd8e3143a88bb38c089678d9a2/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.940442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b65499-761d-4eab-8526-f6fb53a17614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30fcd36d4ea64d4f9bd1ebfd4ef8cf9b, user_id=acb671dd8e3143a88bb38c089678d9a2, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.943873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b65499-761d-4eab-8526-f6fb53a17614 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.949897 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c36bb31-2ccb-45ec-a8b6-ad4a94d5f6fd None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:44.953851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634e66c-54c7-4e55-8e08-55ce9624bca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:44.954464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634e66c-54c7-4e55-8e08-55ce9624bca5 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:44.954745 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634e66c-54c7-4e55-8e08-55ce9624bca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:44.955018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634e66c-54c7-4e55-8e08-55ce9624bca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:44.965275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634e66c-54c7-4e55-8e08-55ce9624bca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:44.966690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6634e66c-54c7-4e55-8e08-55ce9624bca5 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:44.978072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1024/2044] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:44 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:45.068003 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1021/2045] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:44 2022] PUT /identity/v3/projects/30fcd36d4ea64d4f9bd1ebfd4ef8cf9b/users/acb671dd8e3143a88bb38c089678d9a2/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:45.069792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634e66c-54c7-4e55-8e08-55ce9624bca5 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:45.080896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634e66c-54c7-4e55-8e08-55ce9624bca5 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:45.137539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05ca74-4b57-466a-a164-25497ed18aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:45.138139 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05ca74-4b57-466a-a164-25497ed18aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:45.138416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05ca74-4b57-466a-a164-25497ed18aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:45.138679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b05ca74-4b57-466a-a164-25497ed18aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:45.139316 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05ca74-4b57-466a-a164-25497ed18aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:45.140904 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b05ca74-4b57-466a-a164-25497ed18aa5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:45.155420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1025/2046] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:45.158248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b65499-761d-4eab-8526-f6fb53a17614 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:45.169667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b65499-761d-4eab-8526-f6fb53a17614 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:45.174416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcc6d54-8bef-4bfd-ba28-45b7e033f09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:45.175162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc6d54-8bef-4bfd-ba28-45b7e033f09d admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:45.175363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc6d54-8bef-4bfd-ba28-45b7e033f09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:45.175620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcc6d54-8bef-4bfd-ba28-45b7e033f09d admin admin] PATH_INFO: `/v3/projects/30fcd36d4ea64d4f9bd1ebfd4ef8cf9b/users/acb671dd8e3143a88bb38c089678d9a2/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:45.179957 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc6d54-8bef-4bfd-ba28-45b7e033f09d admin admin] RBAC: Authorizing `identity:create_grant(project_id=30fcd36d4ea64d4f9bd1ebfd4ef8cf9b, user_id=acb671dd8e3143a88bb38c089678d9a2, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:45.180759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcc6d54-8bef-4bfd-ba28-45b7e033f09d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:45.191324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05ca74-4b57-466a-a164-25497ed18aa5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:45.194229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1022/2047] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:45 2022] PUT /identity/v3/projects/30fcd36d4ea64d4f9bd1ebfd4ef8cf9b/users/acb671dd8e3143a88bb38c089678d9a2/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:45.210947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920606d9-04e8-474d-9ecc-0ef1b2a1be77 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:45.210947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920606d9-04e8-474d-9ecc-0ef1b2a1be77 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:45.210947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920606d9-04e8-474d-9ecc-0ef1b2a1be77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:45.240775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-920606d9-04e8-474d-9ecc-0ef1b2a1be77 None None] MFA Rules not processed for user `acb671dd8e3143a88bb38c089678d9a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:45.242102 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-920606d9-04e8-474d-9ecc-0ef1b2a1be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:45.259246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b05ca74-4b57-466a-a164-25497ed18aa5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:45.311576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19755f-c467-4a0b-ba5a-eb95d16c000b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:45.312200 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19755f-c467-4a0b-ba5a-eb95d16c000b service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:45.312483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19755f-c467-4a0b-ba5a-eb95d16c000b service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:45.312756 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e19755f-c467-4a0b-ba5a-eb95d16c000b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:45.313407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:45.321024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1023/2048] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:45 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:45.365626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:45.376654 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19755f-c467-4a0b-ba5a-eb95d16c000b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:45.378246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e19755f-c467-4a0b-ba5a-eb95d16c000b service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:45.389741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1026/2049] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:45.410335 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920606d9-04e8-474d-9ecc-0ef1b2a1be77 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:45.411949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-920606d9-04e8-474d-9ecc-0ef1b2a1be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:45.433035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920606d9-04e8-474d-9ecc-0ef1b2a1be77 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:45.437358 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4d999-bde3-4bb8-901d-b0a5ec1b91df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:45.438157 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4d999-bde3-4bb8-901d-b0a5ec1b91df service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:45.438587 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4d999-bde3-4bb8-901d-b0a5ec1b91df service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:45.439149 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4d999-bde3-4bb8-901d-b0a5ec1b91df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:45.449949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4d999-bde3-4bb8-901d-b0a5ec1b91df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:45.451382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4d999-bde3-4bb8-901d-b0a5ec1b91df service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:45.462216 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1024/2050] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:45 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:45.666035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19755f-c467-4a0b-ba5a-eb95d16c000b service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:45.674942 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e19755f-c467-4a0b-ba5a-eb95d16c000b service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:45.679495 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf7650-64b8-48d4-b580-36a8b1e8add6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:45.680541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7650-64b8-48d4-b580-36a8b1e8add6 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:45.680541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7650-64b8-48d4-b580-36a8b1e8add6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:45.680797 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf7650-64b8-48d4-b580-36a8b1e8add6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:45.740596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf7650-64b8-48d4-b580-36a8b1e8add6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:45.741965 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf7650-64b8-48d4-b580-36a8b1e8add6 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:45.751317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1027/2051] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:45 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:45.850871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4d999-bde3-4bb8-901d-b0a5ec1b91df service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:45.868078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:45.920248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:45.930915 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4d999-bde3-4bb8-901d-b0a5ec1b91df service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:45.935687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d781b89-6fc1-470f-9914-63492670eedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:45.936732 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d781b89-6fc1-470f-9914-63492670eedb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:45.937011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d781b89-6fc1-470f-9914-63492670eedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:45.937282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d781b89-6fc1-470f-9914-63492670eedb admin admin] PATH_INFO: `/v3/users/b0f38e5a95e34a2d847136a4b6b32c66` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:45.938418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d781b89-6fc1-470f-9914-63492670eedb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0f38e5a95e34a2d847136a4b6b32c66)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:45.940434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d781b89-6fc1-470f-9914-63492670eedb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:46.060847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:46.150830 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7d781b89-6fc1-470f-9914-63492670eedb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0f38e5a95e34a2d847136a4b6b32c66'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:46.151511 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7d781b89-6fc1-470f-9914-63492670eedb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0f38e5a95e34a2d847136a4b6b32c66'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:46.152142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7d781b89-6fc1-470f-9914-63492670eedb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0f38e5a95e34a2d847136a4b6b32c66'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:46.160067 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7d781b89-6fc1-470f-9914-63492670eedb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0f38e5a95e34a2d847136a4b6b32c66'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:46.172102 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7d781b89-6fc1-470f-9914-63492670eedb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0f38e5a95e34a2d847136a4b6b32c66'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:46.308916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1025/2052] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:45 2022] DELETE /identity/v3/users/b0f38e5a95e34a2d847136a4b6b32c66 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:46.313453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1bb04-64fb-4f94-8d8f-8913c0e939c6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:46.313743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1bb04-64fb-4f94-8d8f-8913c0e939c6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:46.314016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e1bb04-64fb-4f94-8d8f-8913c0e939c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:46.336920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b3e1bb04-64fb-4f94-8d8f-8913c0e939c6 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:46.338196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b3e1bb04-64fb-4f94-8d8f-8913c0e939c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:46.400777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1028/2053] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:46.407667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d781b89-6fc1-470f-9914-63492670eedb admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:46.409204 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7d781b89-6fc1-470f-9914-63492670eedb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:46.416755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:46.466100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d781b89-6fc1-470f-9914-63492670eedb admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:46.469683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a9ce4-db88-429c-87f5-2ebda7bfca49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:46.470288 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a9ce4-db88-429c-87f5-2ebda7bfca49 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:46.470567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a9ce4-db88-429c-87f5-2ebda7bfca49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:46.470839 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00a9ce4-db88-429c-87f5-2ebda7bfca49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:46.481029 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a9ce4-db88-429c-87f5-2ebda7bfca49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:46.482463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00a9ce4-db88-429c-87f5-2ebda7bfca49 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:46.493271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1026/2054] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:46.734803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:46.966599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1bb04-64fb-4f94-8d8f-8913c0e939c6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:46.968149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b3e1bb04-64fb-4f94-8d8f-8913c0e939c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:46.980074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e1bb04-64fb-4f94-8d8f-8913c0e939c6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:46.982777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:46.987201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:46.987931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:46.991049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:46.991049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] PATH_INFO: `/v3/projects/f570100239714ed6be46f0ef5fd39e52` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:46.991049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f570100239714ed6be46f0ef5fd39e52)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:46.991694 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:47.129716 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f570100239714ed6be46f0ef5fd39e52', 'request_id': 'req-5832046c-94c2-4111-9b5f-07c240048b9a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:47.136444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f570100239714ed6be46f0ef5fd39e52', 'request_id': 'req-5832046c-94c2-4111-9b5f-07c240048b9a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:47.142141 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f570100239714ed6be46f0ef5fd39e52', 'request_id': 'req-5832046c-94c2-4111-9b5f-07c240048b9a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:47.227824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] The token cache is being invalidate because project f570100239714ed6be46f0ef5fd39e52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:47.228173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:47.228819 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:47.230640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1029/2055] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:46 2022] DELETE /identity/v3/projects/f570100239714ed6be46f0ef5fd39e52 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:47.234550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a9ce4-db88-429c-87f5-2ebda7bfca49 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:47.245012 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00a9ce4-db88-429c-87f5-2ebda7bfca49 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:47.302497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091ddd09-3546-4799-99e2-8b72bd2e08d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:47.303131 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ddd09-3546-4799-99e2-8b72bd2e08d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:47.303413 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ddd09-3546-4799-99e2-8b72bd2e08d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:47.304254 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091ddd09-3546-4799-99e2-8b72bd2e08d4 admin admin] PATH_INFO: `/v3/users/2b1a1bca2a9e49a58c9649fa1111da06` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:47.305724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ddd09-3546-4799-99e2-8b72bd2e08d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b1a1bca2a9e49a58c9649fa1111da06)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:47.307750 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091ddd09-3546-4799-99e2-8b72bd2e08d4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:47.326863 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:47.410076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:47.532755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-091ddd09-3546-4799-99e2-8b72bd2e08d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b1a1bca2a9e49a58c9649fa1111da06'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:47.533790 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-091ddd09-3546-4799-99e2-8b72bd2e08d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b1a1bca2a9e49a58c9649fa1111da06'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:47.534552 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-091ddd09-3546-4799-99e2-8b72bd2e08d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b1a1bca2a9e49a58c9649fa1111da06'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:47.548339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-091ddd09-3546-4799-99e2-8b72bd2e08d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b1a1bca2a9e49a58c9649fa1111da06'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:47.561510 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-091ddd09-3546-4799-99e2-8b72bd2e08d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b1a1bca2a9e49a58c9649fa1111da06'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:47.661558 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1027/2056] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:47 2022] DELETE /identity/v3/users/2b1a1bca2a9e49a58c9649fa1111da06 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:47.707519 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:48.150077 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:48.151631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:48.166232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832046c-94c2-4111-9b5f-07c240048b9a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:48.228708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b2b0e-f5bf-47b7-b814-a047551bc613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:48.229736 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b2b0e-f5bf-47b7-b814-a047551bc613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:48.229736 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b2b0e-f5bf-47b7-b814-a047551bc613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:48.229926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b2b0e-f5bf-47b7-b814-a047551bc613 admin admin] PATH_INFO: `/v3/projects/6591fb7c3a534c3e93dc179c7d5c7b0c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:48.231208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b2b0e-f5bf-47b7-b814-a047551bc613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6591fb7c3a534c3e93dc179c7d5c7b0c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:48.233244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b2b0e-f5bf-47b7-b814-a047551bc613 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:48.341669 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d12b2b0e-f5bf-47b7-b814-a047551bc613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6591fb7c3a534c3e93dc179c7d5c7b0c', 'request_id': 'req-d12b2b0e-f5bf-47b7-b814-a047551bc613'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:48.347780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d12b2b0e-f5bf-47b7-b814-a047551bc613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6591fb7c3a534c3e93dc179c7d5c7b0c', 'request_id': 'req-d12b2b0e-f5bf-47b7-b814-a047551bc613'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:48.353506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d12b2b0e-f5bf-47b7-b814-a047551bc613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6591fb7c3a534c3e93dc179c7d5c7b0c', 'request_id': 'req-d12b2b0e-f5bf-47b7-b814-a047551bc613'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:48.427097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d12b2b0e-f5bf-47b7-b814-a047551bc613 admin admin] The token cache is being invalidate because project 6591fb7c3a534c3e93dc179c7d5c7b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:48.427384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d12b2b0e-f5bf-47b7-b814-a047551bc613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:48.428063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d12b2b0e-f5bf-47b7-b814-a047551bc613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:48.429728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1030/2057] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:48 2022] DELETE /identity/v3/projects/6591fb7c3a534c3e93dc179c7d5c7b0c => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:48.434992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ba719-603a-47c5-8748-750eae7a6d0e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:48.435281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ba719-603a-47c5-8748-750eae7a6d0e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:48.435557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645ba719-603a-47c5-8748-750eae7a6d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:48.457773 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-645ba719-603a-47c5-8748-750eae7a6d0e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:48.458909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-645ba719-603a-47c5-8748-750eae7a6d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:48.525173 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1028/2058] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:48.534366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532d500-39cf-4dce-949c-45ca56cb57e6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:48.534765 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532d500-39cf-4dce-949c-45ca56cb57e6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:48.535044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d532d500-39cf-4dce-949c-45ca56cb57e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:48.543291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:48.555458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d532d500-39cf-4dce-949c-45ca56cb57e6 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:48.556732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d532d500-39cf-4dce-949c-45ca56cb57e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:48.565229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1031/2059] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:48.570290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ba719-603a-47c5-8748-750eae7a6d0e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:48.580186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645ba719-603a-47c5-8748-750eae7a6d0e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:48.585566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12d29d-964e-40e7-8e15-c7f8ee6463de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:48.586342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d29d-964e-40e7-8e15-c7f8ee6463de admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:48.586625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d29d-964e-40e7-8e15-c7f8ee6463de admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:48.586900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12d29d-964e-40e7-8e15-c7f8ee6463de admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:48.587550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12d29d-964e-40e7-8e15-c7f8ee6463de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:48.587886 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12d29d-964e-40e7-8e15-c7f8ee6463de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:48.589471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12d29d-964e-40e7-8e15-c7f8ee6463de admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:48.600978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1029/2060] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:48.605541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532d500-39cf-4dce-949c-45ca56cb57e6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:48.616352 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d532d500-39cf-4dce-949c-45ca56cb57e6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:48.621094 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fb89d-ed68-4efe-abcc-4d510ce2b3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:48.621707 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fb89d-ed68-4efe-abcc-4d510ce2b3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:48.621986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fb89d-ed68-4efe-abcc-4d510ce2b3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:48.622256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11fb89d-ed68-4efe-abcc-4d510ce2b3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:48.622895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fb89d-ed68-4efe-abcc-4d510ce2b3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:48.624804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11fb89d-ed68-4efe-abcc-4d510ce2b3e5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:48.756536 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1032/2061] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:48 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:48.758710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12d29d-964e-40e7-8e15-c7f8ee6463de admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:48.776655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12d29d-964e-40e7-8e15-c7f8ee6463de admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:48.840635 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314aa91b-2519-4288-9c41-e5e5e95324bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:48.841248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa91b-2519-4288-9c41-e5e5e95324bc admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:48.841530 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa91b-2519-4288-9c41-e5e5e95324bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:48.841802 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314aa91b-2519-4288-9c41-e5e5e95324bc admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:48.842472 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314aa91b-2519-4288-9c41-e5e5e95324bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:48.844407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314aa91b-2519-4288-9c41-e5e5e95324bc admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:48.916016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1030/2062] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:48 2022] POST /identity/v3/users => generated 283 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:48.917162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fb89d-ed68-4efe-abcc-4d510ce2b3e5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:48.928067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11fb89d-ed68-4efe-abcc-4d510ce2b3e5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:48.933815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e17bd5-54c3-4cfe-87a8-41a88ad63bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:48.934830 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e17bd5-54c3-4cfe-87a8-41a88ad63bf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:48.935294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e17bd5-54c3-4cfe-87a8-41a88ad63bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:48.935566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e17bd5-54c3-4cfe-87a8-41a88ad63bf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:48.936509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e17bd5-54c3-4cfe-87a8-41a88ad63bf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:48.938693 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e17bd5-54c3-4cfe-87a8-41a88ad63bf2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:48.949427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1033/2063] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:48.954266 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314aa91b-2519-4288-9c41-e5e5e95324bc admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:48.965930 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314aa91b-2519-4288-9c41-e5e5e95324bc admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:48.970596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744491a-e4cd-4d41-8436-560f9ea4b793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:48.971196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744491a-e4cd-4d41-8436-560f9ea4b793 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:48.971475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744491a-e4cd-4d41-8436-560f9ea4b793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:48.971741 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3744491a-e4cd-4d41-8436-560f9ea4b793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:48.972442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744491a-e4cd-4d41-8436-560f9ea4b793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:48.974011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3744491a-e4cd-4d41-8436-560f9ea4b793 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:48.982008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:48.985383 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1031/2064] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:48.989919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e17bd5-54c3-4cfe-87a8-41a88ad63bf2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:49.001078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e17bd5-54c3-4cfe-87a8-41a88ad63bf2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:49.010988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2019a28b-a958-4349-a87c-b8b4127dced7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:49.017169 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019a28b-a958-4349-a87c-b8b4127dced7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.017169 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019a28b-a958-4349-a87c-b8b4127dced7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.017169 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2019a28b-a958-4349-a87c-b8b4127dced7 admin admin] PATH_INFO: `/v3/projects/110efbeecece4bb288062986c42fddcc/users/2c22a8a728244acda5c5ec965ef18731/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.029694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744491a-e4cd-4d41-8436-560f9ea4b793 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:49.030344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019a28b-a958-4349-a87c-b8b4127dced7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=110efbeecece4bb288062986c42fddcc, user_id=2c22a8a728244acda5c5ec965ef18731, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:49.032000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3744491a-e4cd-4d41-8436-560f9ea4b793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:49.033165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2019a28b-a958-4349-a87c-b8b4127dced7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:49.046784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3744491a-e4cd-4d41-8436-560f9ea4b793 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:49.051866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2075038-7023-45dd-9e54-abb3ccd60944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:49.052523 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2075038-7023-45dd-9e54-abb3ccd60944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.052803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2075038-7023-45dd-9e54-abb3ccd60944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.053077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2075038-7023-45dd-9e54-abb3ccd60944 admin admin] PATH_INFO: `/v3/users/275d3eb14af1468da4e167a1d7afa3dc` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.054960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2075038-7023-45dd-9e54-abb3ccd60944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=275d3eb14af1468da4e167a1d7afa3dc)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:49.057108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2075038-7023-45dd-9e54-abb3ccd60944 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:49.141979 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1034/2065] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:48 2022] PUT /identity/v3/projects/110efbeecece4bb288062986c42fddcc/users/2c22a8a728244acda5c5ec965ef18731/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:49.152827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53970b0a-b127-4012-8419-7ee06a9c2096 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.153459 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53970b0a-b127-4012-8419-7ee06a9c2096 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.153459 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53970b0a-b127-4012-8419-7ee06a9c2096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.183569 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-53970b0a-b127-4012-8419-7ee06a9c2096 None None] MFA Rules not processed for user `2c22a8a728244acda5c5ec965ef18731`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:49.185125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-53970b0a-b127-4012-8419-7ee06a9c2096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:49.249538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1035/2066] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:49.253955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53970b0a-b127-4012-8419-7ee06a9c2096 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:49.286810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e2075038-7023-45dd-9e54-abb3ccd60944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '275d3eb14af1468da4e167a1d7afa3dc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:49.287547 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e2075038-7023-45dd-9e54-abb3ccd60944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '275d3eb14af1468da4e167a1d7afa3dc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:49.288906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e2075038-7023-45dd-9e54-abb3ccd60944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '275d3eb14af1468da4e167a1d7afa3dc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:49.295976 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e2075038-7023-45dd-9e54-abb3ccd60944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '275d3eb14af1468da4e167a1d7afa3dc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:49.308672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-e2075038-7023-45dd-9e54-abb3ccd60944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '275d3eb14af1468da4e167a1d7afa3dc'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:49.318045 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53970b0a-b127-4012-8419-7ee06a9c2096 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:49.323610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904b0be-bcf7-4135-a3f9-ba9d3b303ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:49.324282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b0be-bcf7-4135-a3f9-ba9d3b303ff3 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.324579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b0be-bcf7-4135-a3f9-ba9d3b303ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.324829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4904b0be-bcf7-4135-a3f9-ba9d3b303ff3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.325449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904b0be-bcf7-4135-a3f9-ba9d3b303ff3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:49.327335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4904b0be-bcf7-4135-a3f9-ba9d3b303ff3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:49.421369 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1032/2067] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:49 2022] DELETE /identity/v3/users/275d3eb14af1468da4e167a1d7afa3dc => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:49.426110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e1c6-62d7-4d5c-8bd3-30659080ef77 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.426393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e1c6-62d7-4d5c-8bd3-30659080ef77 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.426666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83e1c6-62d7-4d5c-8bd3-30659080ef77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.448199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-cc83e1c6-62d7-4d5c-8bd3-30659080ef77 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:49.449591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cc83e1c6-62d7-4d5c-8bd3-30659080ef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:49.452837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1036/2068] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:49 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:49.456896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904b0be-bcf7-4135-a3f9-ba9d3b303ff3 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:49.458517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4904b0be-bcf7-4135-a3f9-ba9d3b303ff3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:49.472878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:49.508433 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1033/2069] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:49.519410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e1c6-62d7-4d5c-8bd3-30659080ef77 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:49.520784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cc83e1c6-62d7-4d5c-8bd3-30659080ef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:49.525214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4904b0be-bcf7-4135-a3f9-ba9d3b303ff3 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:49.530190 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0156d1-14cd-44b3-aef2-32d05a7aee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:49.530811 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0156d1-14cd-44b3-aef2-32d05a7aee42 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.531090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0156d1-14cd-44b3-aef2-32d05a7aee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.531363 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0156d1-14cd-44b3-aef2-32d05a7aee42 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.532079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0156d1-14cd-44b3-aef2-32d05a7aee42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:49.533998 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0156d1-14cd-44b3-aef2-32d05a7aee42 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:49.579613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83e1c6-62d7-4d5c-8bd3-30659080ef77 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:49.629380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b851c0-729d-47ea-b8a6-d8b8d60841f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:49.630010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b851c0-729d-47ea-b8a6-d8b8d60841f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.630291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b851c0-729d-47ea-b8a6-d8b8d60841f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.630562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b851c0-729d-47ea-b8a6-d8b8d60841f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.640722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1037/2070] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:49 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:49.640893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b851c0-729d-47ea-b8a6-d8b8d60841f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:49.642272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b851c0-729d-47ea-b8a6-d8b8d60841f1 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:49.642441 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0156d1-14cd-44b3-aef2-32d05a7aee42 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:49.654004 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1034/2071] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:49.654337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0156d1-14cd-44b3-aef2-32d05a7aee42 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:49.659111 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f89d7d-e658-4ea0-b46a-57e577ee4dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:49.659719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f89d7d-e658-4ea0-b46a-57e577ee4dac admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.660030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f89d7d-e658-4ea0-b46a-57e577ee4dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.660302 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f89d7d-e658-4ea0-b46a-57e577ee4dac admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.660947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f89d7d-e658-4ea0-b46a-57e577ee4dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:49.662572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f89d7d-e658-4ea0-b46a-57e577ee4dac admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:49.673194 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1038/2072] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:49.677406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b851c0-729d-47ea-b8a6-d8b8d60841f1 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:49.688683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b851c0-729d-47ea-b8a6-d8b8d60841f1 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:49.695021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2a9eb-f0ab-438a-9a5a-9115f589ee52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:49.695724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2a9eb-f0ab-438a-9a5a-9115f589ee52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.696064 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2a9eb-f0ab-438a-9a5a-9115f589ee52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.696353 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e2a9eb-f0ab-438a-9a5a-9115f589ee52 admin admin] PATH_INFO: `/v3/projects/8920c7862581489b92e49d340a71a58d/users/4ccb60e4584e4444866cf814ff017df2/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.715286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2a9eb-f0ab-438a-9a5a-9115f589ee52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8920c7862581489b92e49d340a71a58d, user_id=4ccb60e4584e4444866cf814ff017df2, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:49.718286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e2a9eb-f0ab-438a-9a5a-9115f589ee52 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:49.814998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1035/2073] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:49 2022] PUT /identity/v3/projects/8920c7862581489b92e49d340a71a58d/users/4ccb60e4584e4444866cf814ff017df2/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:49.819558 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f89d7d-e658-4ea0-b46a-57e577ee4dac admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:49.830186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f89d7d-e658-4ea0-b46a-57e577ee4dac admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:49.892732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245501ea-739d-408f-a2cd-e30e8c8dbb63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:49.893311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245501ea-739d-408f-a2cd-e30e8c8dbb63 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.893593 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245501ea-739d-408f-a2cd-e30e8c8dbb63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.894441 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245501ea-739d-408f-a2cd-e30e8c8dbb63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.895104 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245501ea-739d-408f-a2cd-e30e8c8dbb63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:49.896949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245501ea-739d-408f-a2cd-e30e8c8dbb63 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:49.911896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1039/2074] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:49.919063 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2a9eb-f0ab-438a-9a5a-9115f589ee52 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:49.931794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245501ea-739d-408f-a2cd-e30e8c8dbb63 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:49.934040 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e2a9eb-f0ab-438a-9a5a-9115f589ee52 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:49.934173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-245501ea-739d-408f-a2cd-e30e8c8dbb63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:49.946979 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3519689-f995-417b-87b0-733d90bd16ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:49.947958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3519689-f995-417b-87b0-733d90bd16ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.948420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3519689-f995-417b-87b0-733d90bd16ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.948873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3519689-f995-417b-87b0-733d90bd16ee admin admin] PATH_INFO: `/v3/projects/8920c7862581489b92e49d340a71a58d/users/4ccb60e4584e4444866cf814ff017df2/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.948989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245501ea-739d-408f-a2cd-e30e8c8dbb63 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:49.954430 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3519689-f995-417b-87b0-733d90bd16ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8920c7862581489b92e49d340a71a58d, user_id=4ccb60e4584e4444866cf814ff017df2, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:49.957467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3519689-f995-417b-87b0-733d90bd16ee admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:49.961142 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fe710-2c17-4ea6-aabe-d4f4eb7326e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:49.962392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fe710-2c17-4ea6-aabe-d4f4eb7326e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.962774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fe710-2c17-4ea6-aabe-d4f4eb7326e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.963036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367fe710-2c17-4ea6-aabe-d4f4eb7326e6 admin admin] PATH_INFO: `/v3/users/ee09e0c282bb418b9578d6235ed5fae2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:49.965708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fe710-2c17-4ea6-aabe-d4f4eb7326e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee09e0c282bb418b9578d6235ed5fae2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:49.968145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367fe710-2c17-4ea6-aabe-d4f4eb7326e6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:49.971165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1036/2075] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:49 2022] PUT /identity/v3/projects/8920c7862581489b92e49d340a71a58d/users/4ccb60e4584e4444866cf814ff017df2/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:49.985228 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893e180-42e2-46a9-a8df-d95fcac3b0ac None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:49.985802 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893e180-42e2-46a9-a8df-d95fcac3b0ac None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:49.986284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893e180-42e2-46a9-a8df-d95fcac3b0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:50.019733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7893e180-42e2-46a9-a8df-d95fcac3b0ac None None] MFA Rules not processed for user `4ccb60e4584e4444866cf814ff017df2`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:50.021268 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7893e180-42e2-46a9-a8df-d95fcac3b0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:50.091094 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1037/2076] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:50.098014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893e180-42e2-46a9-a8df-d95fcac3b0ac None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:50.099508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7893e180-42e2-46a9-a8df-d95fcac3b0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:50.108101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:50.123598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-367fe710-2c17-4ea6-aabe-d4f4eb7326e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee09e0c282bb418b9578d6235ed5fae2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.139401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-367fe710-2c17-4ea6-aabe-d4f4eb7326e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee09e0c282bb418b9578d6235ed5fae2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.139401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-367fe710-2c17-4ea6-aabe-d4f4eb7326e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee09e0c282bb418b9578d6235ed5fae2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.139401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-367fe710-2c17-4ea6-aabe-d4f4eb7326e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee09e0c282bb418b9578d6235ed5fae2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.147392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-367fe710-2c17-4ea6-aabe-d4f4eb7326e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee09e0c282bb418b9578d6235ed5fae2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.174343 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893e180-42e2-46a9-a8df-d95fcac3b0ac None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:50.179214 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2639b4be-0b20-436f-82b1-59085afda912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:50.179865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639b4be-0b20-436f-82b1-59085afda912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:50.181427 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639b4be-0b20-436f-82b1-59085afda912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:50.181427 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2639b4be-0b20-436f-82b1-59085afda912 admin admin] PATH_INFO: `/v3/projects/3fec860522a3492db2f626f242337650` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:50.181606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639b4be-0b20-436f-82b1-59085afda912 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fec860522a3492db2f626f242337650)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:50.183442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2639b4be-0b20-436f-82b1-59085afda912 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:50.200102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:50.205604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1040/2077] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:49 2022] DELETE /identity/v3/users/ee09e0c282bb418b9578d6235ed5fae2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:50.210732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fe710-2c17-4ea6-aabe-d4f4eb7326e6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:50.212516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-367fe710-2c17-4ea6-aabe-d4f4eb7326e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:50.271090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367fe710-2c17-4ea6-aabe-d4f4eb7326e6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:50.288582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2639b4be-0b20-436f-82b1-59085afda912 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fec860522a3492db2f626f242337650', 'request_id': 'req-2639b4be-0b20-436f-82b1-59085afda912'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.295549 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2639b4be-0b20-436f-82b1-59085afda912 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fec860522a3492db2f626f242337650', 'request_id': 'req-2639b4be-0b20-436f-82b1-59085afda912'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.323895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa6eb4-69bc-4855-b56c-87fc88be453f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:50.324640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6eb4-69bc-4855-b56c-87fc88be453f service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:50.324940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6eb4-69bc-4855-b56c-87fc88be453f service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:50.325197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfa6eb4-69bc-4855-b56c-87fc88be453f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:50.327059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8bfa6eb4-69bc-4855-b56c-87fc88be453f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:50.364292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2639b4be-0b20-436f-82b1-59085afda912 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fec860522a3492db2f626f242337650', 'request_id': 'req-2639b4be-0b20-436f-82b1-59085afda912'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.383641 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2639b4be-0b20-436f-82b1-59085afda912 admin admin] The token cache is being invalidate because project 3fec860522a3492db2f626f242337650 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:50.383951 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2639b4be-0b20-436f-82b1-59085afda912 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.384669 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2639b4be-0b20-436f-82b1-59085afda912 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.386495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1038/2078] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:50 2022] DELETE /identity/v3/projects/3fec860522a3492db2f626f242337650 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:50.387872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a28301-b047-4f59-9232-e221bcd36820 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:50.388494 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a28301-b047-4f59-9232-e221bcd36820 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:50.388783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a28301-b047-4f59-9232-e221bcd36820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:50.402235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa6eb4-69bc-4855-b56c-87fc88be453f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:50.403678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfa6eb4-69bc-4855-b56c-87fc88be453f service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:50.409185 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-72a28301-b047-4f59-9232-e221bcd36820 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:50.410401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-72a28301-b047-4f59-9232-e221bcd36820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:50.413598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1041/2079] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:50.414305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa6eb4-69bc-4855-b56c-87fc88be453f service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:50.415540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8bfa6eb4-69bc-4855-b56c-87fc88be453f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:50.475974 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1039/2080] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:50.484601 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfa6eb4-69bc-4855-b56c-87fc88be453f service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:50.486086 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a28301-b047-4f59-9232-e221bcd36820 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:50.487576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-72a28301-b047-4f59-9232-e221bcd36820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:50.489336 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf9572-b5de-4b4b-98e6-d3e45e162284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:50.489967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf9572-b5de-4b4b-98e6-d3e45e162284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:50.490248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf9572-b5de-4b4b-98e6-d3e45e162284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:50.490521 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf9572-b5de-4b4b-98e6-d3e45e162284 admin admin] PATH_INFO: `/v3/users/521048746664444382e9669fa88cbb72` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:50.492374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf9572-b5de-4b4b-98e6-d3e45e162284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=521048746664444382e9669fa88cbb72)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:50.494423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf9572-b5de-4b4b-98e6-d3e45e162284 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:50.548216 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a28301-b047-4f59-9232-e221bcd36820 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:50.552971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d7567-6817-4c27-b9ab-823b7370a65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:50.554297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7567-6817-4c27-b9ab-823b7370a65d service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:50.554793 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7567-6817-4c27-b9ab-823b7370a65d service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:50.555224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d7567-6817-4c27-b9ab-823b7370a65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:50.565006 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d7567-6817-4c27-b9ab-823b7370a65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:50.566421 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d7567-6817-4c27-b9ab-823b7370a65d service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:50.576968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1040/2081] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:50.726680 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-95cf9572-b5de-4b4b-98e6-d3e45e162284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521048746664444382e9669fa88cbb72'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.739360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-95cf9572-b5de-4b4b-98e6-d3e45e162284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521048746664444382e9669fa88cbb72'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.740092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-95cf9572-b5de-4b4b-98e6-d3e45e162284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521048746664444382e9669fa88cbb72'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.740720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-95cf9572-b5de-4b4b-98e6-d3e45e162284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521048746664444382e9669fa88cbb72'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.748257 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-95cf9572-b5de-4b4b-98e6-d3e45e162284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521048746664444382e9669fa88cbb72'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:50.785907 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:50.854310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1042/2082] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:50 2022] DELETE /identity/v3/users/521048746664444382e9669fa88cbb72 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:50.856353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:51.034567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d7567-6817-4c27-b9ab-823b7370a65d service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:51.036000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a31d7567-6817-4c27-b9ab-823b7370a65d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:51.052018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d7567-6817-4c27-b9ab-823b7370a65d service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:51.108747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:51.118766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:51.119142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.119488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.119838 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] PATH_INFO: `/v3/projects/5f573711e73f4c1a9688932c8971e3e9` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.121699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f573711e73f4c1a9688932c8971e3e9)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:51.123678 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:51.261904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f573711e73f4c1a9688932c8971e3e9', 'request_id': 'req-0655193b-263c-4d52-8930-d8bcc81fe903'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.273586 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f573711e73f4c1a9688932c8971e3e9', 'request_id': 'req-0655193b-263c-4d52-8930-d8bcc81fe903'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.314377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf9572-b5de-4b4b-98e6-d3e45e162284 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:51.315970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-95cf9572-b5de-4b4b-98e6-d3e45e162284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:51.333449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf9572-b5de-4b4b-98e6-d3e45e162284 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:51.336371 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f573711e73f4c1a9688932c8971e3e9', 'request_id': 'req-0655193b-263c-4d52-8930-d8bcc81fe903'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.349376 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] The token cache is being invalidate because project 5f573711e73f4c1a9688932c8971e3e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:51.349737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.350747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.352842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1041/2083] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:51 2022] DELETE /identity/v3/projects/5f573711e73f4c1a9688932c8971e3e9 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:51.356964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:51.358320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:51.413320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:51.414140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.414633 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.415392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] PATH_INFO: `/v3/projects/0f825653b6c84ab3b108886af6dac2a0` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.416881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f825653b6c84ab3b108886af6dac2a0)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:51.419180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:51.453083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655193b-263c-4d52-8930-d8bcc81fe903 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:51.459511 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f771ebc-fef8-4efc-8aa9-7be5097f7f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:51.463446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f771ebc-fef8-4efc-8aa9-7be5097f7f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.463446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f771ebc-fef8-4efc-8aa9-7be5097f7f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.463446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f771ebc-fef8-4efc-8aa9-7be5097f7f6d admin admin] PATH_INFO: `/v3/users/27dca3920e344c28bfad127722fb4f1d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.463446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f771ebc-fef8-4efc-8aa9-7be5097f7f6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=27dca3920e344c28bfad127722fb4f1d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:51.464952 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f771ebc-fef8-4efc-8aa9-7be5097f7f6d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:51.536387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f825653b6c84ab3b108886af6dac2a0', 'request_id': 'req-c65769bf-69c3-46ce-9f8e-fb94d057d781'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.542726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f825653b6c84ab3b108886af6dac2a0', 'request_id': 'req-c65769bf-69c3-46ce-9f8e-fb94d057d781'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.548623 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f825653b6c84ab3b108886af6dac2a0', 'request_id': 'req-c65769bf-69c3-46ce-9f8e-fb94d057d781'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.666884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] The token cache is being invalidate because project 0f825653b6c84ab3b108886af6dac2a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:51.667177 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.667826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.669435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1043/2084] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:51 2022] DELETE /identity/v3/projects/0f825653b6c84ab3b108886af6dac2a0 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:51.670642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:51.671624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:51.687966 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5f771ebc-fef8-4efc-8aa9-7be5097f7f6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27dca3920e344c28bfad127722fb4f1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.688695 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5f771ebc-fef8-4efc-8aa9-7be5097f7f6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27dca3920e344c28bfad127722fb4f1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.689290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5f771ebc-fef8-4efc-8aa9-7be5097f7f6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27dca3920e344c28bfad127722fb4f1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.691076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:51.696948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5f771ebc-fef8-4efc-8aa9-7be5097f7f6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27dca3920e344c28bfad127722fb4f1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.711049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5f771ebc-fef8-4efc-8aa9-7be5097f7f6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27dca3920e344c28bfad127722fb4f1d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.740354 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65769bf-69c3-46ce-9f8e-fb94d057d781 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:51.745789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a857d50-82a4-44d0-bbf3-3962df8fa2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:51.746448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a857d50-82a4-44d0-bbf3-3962df8fa2b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.746731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a857d50-82a4-44d0-bbf3-3962df8fa2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.747004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a857d50-82a4-44d0-bbf3-3962df8fa2b5 admin admin] PATH_INFO: `/v3/users/2c22a8a728244acda5c5ec965ef18731` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.748205 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a857d50-82a4-44d0-bbf3-3962df8fa2b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c22a8a728244acda5c5ec965ef18731)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:51.750135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a857d50-82a4-44d0-bbf3-3962df8fa2b5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:51.786801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1042/2085] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:51 2022] DELETE /identity/v3/users/27dca3920e344c28bfad127722fb4f1d => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:51.788229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd7364-2ea5-4ba6-846c-1b830257eeb7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.788510 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd7364-2ea5-4ba6-846c-1b830257eeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.788782 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd7364-2ea5-4ba6-846c-1b830257eeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.796108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:51.813388 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1ccd7364-2ea5-4ba6-846c-1b830257eeb7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:51.814620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1ccd7364-2ea5-4ba6-846c-1b830257eeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:51.879536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1043/2086] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:51.887761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057b464-9eff-4720-b371-76854439281d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.888084 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057b464-9eff-4720-b371-76854439281d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.888354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057b464-9eff-4720-b371-76854439281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.908394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-0057b464-9eff-4720-b371-76854439281d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:51.909602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0057b464-9eff-4720-b371-76854439281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:51.918442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1044/2087] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:51.923238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057b464-9eff-4720-b371-76854439281d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:51.932089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057b464-9eff-4720-b371-76854439281d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:51.937132 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8a0d6-5948-40f9-a531-9c0d94ac6605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:51.937706 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8a0d6-5948-40f9-a531-9c0d94ac6605 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.937986 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8a0d6-5948-40f9-a531-9c0d94ac6605 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.938257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8a0d6-5948-40f9-a531-9c0d94ac6605 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.938890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8a0d6-5948-40f9-a531-9c0d94ac6605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:51.939289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8a0d6-5948-40f9-a531-9c0d94ac6605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:51.940908 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e8a0d6-5948-40f9-a531-9c0d94ac6605 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:51.954434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1045/2088] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:09:51.965068 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8a0d6-5948-40f9-a531-9c0d94ac6605 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:51.968841 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4a857d50-82a4-44d0-bbf3-3962df8fa2b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c22a8a728244acda5c5ec965ef18731'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.974989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8a0d6-5948-40f9-a531-9c0d94ac6605 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:51.980734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432070e5-c445-4634-894e-7e056bfbe77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:51.985051 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432070e5-c445-4634-894e-7e056bfbe77e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:51.985051 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432070e5-c445-4634-894e-7e056bfbe77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:51.985051 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432070e5-c445-4634-894e-7e056bfbe77e admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:51.985051 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432070e5-c445-4634-894e-7e056bfbe77e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:51.985562 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4a857d50-82a4-44d0-bbf3-3962df8fa2b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c22a8a728244acda5c5ec965ef18731'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.985562 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4a857d50-82a4-44d0-bbf3-3962df8fa2b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c22a8a728244acda5c5ec965ef18731'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.985562 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4a857d50-82a4-44d0-bbf3-3962df8fa2b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c22a8a728244acda5c5ec965ef18731'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:51.985799 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432070e5-c445-4634-894e-7e056bfbe77e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:51.992589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4a857d50-82a4-44d0-bbf3-3962df8fa2b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c22a8a728244acda5c5ec965ef18731'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:52.098201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1044/2089] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:51 2022] DELETE /identity/v3/users/2c22a8a728244acda5c5ec965ef18731 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:52.102065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1046/2090] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:51 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:52.104165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd370189-d9f1-475d-8f29-b5c6b5d3b6f2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:52.104536 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd370189-d9f1-475d-8f29-b5c6b5d3b6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:52.105074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd370189-d9f1-475d-8f29-b5c6b5d3b6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:52.106154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432070e5-c445-4634-894e-7e056bfbe77e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:52.108068 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-432070e5-c445-4634-894e-7e056bfbe77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:52.126404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-dd370189-d9f1-475d-8f29-b5c6b5d3b6f2 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:52.128132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dd370189-d9f1-475d-8f29-b5c6b5d3b6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:52.183858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432070e5-c445-4634-894e-7e056bfbe77e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:52.189095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fba1c4-853f-4be4-84e4-35e9dae06d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:52.189769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fba1c4-853f-4be4-84e4-35e9dae06d1c admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:52.190074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fba1c4-853f-4be4-84e4-35e9dae06d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:52.190352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fba1c4-853f-4be4-84e4-35e9dae06d1c admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:52.191010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fba1c4-853f-4be4-84e4-35e9dae06d1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:52.193068 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fba1c4-853f-4be4-84e4-35e9dae06d1c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:52.197140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1045/2091] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:52.207121 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd370189-d9f1-475d-8f29-b5c6b5d3b6f2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:52.208504 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dd370189-d9f1-475d-8f29-b5c6b5d3b6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:52.254744 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:52.269261 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1047/2092] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:52 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:52.270240 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fba1c4-853f-4be4-84e4-35e9dae06d1c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:52.275704 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e6fba1c4-853f-4be4-84e4-35e9dae06d1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:52.279795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd370189-d9f1-475d-8f29-b5c6b5d3b6f2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:52.284104 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70329b92-4d94-4346-b699-3573fe176c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:52.284749 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70329b92-4d94-4346-b699-3573fe176c3b service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:52.285031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70329b92-4d94-4346-b699-3573fe176c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:52.287172 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70329b92-4d94-4346-b699-3573fe176c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:52.288933 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fba1c4-853f-4be4-84e4-35e9dae06d1c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:52.293685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:52.294350 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:52.294808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:52.295090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] PATH_INFO: `/v3/projects/02f7e38914054c4099be8cb329ae7c2a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:52.295829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70329b92-4d94-4346-b699-3573fe176c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:52.296384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02f7e38914054c4099be8cb329ae7c2a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:52.297375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70329b92-4d94-4346-b699-3573fe176c3b service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:52.298307 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:52.309256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1046/2093] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:52.316882 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70329b92-4d94-4346-b699-3573fe176c3b service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:52.329271 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70329b92-4d94-4346-b699-3573fe176c3b service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:52.334412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ef475-e81b-4006-a512-6b67775ff472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:52.336407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ef475-e81b-4006-a512-6b67775ff472 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:52.336687 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ef475-e81b-4006-a512-6b67775ff472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:52.336955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036ef475-e81b-4006-a512-6b67775ff472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:52.337629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ef475-e81b-4006-a512-6b67775ff472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:52.339204 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036ef475-e81b-4006-a512-6b67775ff472 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:52.349798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1047/2094] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:52.353629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ef475-e81b-4006-a512-6b67775ff472 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:52.363578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036ef475-e81b-4006-a512-6b67775ff472 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:52.370343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d7f3f-b535-49d0-bb87-ccb485dd40be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:52.371129 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d7f3f-b535-49d0-bb87-ccb485dd40be admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:52.371414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d7f3f-b535-49d0-bb87-ccb485dd40be admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:52.373175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d7f3f-b535-49d0-bb87-ccb485dd40be admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:52.373175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d7f3f-b535-49d0-bb87-ccb485dd40be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:52.374486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d7f3f-b535-49d0-bb87-ccb485dd40be admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:52.391589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1048/2095] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:52.395791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d7f3f-b535-49d0-bb87-ccb485dd40be admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:52.408280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d7f3f-b535-49d0-bb87-ccb485dd40be admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:52.417498 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f7e38914054c4099be8cb329ae7c2a', 'request_id': 'req-a9d84498-9711-4c24-938d-b71c743b1d67'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:52.424491 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f7e38914054c4099be8cb329ae7c2a', 'request_id': 'req-a9d84498-9711-4c24-938d-b71c743b1d67'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:52.427726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:52.468595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6910427-91ae-47d3-9e79-6b4d29a628b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:52.469252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6910427-91ae-47d3-9e79-6b4d29a628b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:52.469543 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6910427-91ae-47d3-9e79-6b4d29a628b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:52.469827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6910427-91ae-47d3-9e79-6b4d29a628b9 admin admin] PATH_INFO: `/v3/projects/105a5aaecfac4453b0f02baf78c58806/users/79efbaa088344cf3b6382de6b4f8f5e2/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:52.484547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6910427-91ae-47d3-9e79-6b4d29a628b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=105a5aaecfac4453b0f02baf78c58806, user_id=79efbaa088344cf3b6382de6b4f8f5e2, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:52.487232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6910427-91ae-47d3-9e79-6b4d29a628b9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:52.507944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f7e38914054c4099be8cb329ae7c2a', 'request_id': 'req-a9d84498-9711-4c24-938d-b71c743b1d67'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:52.522722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] The token cache is being invalidate because project 02f7e38914054c4099be8cb329ae7c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:52.523162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:52.524050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:52.525566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1048/2096] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:52 2022] DELETE /identity/v3/projects/02f7e38914054c4099be8cb329ae7c2a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:52.531944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:52.533483 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:52.547177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d84498-9711-4c24-938d-b71c743b1d67 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:52.551913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97907a17-89e6-414d-904b-9583a9b38a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:52.552478 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97907a17-89e6-414d-904b-9583a9b38a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:52.552756 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97907a17-89e6-414d-904b-9583a9b38a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:52.553024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97907a17-89e6-414d-904b-9583a9b38a8a admin admin] PATH_INFO: `/v3/users/acb671dd8e3143a88bb38c089678d9a2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:52.554483 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97907a17-89e6-414d-904b-9583a9b38a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb671dd8e3143a88bb38c089678d9a2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:52.556420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97907a17-89e6-414d-904b-9583a9b38a8a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:52.570449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1049/2097] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:52 2022] PUT /identity/v3/projects/105a5aaecfac4453b0f02baf78c58806/users/79efbaa088344cf3b6382de6b4f8f5e2/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:52.582114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48424d-e520-4201-99ae-2c98f5b5d4f6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:52.582491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48424d-e520-4201-99ae-2c98f5b5d4f6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:52.582672 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48424d-e520-4201-99ae-2c98f5b5d4f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:52.615102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ef48424d-e520-4201-99ae-2c98f5b5d4f6 None None] MFA Rules not processed for user `79efbaa088344cf3b6382de6b4f8f5e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:52.616819 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ef48424d-e520-4201-99ae-2c98f5b5d4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:52.685415 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1050/2098] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:52.690128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48424d-e520-4201-99ae-2c98f5b5d4f6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:52.691444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ef48424d-e520-4201-99ae-2c98f5b5d4f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:52.738813 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-97907a17-89e6-414d-904b-9583a9b38a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb671dd8e3143a88bb38c089678d9a2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:52.744286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-97907a17-89e6-414d-904b-9583a9b38a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb671dd8e3143a88bb38c089678d9a2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:52.745129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-97907a17-89e6-414d-904b-9583a9b38a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb671dd8e3143a88bb38c089678d9a2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:52.753902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-97907a17-89e6-414d-904b-9583a9b38a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb671dd8e3143a88bb38c089678d9a2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:52.768375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-97907a17-89e6-414d-904b-9583a9b38a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb671dd8e3143a88bb38c089678d9a2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:52.770241 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48424d-e520-4201-99ae-2c98f5b5d4f6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:52.776367 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee4eee-a56a-4174-9a18-5e92d5b8cc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:52.776696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee4eee-a56a-4174-9a18-5e92d5b8cc42 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:52.776974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee4eee-a56a-4174-9a18-5e92d5b8cc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:52.777241 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ee4eee-a56a-4174-9a18-5e92d5b8cc42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:52.777868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee4eee-a56a-4174-9a18-5e92d5b8cc42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:52.779741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ee4eee-a56a-4174-9a18-5e92d5b8cc42 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:52.827680 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1049/2099] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:52 2022] DELETE /identity/v3/users/acb671dd8e3143a88bb38c089678d9a2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:52.828444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97907a17-89e6-414d-904b-9583a9b38a8a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:52.830637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-97907a17-89e6-414d-904b-9583a9b38a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:52.899198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1051/2100] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:52 2022] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:52.903443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee4eee-a56a-4174-9a18-5e92d5b8cc42 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:52.905273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-41ee4eee-a56a-4174-9a18-5e92d5b8cc42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:52.906236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97907a17-89e6-414d-904b-9583a9b38a8a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:52.966773 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:52.967415 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:52.967696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:52.968003 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] PATH_INFO: `/v3/projects/110efbeecece4bb288062986c42fddcc` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:52.969147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] RBAC: Authorizing `identity:delete_project(project_id=110efbeecece4bb288062986c42fddcc)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:52.971297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:52.980406 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ee4eee-a56a-4174-9a18-5e92d5b8cc42 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:52.985136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f55f7-b4b2-4d1f-b277-9cbe2cd70f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:52.985719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f55f7-b4b2-4d1f-b277-9cbe2cd70f72 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:52.985996 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f55f7-b4b2-4d1f-b277-9cbe2cd70f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:52.986268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f55f7-b4b2-4d1f-b277-9cbe2cd70f72 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:52.989063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f55f7-b4b2-4d1f-b277-9cbe2cd70f72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:52.989063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f55f7-b4b2-4d1f-b277-9cbe2cd70f72 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:53.038828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:53.080202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1052/2101] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:52 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:53.088155 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '110efbeecece4bb288062986c42fddcc', 'request_id': 'req-d8596627-817b-46f6-8ba3-b6ac7762eabe'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.088386 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f55f7-b4b2-4d1f-b277-9cbe2cd70f72 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:53.095693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '110efbeecece4bb288062986c42fddcc', 'request_id': 'req-d8596627-817b-46f6-8ba3-b6ac7762eabe'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.109089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f55f7-b4b2-4d1f-b277-9cbe2cd70f72 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:53.177477 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cb6ba-3092-4282-928f-8176848e1dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:53.178117 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cb6ba-3092-4282-928f-8176848e1dfe admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.178968 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cb6ba-3092-4282-928f-8176848e1dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.179405 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13cb6ba-3092-4282-928f-8176848e1dfe admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.184014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cb6ba-3092-4282-928f-8176848e1dfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:53.184014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13cb6ba-3092-4282-928f-8176848e1dfe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:53.191803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1053/2102] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:53.195955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cb6ba-3092-4282-928f-8176848e1dfe admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:53.203717 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '110efbeecece4bb288062986c42fddcc', 'request_id': 'req-d8596627-817b-46f6-8ba3-b6ac7762eabe'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.207162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13cb6ba-3092-4282-928f-8176848e1dfe admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:53.210549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe0b7a-fc73-42a6-8e4b-5ffed1c4ca73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:53.211182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe0b7a-fc73-42a6-8e4b-5ffed1c4ca73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.211962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe0b7a-fc73-42a6-8e4b-5ffed1c4ca73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.211962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe0b7a-fc73-42a6-8e4b-5ffed1c4ca73 admin admin] PATH_INFO: `/v3/projects/0b517860f1fc49839a211f49ab7c5c3b/users/6d8f28b09b244102b31913dafc93b133/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.222331 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] The token cache is being invalidate because project 110efbeecece4bb288062986c42fddcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:53.222629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.223451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.225993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1050/2103] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:52 2022] DELETE /identity/v3/projects/110efbeecece4bb288062986c42fddcc => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:53.230218 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:53.230355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:53.232529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:53.240663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe0b7a-fc73-42a6-8e4b-5ffed1c4ca73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b517860f1fc49839a211f49ab7c5c3b, user_id=6d8f28b09b244102b31913dafc93b133, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:53.243733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fe0b7a-fc73-42a6-8e4b-5ffed1c4ca73 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:53.245628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8596627-817b-46f6-8ba3-b6ac7762eabe admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:53.250314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81f7e4-2fbe-4ba9-ac90-6e2ceae30bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:53.250929 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81f7e4-2fbe-4ba9-ac90-6e2ceae30bfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.251208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81f7e4-2fbe-4ba9-ac90-6e2ceae30bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.251481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81f7e4-2fbe-4ba9-ac90-6e2ceae30bfc admin admin] PATH_INFO: `/v3/users/4ccb60e4584e4444866cf814ff017df2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.252659 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81f7e4-2fbe-4ba9-ac90-6e2ceae30bfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ccb60e4584e4444866cf814ff017df2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:53.254555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81f7e4-2fbe-4ba9-ac90-6e2ceae30bfc admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:53.342774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1054/2104] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:53 2022] PUT /identity/v3/projects/0b517860f1fc49839a211f49ab7c5c3b/users/6d8f28b09b244102b31913dafc93b133/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:53.343784 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe0b7a-fc73-42a6-8e4b-5ffed1c4ca73 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:53.345405 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-26fe0b7a-fc73-42a6-8e4b-5ffed1c4ca73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:53.412642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe0b7a-fc73-42a6-8e4b-5ffed1c4ca73 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:53.418379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a5971-0313-4dad-b756-1a4198915699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:53.419035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a5971-0313-4dad-b756-1a4198915699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.419342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a5971-0313-4dad-b756-1a4198915699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.419612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a5971-0313-4dad-b756-1a4198915699 admin admin] PATH_INFO: `/v3/projects/30fcd36d4ea64d4f9bd1ebfd4ef8cf9b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.420971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a5971-0313-4dad-b756-1a4198915699 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30fcd36d4ea64d4f9bd1ebfd4ef8cf9b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:53.422672 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a5971-0313-4dad-b756-1a4198915699 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:53.425199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2a81f7e4-2fbe-4ba9-ac90-6e2ceae30bfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ccb60e4584e4444866cf814ff017df2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.425895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2a81f7e4-2fbe-4ba9-ac90-6e2ceae30bfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ccb60e4584e4444866cf814ff017df2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.426513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2a81f7e4-2fbe-4ba9-ac90-6e2ceae30bfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ccb60e4584e4444866cf814ff017df2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.433708 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2a81f7e4-2fbe-4ba9-ac90-6e2ceae30bfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ccb60e4584e4444866cf814ff017df2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.445944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2a81f7e4-2fbe-4ba9-ac90-6e2ceae30bfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ccb60e4584e4444866cf814ff017df2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.449860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:53.524280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ce9a5971-0313-4dad-b756-1a4198915699 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30fcd36d4ea64d4f9bd1ebfd4ef8cf9b', 'request_id': 'req-ce9a5971-0313-4dad-b756-1a4198915699'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.530463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ce9a5971-0313-4dad-b756-1a4198915699 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30fcd36d4ea64d4f9bd1ebfd4ef8cf9b', 'request_id': 'req-ce9a5971-0313-4dad-b756-1a4198915699'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.531219 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1051/2105] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:53 2022] DELETE /identity/v3/users/4ccb60e4584e4444866cf814ff017df2 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:53.532221 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81f7e4-2fbe-4ba9-ac90-6e2ceae30bfc admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:53.533628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2a81f7e4-2fbe-4ba9-ac90-6e2ceae30bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:53.537232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ce9a5971-0313-4dad-b756-1a4198915699 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30fcd36d4ea64d4f9bd1ebfd4ef8cf9b', 'request_id': 'req-ce9a5971-0313-4dad-b756-1a4198915699'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.587885 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ce9a5971-0313-4dad-b756-1a4198915699 admin admin] The token cache is being invalidate because project 30fcd36d4ea64d4f9bd1ebfd4ef8cf9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:53.588485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ce9a5971-0313-4dad-b756-1a4198915699 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.589583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ce9a5971-0313-4dad-b756-1a4198915699 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:53.597489 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1055/2106] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:53 2022] DELETE /identity/v3/projects/30fcd36d4ea64d4f9bd1ebfd4ef8cf9b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:53.598996 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2584bb2-e671-4598-b9f5-f4e06aeae441 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.599541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2584bb2-e671-4598-b9f5-f4e06aeae441 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.599951 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2584bb2-e671-4598-b9f5-f4e06aeae441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.617076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81f7e4-2fbe-4ba9-ac90-6e2ceae30bfc admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:53.620763 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f2584bb2-e671-4598-b9f5-f4e06aeae441 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:53.622034 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f2584bb2-e671-4598-b9f5-f4e06aeae441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:53.622333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c82f3f-fa0c-40c3-9b0a-fafff77a93e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:53.622956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c82f3f-fa0c-40c3-9b0a-fafff77a93e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.623239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c82f3f-fa0c-40c3-9b0a-fafff77a93e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.623515 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c82f3f-fa0c-40c3-9b0a-fafff77a93e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.624351 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c82f3f-fa0c-40c3-9b0a-fafff77a93e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:53.626176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c82f3f-fa0c-40c3-9b0a-fafff77a93e3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:53.636726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1056/2107] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:53.639313 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1052/2108] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:53 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:53.646878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27365ad5-9370-40c6-bbbc-64152460426a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.647128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27365ad5-9370-40c6-bbbc-64152460426a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.647965 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27365ad5-9370-40c6-bbbc-64152460426a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.648913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c82f3f-fa0c-40c3-9b0a-fafff77a93e3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:53.651186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:53.652566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a9c82f3f-fa0c-40c3-9b0a-fafff77a93e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:53.667276 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c82f3f-fa0c-40c3-9b0a-fafff77a93e3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:53.671336 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-27365ad5-9370-40c6-bbbc-64152460426a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:53.672447 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134b2b1-4599-4112-86eb-1ca5192d163c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:53.672577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-27365ad5-9370-40c6-bbbc-64152460426a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:53.673127 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134b2b1-4599-4112-86eb-1ca5192d163c admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.673396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134b2b1-4599-4112-86eb-1ca5192d163c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.673908 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134b2b1-4599-4112-86eb-1ca5192d163c admin admin] PATH_INFO: `/v3/projects/0b517860f1fc49839a211f49ab7c5c3b/users/6d8f28b09b244102b31913dafc93b133/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.675708 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134b2b1-4599-4112-86eb-1ca5192d163c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b517860f1fc49839a211f49ab7c5c3b, user_id=6d8f28b09b244102b31913dafc93b133, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:53.679016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134b2b1-4599-4112-86eb-1ca5192d163c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:53.681411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1057/2109] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:53.685417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27365ad5-9370-40c6-bbbc-64152460426a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:53.690295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1053/2110] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:53 2022] PUT /identity/v3/projects/0b517860f1fc49839a211f49ab7c5c3b/users/6d8f28b09b244102b31913dafc93b133/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:53.694731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27365ad5-9370-40c6-bbbc-64152460426a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:53.704563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc2927-a61f-485c-b444-90476d561c00 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.704855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc2927-a61f-485c-b444-90476d561c00 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.705128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cc2927-a61f-485c-b444-90476d561c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.734801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-93cc2927-a61f-485c-b444-90476d561c00 None None] MFA Rules not processed for user `6d8f28b09b244102b31913dafc93b133`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:53.736114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-93cc2927-a61f-485c-b444-90476d561c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:53.754776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc239fcc-c894-4434-8bc8-d2fcab3c16f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:53.755525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc239fcc-c894-4434-8bc8-d2fcab3c16f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.755728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc239fcc-c894-4434-8bc8-d2fcab3c16f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.756207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc239fcc-c894-4434-8bc8-d2fcab3c16f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.760528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc239fcc-c894-4434-8bc8-d2fcab3c16f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:53.760812 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc239fcc-c894-4434-8bc8-d2fcab3c16f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:53.774232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc239fcc-c894-4434-8bc8-d2fcab3c16f1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:53.791218 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1058/2111] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:09:53.795699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc239fcc-c894-4434-8bc8-d2fcab3c16f1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:53.807510 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc239fcc-c894-4434-8bc8-d2fcab3c16f1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:53.813159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f1c52-c9d6-4439-b56b-d6ee67725f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:53.813710 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f1c52-c9d6-4439-b56b-d6ee67725f19 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.813996 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f1c52-c9d6-4439-b56b-d6ee67725f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.814272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f1c52-c9d6-4439-b56b-d6ee67725f19 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:53.814908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f1c52-c9d6-4439-b56b-d6ee67725f19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:53.816921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2f1c52-c9d6-4439-b56b-d6ee67725f19 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:53.833437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1054/2112] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:53.851279 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc2927-a61f-485c-b444-90476d561c00 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:53.852865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-93cc2927-a61f-485c-b444-90476d561c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:53.917719 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cc2927-a61f-485c-b444-90476d561c00 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:53.918629 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1059/2113] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:53 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:53.924917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f1c52-c9d6-4439-b56b-d6ee67725f19 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:53.933321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:53.976710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6988ec-4878-4bd1-b3b8-aac26a3a4cba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:53.977637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6988ec-4878-4bd1-b3b8-aac26a3a4cba service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:53.977962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6988ec-4878-4bd1-b3b8-aac26a3a4cba service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:53.978245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6988ec-4878-4bd1-b3b8-aac26a3a4cba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.006221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f1c52-c9d6-4439-b56b-d6ee67725f19 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:54.011243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743bd85-25a8-41b0-beed-1157db5dee9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:54.011907 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743bd85-25a8-41b0-beed-1157db5dee9e admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.012158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743bd85-25a8-41b0-beed-1157db5dee9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.012427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7743bd85-25a8-41b0-beed-1157db5dee9e admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.013206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743bd85-25a8-41b0-beed-1157db5dee9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:54.015116 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7743bd85-25a8-41b0-beed-1157db5dee9e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:54.053172 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6988ec-4878-4bd1-b3b8-aac26a3a4cba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:54.054685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6988ec-4878-4bd1-b3b8-aac26a3a4cba service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:54.064340 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1055/2114] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:53 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:54.116026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6988ec-4878-4bd1-b3b8-aac26a3a4cba service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:54.117912 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ab6988ec-4878-4bd1-b3b8-aac26a3a4cba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:54.132136 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6988ec-4878-4bd1-b3b8-aac26a3a4cba service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:54.138472 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:54.138873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1060/2115] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:53 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:54.141531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.141531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.141531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] PATH_INFO: `/v3/projects/8920c7862581489b92e49d340a71a58d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.148565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743bd85-25a8-41b0-beed-1157db5dee9e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:54.148680 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8920c7862581489b92e49d340a71a58d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:54.148680 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:54.159200 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7743bd85-25a8-41b0-beed-1157db5dee9e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:54.169585 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d925c-33be-4f0f-9662-ca1a7b7f7af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:54.171099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d925c-33be-4f0f-9662-ca1a7b7f7af2 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.171457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d925c-33be-4f0f-9662-ca1a7b7f7af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.171796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749d925c-33be-4f0f-9662-ca1a7b7f7af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.172910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d925c-33be-4f0f-9662-ca1a7b7f7af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:54.174650 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749d925c-33be-4f0f-9662-ca1a7b7f7af2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:54.188283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1061/2116] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:54.189255 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d925c-33be-4f0f-9662-ca1a7b7f7af2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:54.200449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749d925c-33be-4f0f-9662-ca1a7b7f7af2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:54.205221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca5a678-1655-4199-8992-69171c4cd6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:54.205859 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5a678-1655-4199-8992-69171c4cd6d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.206130 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5a678-1655-4199-8992-69171c4cd6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.206403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca5a678-1655-4199-8992-69171c4cd6d5 admin admin] PATH_INFO: `/v3/users/79efbaa088344cf3b6382de6b4f8f5e2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.207570 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5a678-1655-4199-8992-69171c4cd6d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79efbaa088344cf3b6382de6b4f8f5e2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:54.210221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca5a678-1655-4199-8992-69171c4cd6d5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:54.272754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8920c7862581489b92e49d340a71a58d', 'request_id': 'req-96e0dbb5-6589-4903-aa02-503d52347377'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:54.278912 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8920c7862581489b92e49d340a71a58d', 'request_id': 'req-96e0dbb5-6589-4903-aa02-503d52347377'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:54.358139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8920c7862581489b92e49d340a71a58d', 'request_id': 'req-96e0dbb5-6589-4903-aa02-503d52347377'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:54.360590 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:54.370796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] The token cache is being invalidate because project 8920c7862581489b92e49d340a71a58d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:54.371082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:54.371725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:54.373257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1056/2117] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:54 2022] DELETE /identity/v3/projects/8920c7862581489b92e49d340a71a58d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:54.374107 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:54.375410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:54.407223 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2ca5a678-1655-4199-8992-69171c4cd6d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79efbaa088344cf3b6382de6b4f8f5e2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:54.419953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2ca5a678-1655-4199-8992-69171c4cd6d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79efbaa088344cf3b6382de6b4f8f5e2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:54.420667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2ca5a678-1655-4199-8992-69171c4cd6d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79efbaa088344cf3b6382de6b4f8f5e2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:54.421289 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2ca5a678-1655-4199-8992-69171c4cd6d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79efbaa088344cf3b6382de6b4f8f5e2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:54.428092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2ca5a678-1655-4199-8992-69171c4cd6d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79efbaa088344cf3b6382de6b4f8f5e2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:54.441960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0dbb5-6589-4903-aa02-503d52347377 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:54.447392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfa7c8-273e-4e59-bbcc-c5cd07f8aacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:54.448041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfa7c8-273e-4e59-bbcc-c5cd07f8aacf admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.448323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfa7c8-273e-4e59-bbcc-c5cd07f8aacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.448603 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfa7c8-273e-4e59-bbcc-c5cd07f8aacf admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.449244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfa7c8-273e-4e59-bbcc-c5cd07f8aacf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:54.450838 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddfa7c8-273e-4e59-bbcc-c5cd07f8aacf admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:54.461221 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1057/2118] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:54.462545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7acb4-bd9b-4c8f-ab5a-06d61d3afe78 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.462899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7acb4-bd9b-4c8f-ab5a-06d61d3afe78 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.463192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7acb4-bd9b-4c8f-ab5a-06d61d3afe78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.484562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-23d7acb4-bd9b-4c8f-ab5a-06d61d3afe78 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:54.485784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-23d7acb4-bd9b-4c8f-ab5a-06d61d3afe78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:54.494009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1058/2119] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:54.494761 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7acb4-bd9b-4c8f-ab5a-06d61d3afe78 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:54.495996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-23d7acb4-bd9b-4c8f-ab5a-06d61d3afe78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:54.507862 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1062/2120] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:54 2022] DELETE /identity/v3/users/79efbaa088344cf3b6382de6b4f8f5e2 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:54.509144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a239b-5ee0-45e1-8cab-51d1fbf0e850 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.509425 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a239b-5ee0-45e1-8cab-51d1fbf0e850 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.509695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a239b-5ee0-45e1-8cab-51d1fbf0e850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.511339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7acb4-bd9b-4c8f-ab5a-06d61d3afe78 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:54.531603 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1d8a239b-5ee0-45e1-8cab-51d1fbf0e850 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:54.532863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1d8a239b-5ee0-45e1-8cab-51d1fbf0e850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:54.571601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10468e0f-4bad-4bb0-8e14-f476deb6f1a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:54.572195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10468e0f-4bad-4bb0-8e14-f476deb6f1a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.572475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10468e0f-4bad-4bb0-8e14-f476deb6f1a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.572748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10468e0f-4bad-4bb0-8e14-f476deb6f1a1 admin admin] PATH_INFO: `/v3/projects/1826f04264b442689d9b9c77589f1b62/users/6e76e7429258478fa04115d7c12d17f6/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.584336 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:54.587964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10468e0f-4bad-4bb0-8e14-f476deb6f1a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1826f04264b442689d9b9c77589f1b62, user_id=6e76e7429258478fa04115d7c12d17f6, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:54.593523 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10468e0f-4bad-4bb0-8e14-f476deb6f1a1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:54.595411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:54.599091 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1063/2121] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:54.600662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1f8d5-5172-4fa8-937c-f00590996121 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.601021 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1f8d5-5172-4fa8-937c-f00590996121 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.601312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1f8d5-5172-4fa8-937c-f00590996121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.620684 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8bb1f8d5-5172-4fa8-937c-f00590996121 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:54.621872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8bb1f8d5-5172-4fa8-937c-f00590996121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:54.631281 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1064/2122] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:54.632771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1f8d5-5172-4fa8-937c-f00590996121 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:54.642080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1f8d5-5172-4fa8-937c-f00590996121 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:54.646592 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16849a22-97b5-4539-8a47-82320e5b14b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:54.647836 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849a22-97b5-4539-8a47-82320e5b14b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.648243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849a22-97b5-4539-8a47-82320e5b14b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.648515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16849a22-97b5-4539-8a47-82320e5b14b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.649195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16849a22-97b5-4539-8a47-82320e5b14b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:54.649492 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16849a22-97b5-4539-8a47-82320e5b14b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:54.650832 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1059/2123] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:54 2022] PUT /identity/v3/projects/1826f04264b442689d9b9c77589f1b62/users/6e76e7429258478fa04115d7c12d17f6/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:54.651089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16849a22-97b5-4539-8a47-82320e5b14b8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:54.651584 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10468e0f-4bad-4bb0-8e14-f476deb6f1a1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:54.665361 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-10468e0f-4bad-4bb0-8e14-f476deb6f1a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:54.665838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1065/2124] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:54.670985 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98768844-6df4-4ad5-a512-7df7cc528986 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.671159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98768844-6df4-4ad5-a512-7df7cc528986 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.671351 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98768844-6df4-4ad5-a512-7df7cc528986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.699988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-98768844-6df4-4ad5-a512-7df7cc528986 None None] MFA Rules not processed for user `6e76e7429258478fa04115d7c12d17f6`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:54.701189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-98768844-6df4-4ad5-a512-7df7cc528986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:54.728427 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10468e0f-4bad-4bb0-8e14-f476deb6f1a1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:54.732374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af663151-37c8-4430-8df9-5dd895b947c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:54.732989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af663151-37c8-4430-8df9-5dd895b947c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.733278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af663151-37c8-4430-8df9-5dd895b947c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.733546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af663151-37c8-4430-8df9-5dd895b947c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.766074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1066/2125] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:54.766732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98768844-6df4-4ad5-a512-7df7cc528986 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:54.796687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af663151-37c8-4430-8df9-5dd895b947c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:54.798147 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af663151-37c8-4430-8df9-5dd895b947c9 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:54.808099 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1060/2126] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:54.809041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af663151-37c8-4430-8df9-5dd895b947c9 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:54.810366 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-af663151-37c8-4430-8df9-5dd895b947c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:54.837852 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98768844-6df4-4ad5-a512-7df7cc528986 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:54.843318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932037-83c1-40d2-ac54-31da16f5ffff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:54.844043 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932037-83c1-40d2-ac54-31da16f5ffff admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.844326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932037-83c1-40d2-ac54-31da16f5ffff admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.844597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92932037-83c1-40d2-ac54-31da16f5ffff admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.845393 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92932037-83c1-40d2-ac54-31da16f5ffff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:54.847428 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92932037-83c1-40d2-ac54-31da16f5ffff admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:54.877666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af663151-37c8-4430-8df9-5dd895b947c9 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:54.882008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a54f1-aab4-4f95-8d16-41577ef0bd27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:54.882653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a54f1-aab4-4f95-8d16-41577ef0bd27 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.882935 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a54f1-aab4-4f95-8d16-41577ef0bd27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.883209 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415a54f1-aab4-4f95-8d16-41577ef0bd27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.891931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a54f1-aab4-4f95-8d16-41577ef0bd27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:54.893665 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415a54f1-aab4-4f95-8d16-41577ef0bd27 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:54.906474 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1061/2127] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:54.924959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a54f1-aab4-4f95-8d16-41577ef0bd27 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:54.935926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415a54f1-aab4-4f95-8d16-41577ef0bd27 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:54.938191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1067/2128] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:54 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:54.941036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932037-83c1-40d2-ac54-31da16f5ffff admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:54.958476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:54.993703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:54.996982 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970cab8-5564-4a95-b245-3efcdc81e01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:54.997607 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970cab8-5564-4a95-b245-3efcdc81e01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:54.997885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970cab8-5564-4a95-b245-3efcdc81e01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:54.998159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970cab8-5564-4a95-b245-3efcdc81e01d admin admin] PATH_INFO: `/v3/users/6e76e7429258478fa04115d7c12d17f6` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:54.999306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970cab8-5564-4a95-b245-3efcdc81e01d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e76e7429258478fa04115d7c12d17f6)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:55.001557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970cab8-5564-4a95-b245-3efcdc81e01d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:55.005514 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92932037-83c1-40d2-ac54-31da16f5ffff admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:55.011822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b0daa-4bf1-4f94-a377-5a423a43ba02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:55.012190 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b0daa-4bf1-4f94-a377-5a423a43ba02 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.012471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b0daa-4bf1-4f94-a377-5a423a43ba02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.017453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6b0daa-4bf1-4f94-a377-5a423a43ba02 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.017453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b0daa-4bf1-4f94-a377-5a423a43ba02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:55.017453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6b0daa-4bf1-4f94-a377-5a423a43ba02 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:55.228878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1068/2129] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:54 2022] POST /identity/v3/users => generated 288 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:55.229969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b0daa-4bf1-4f94-a377-5a423a43ba02 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:55.250625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6b0daa-4bf1-4f94-a377-5a423a43ba02 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:55.264930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d0afc-adca-4eed-8b1a-d3319ab885ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:55.265051 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8970cab8-5564-4a95-b245-3efcdc81e01d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e76e7429258478fa04115d7c12d17f6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.265134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d0afc-adca-4eed-8b1a-d3319ab885ee admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.265236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8970cab8-5564-4a95-b245-3efcdc81e01d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e76e7429258478fa04115d7c12d17f6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.265428 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d0afc-adca-4eed-8b1a-d3319ab885ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.265428 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d0afc-adca-4eed-8b1a-d3319ab885ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.265568 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8970cab8-5564-4a95-b245-3efcdc81e01d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e76e7429258478fa04115d7c12d17f6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.265754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d0afc-adca-4eed-8b1a-d3319ab885ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:55.265754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d0afc-adca-4eed-8b1a-d3319ab885ee admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:55.265941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8970cab8-5564-4a95-b245-3efcdc81e01d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e76e7429258478fa04115d7c12d17f6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.277263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8970cab8-5564-4a95-b245-3efcdc81e01d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e76e7429258478fa04115d7c12d17f6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.296272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1069/2130] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:55.297135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d0afc-adca-4eed-8b1a-d3319ab885ee admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:55.298970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4a9d0afc-adca-4eed-8b1a-d3319ab885ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:55.313916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d0afc-adca-4eed-8b1a-d3319ab885ee admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:55.320820 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:55.321210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.321486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.321758 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] PATH_INFO: `/v3/projects/105a5aaecfac4453b0f02baf78c58806` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.322968 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] RBAC: Authorizing `identity:delete_project(project_id=105a5aaecfac4453b0f02baf78c58806)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:55.324977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:55.358874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1062/2131] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:54 2022] DELETE /identity/v3/users/6e76e7429258478fa04115d7c12d17f6 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:55.359779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970cab8-5564-4a95-b245-3efcdc81e01d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:55.361158 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8970cab8-5564-4a95-b245-3efcdc81e01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:55.428714 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970cab8-5564-4a95-b245-3efcdc81e01d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:55.433555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e9868-2a23-403d-bba5-807ec269ae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:55.434159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e9868-2a23-403d-bba5-807ec269ae16 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.434438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e9868-2a23-403d-bba5-807ec269ae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.435122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e9868-2a23-403d-bba5-807ec269ae16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.435346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e9868-2a23-403d-bba5-807ec269ae16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:55.437278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e9868-2a23-403d-bba5-807ec269ae16 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:55.448140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1063/2132] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:55 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:09:55.449360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf6707-538d-4df4-b679-06fa0d220ccd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.449646 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf6707-538d-4df4-b679-06fa0d220ccd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.449917 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabf6707-538d-4df4-b679-06fa0d220ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.454039 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '105a5aaecfac4453b0f02baf78c58806', 'request_id': 'req-8590a5ce-3e1b-4829-920c-415aa1804248'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.461460 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '105a5aaecfac4453b0f02baf78c58806', 'request_id': 'req-8590a5ce-3e1b-4829-920c-415aa1804248'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.467341 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '105a5aaecfac4453b0f02baf78c58806', 'request_id': 'req-8590a5ce-3e1b-4829-920c-415aa1804248'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.468553 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fabf6707-538d-4df4-b679-06fa0d220ccd None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:55.469754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fabf6707-538d-4df4-b679-06fa0d220ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:55.497944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:55.528266 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1064/2133] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:55.529071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf6707-538d-4df4-b679-06fa0d220ccd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:55.538877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabf6707-538d-4df4-b679-06fa0d220ccd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:55.543579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745b9ef-6571-4ebe-bce2-0af1dca1cf3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:55.544297 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745b9ef-6571-4ebe-bce2-0af1dca1cf3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.544577 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745b9ef-6571-4ebe-bce2-0af1dca1cf3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.544845 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745b9ef-6571-4ebe-bce2-0af1dca1cf3a admin admin] PATH_INFO: `/v3/projects/d7e8f39f5c62479f8b9d27757bdf7e5b/users/e1dbb6f7758e47728bc7da60ed1e2486/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.559105 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745b9ef-6571-4ebe-bce2-0af1dca1cf3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7e8f39f5c62479f8b9d27757bdf7e5b, user_id=e1dbb6f7758e47728bc7da60ed1e2486, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:55.562055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745b9ef-6571-4ebe-bce2-0af1dca1cf3a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:55.574689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] The token cache is being invalidate because project 105a5aaecfac4453b0f02baf78c58806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:55.574993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.575641 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.577166 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1070/2134] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:55 2022] DELETE /identity/v3/projects/105a5aaecfac4453b0f02baf78c58806 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:55.578021 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:55.579279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:55.636292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8590a5ce-3e1b-4829-920c-415aa1804248 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:55.639940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cf0765-905c-480b-9792-3b05fe7d5b43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:55.640538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf0765-905c-480b-9792-3b05fe7d5b43 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.640816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf0765-905c-480b-9792-3b05fe7d5b43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.641085 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cf0765-905c-480b-9792-3b05fe7d5b43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.642885 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e2cf0765-905c-480b-9792-3b05fe7d5b43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:55.655287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf0765-905c-480b-9792-3b05fe7d5b43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:55.657174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cf0765-905c-480b-9792-3b05fe7d5b43 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:55.661263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1065/2135] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:55 2022] PUT /identity/v3/projects/d7e8f39f5c62479f8b9d27757bdf7e5b/users/e1dbb6f7758e47728bc7da60ed1e2486/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:55.670869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745b9ef-6571-4ebe-bce2-0af1dca1cf3a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:55.670869 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d745b9ef-6571-4ebe-bce2-0af1dca1cf3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:55.676486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1071/2136] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:55.677854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cfb9-ea03-4f75-a30d-727c102f446b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.678144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cfb9-ea03-4f75-a30d-727c102f446b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.678432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8cfb9-ea03-4f75-a30d-727c102f446b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.707547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-52d8cfb9-ea03-4f75-a30d-727c102f446b None None] MFA Rules not processed for user `e1dbb6f7758e47728bc7da60ed1e2486`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:55.708801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-52d8cfb9-ea03-4f75-a30d-727c102f446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:55.740926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745b9ef-6571-4ebe-bce2-0af1dca1cf3a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:55.747213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689525c-901c-4e00-ae3b-a1598707b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:55.748129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689525c-901c-4e00-ae3b-a1598707b447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.748513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689525c-901c-4e00-ae3b-a1598707b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.748890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689525c-901c-4e00-ae3b-a1598707b447 admin admin] PATH_INFO: `/v3/users/6d8f28b09b244102b31913dafc93b133` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.750202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689525c-901c-4e00-ae3b-a1598707b447 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d8f28b09b244102b31913dafc93b133)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:55.752282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689525c-901c-4e00-ae3b-a1598707b447 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:55.758791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:55.781102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1072/2137] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:55.785439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8cfb9-ea03-4f75-a30d-727c102f446b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:55.786785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-52d8cfb9-ea03-4f75-a30d-727c102f446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:55.800408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8cfb9-ea03-4f75-a30d-727c102f446b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:55.805040 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e779b-25fc-43f3-a776-1b6338fea106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:55.805620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e779b-25fc-43f3-a776-1b6338fea106 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.805895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e779b-25fc-43f3-a776-1b6338fea106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.806164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e779b-25fc-43f3-a776-1b6338fea106 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.806773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e779b-25fc-43f3-a776-1b6338fea106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:55.808670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1e779b-25fc-43f3-a776-1b6338fea106 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:55.891721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1073/2138] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:55 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:55.894397 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e779b-25fc-43f3-a776-1b6338fea106 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:55.961821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e779b-25fc-43f3-a776-1b6338fea106 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:55.967614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee93c2-226d-4294-aa6c-3717ee4ac826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:55.968376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee93c2-226d-4294-aa6c-3717ee4ac826 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:55.968713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee93c2-226d-4294-aa6c-3717ee4ac826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:55.968977 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9689525c-901c-4e00-ae3b-a1598707b447 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d8f28b09b244102b31913dafc93b133'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.972287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee93c2-226d-4294-aa6c-3717ee4ac826 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:55.972287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee93c2-226d-4294-aa6c-3717ee4ac826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:55.972674 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9689525c-901c-4e00-ae3b-a1598707b447 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d8f28b09b244102b31913dafc93b133'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.972674 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9689525c-901c-4e00-ae3b-a1598707b447 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d8f28b09b244102b31913dafc93b133'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.972846 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee93c2-226d-4294-aa6c-3717ee4ac826 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:55.979212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9689525c-901c-4e00-ae3b-a1598707b447 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d8f28b09b244102b31913dafc93b133'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:55.992019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9689525c-901c-4e00-ae3b-a1598707b447 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d8f28b09b244102b31913dafc93b133'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.061510 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1074/2139] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:55 2022] POST /identity/v3/users => generated 293 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:56.065357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee93c2-226d-4294-aa6c-3717ee4ac826 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:56.066950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5bee93c2-226d-4294-aa6c-3717ee4ac826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:56.079524 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee93c2-226d-4294-aa6c-3717ee4ac826 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:56.086146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f68c4-8c0f-491a-b151-ce2adf10cff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:56.086735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f68c4-8c0f-491a-b151-ce2adf10cff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.087013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f68c4-8c0f-491a-b151-ce2adf10cff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.087280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f68c4-8c0f-491a-b151-ce2adf10cff7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.087967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f68c4-8c0f-491a-b151-ce2adf10cff7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:56.089512 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f68c4-8c0f-491a-b151-ce2adf10cff7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:56.090771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1066/2140] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:55 2022] DELETE /identity/v3/users/6d8f28b09b244102b31913dafc93b133 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:56.101004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1075/2141] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:56.105197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689525c-901c-4e00-ae3b-a1598707b447 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:56.136780 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:56.149841 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f68c4-8c0f-491a-b151-ce2adf10cff7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:56.151815 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9c8f68c4-8c0f-491a-b151-ce2adf10cff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:56.172983 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689525c-901c-4e00-ae3b-a1598707b447 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:56.177953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f68c4-8c0f-491a-b151-ce2adf10cff7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:56.179330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11b505-176d-456b-b476-c8c4e6633954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:56.180078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11b505-176d-456b-b476-c8c4e6633954 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.180367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11b505-176d-456b-b476-c8c4e6633954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.180757 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a11b505-176d-456b-b476-c8c4e6633954 admin admin] PATH_INFO: `/v3/projects/0cf910398c374eaea709156855b4dd32/users/dc6c455491f24cc59b7e59eb1973d70c/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.188802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:56.189727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.190124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.190620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263 admin admin] PATH_INFO: `/v3/projects/1826f04264b442689d9b9c77589f1b62` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.193046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1826f04264b442689d9b9c77589f1b62)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:56.195821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:56.199835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11b505-176d-456b-b476-c8c4e6633954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf910398c374eaea709156855b4dd32, user_id=dc6c455491f24cc59b7e59eb1973d70c, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:56.202625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a11b505-176d-456b-b476-c8c4e6633954 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:56.273085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1067/2142] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:56 2022] PUT /identity/v3/projects/0cf910398c374eaea709156855b4dd32/users/dc6c455491f24cc59b7e59eb1973d70c/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:56.276859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11b505-176d-456b-b476-c8c4e6633954 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:56.320789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1826f04264b442689d9b9c77589f1b62', 'request_id': 'req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.332015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1826f04264b442689d9b9c77589f1b62', 'request_id': 'req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.345729 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1826f04264b442689d9b9c77589f1b62', 'request_id': 'req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.369202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a11b505-176d-456b-b476-c8c4e6633954 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:56.436730 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263 admin admin] The token cache is being invalidate because project 1826f04264b442689d9b9c77589f1b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:56.436730 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.437666 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-938c44c8-f9d0-4ddb-bf9c-f7df8fabf263 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.438606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2188f8-0c2a-4537-b68d-f3f82c54aecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:56.439678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1076/2143] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:56 2022] DELETE /identity/v3/projects/1826f04264b442689d9b9c77589f1b62 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:56.440311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2188f8-0c2a-4537-b68d-f3f82c54aecc admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.440868 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2188f8-0c2a-4537-b68d-f3f82c54aecc admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.441451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2188f8-0c2a-4537-b68d-f3f82c54aecc admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.442264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2188f8-0c2a-4537-b68d-f3f82c54aecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:56.445375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb788a-f97f-4bb5-9809-c143bbbdfa22 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.445807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2188f8-0c2a-4537-b68d-f3f82c54aecc admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:56.445928 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb788a-f97f-4bb5-9809-c143bbbdfa22 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.446264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eb788a-f97f-4bb5-9809-c143bbbdfa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.463965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1068/2144] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:56 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:56.467207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2188f8-0c2a-4537-b68d-f3f82c54aecc admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:56.471873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-de2188f8-0c2a-4537-b68d-f3f82c54aecc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:56.477366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-45eb788a-f97f-4bb5-9809-c143bbbdfa22 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:56.478719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-45eb788a-f97f-4bb5-9809-c143bbbdfa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:56.487187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2188f8-0c2a-4537-b68d-f3f82c54aecc admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:56.489089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1077/2145] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:56.495173 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f6084-3a5c-4165-a5be-df30f549d0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:56.496579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f6084-3a5c-4165-a5be-df30f549d0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.496793 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92012b62-beab-487c-a38b-3852a10b8ead None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.496916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f6084-3a5c-4165-a5be-df30f549d0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.497196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f6084-3a5c-4165-a5be-df30f549d0a2 admin admin] PATH_INFO: `/v3/projects/0cf910398c374eaea709156855b4dd32/users/dc6c455491f24cc59b7e59eb1973d70c/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.497300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92012b62-beab-487c-a38b-3852a10b8ead None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.497918 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92012b62-beab-487c-a38b-3852a10b8ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.499272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f6084-3a5c-4165-a5be-df30f549d0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf910398c374eaea709156855b4dd32, user_id=dc6c455491f24cc59b7e59eb1973d70c, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:56.502062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f6084-3a5c-4165-a5be-df30f549d0a2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:56.513847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1069/2146] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:56 2022] PUT /identity/v3/projects/0cf910398c374eaea709156855b4dd32/users/dc6c455491f24cc59b7e59eb1973d70c/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:56.521291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-92012b62-beab-487c-a38b-3852a10b8ead None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:56.522761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-92012b62-beab-487c-a38b-3852a10b8ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:56.525258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d1f5a-6348-4246-994b-583a5bdb13c4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.525542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d1f5a-6348-4246-994b-583a5bdb13c4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.525814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d1f5a-6348-4246-994b-583a5bdb13c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.535787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:56.554642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ea2d1f5a-6348-4246-994b-583a5bdb13c4 None None] MFA Rules not processed for user `dc6c455491f24cc59b7e59eb1973d70c`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:56.556096 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ea2d1f5a-6348-4246-994b-583a5bdb13c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:56.592036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1078/2147] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:56.597003 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92012b62-beab-487c-a38b-3852a10b8ead None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:56.597003 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-92012b62-beab-487c-a38b-3852a10b8ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:56.608596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92012b62-beab-487c-a38b-3852a10b8ead None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:56.613422 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:56.614164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.614391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.614658 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] PATH_INFO: `/v3/projects/0b517860f1fc49839a211f49ab7c5c3b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.616451 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b517860f1fc49839a211f49ab7c5c3b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:56.618333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:56.636312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1070/2148] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:56.637117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d1f5a-6348-4246-994b-583a5bdb13c4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:56.650470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d1f5a-6348-4246-994b-583a5bdb13c4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:56.655097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616c0b2-da50-49dd-bd87-b1acb2ed1333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:56.655643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616c0b2-da50-49dd-bd87-b1acb2ed1333 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.655965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616c0b2-da50-49dd-bd87-b1acb2ed1333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.656241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616c0b2-da50-49dd-bd87-b1acb2ed1333 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.656891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616c0b2-da50-49dd-bd87-b1acb2ed1333 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:56.657194 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616c0b2-da50-49dd-bd87-b1acb2ed1333 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:56.658771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616c0b2-da50-49dd-bd87-b1acb2ed1333 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:56.671053 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1071/2149] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:56.671944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616c0b2-da50-49dd-bd87-b1acb2ed1333 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:56.673532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8616c0b2-da50-49dd-bd87-b1acb2ed1333 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:56.713967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b517860f1fc49839a211f49ab7c5c3b', 'request_id': 'req-17fb0691-af89-437a-b3e4-6675ffcf6041'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.720144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b517860f1fc49839a211f49ab7c5c3b', 'request_id': 'req-17fb0691-af89-437a-b3e4-6675ffcf6041'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.726267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b517860f1fc49839a211f49ab7c5c3b', 'request_id': 'req-17fb0691-af89-437a-b3e4-6675ffcf6041'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.732401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616c0b2-da50-49dd-bd87-b1acb2ed1333 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:56.780680 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dc203e-57dd-47d2-a742-6c17e45c37fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:56.781285 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc203e-57dd-47d2-a742-6c17e45c37fa service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.781561 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc203e-57dd-47d2-a742-6c17e45c37fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.781833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dc203e-57dd-47d2-a742-6c17e45c37fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.783577 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b8dc203e-57dd-47d2-a742-6c17e45c37fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:56.792216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] The token cache is being invalidate because project 0b517860f1fc49839a211f49ab7c5c3b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:56.792504 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.793146 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:56.794649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1079/2150] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:56 2022] DELETE /identity/v3/projects/0b517860f1fc49839a211f49ab7c5c3b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:56.795375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:56.796807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:56.844749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc203e-57dd-47d2-a742-6c17e45c37fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:56.846181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dc203e-57dd-47d2-a742-6c17e45c37fa service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:56.856594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1072/2151] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:56.857996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee279a5-9f5c-42cd-93a5-5c1cf208066a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.858282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee279a5-9f5c-42cd-93a5-5c1cf208066a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.859181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee279a5-9f5c-42cd-93a5-5c1cf208066a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.862457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb0691-af89-437a-b3e4-6675ffcf6041 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:56.872219 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb6157-73df-4c68-b65f-2c1f96734c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:56.872219 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb6157-73df-4c68-b65f-2c1f96734c40 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.872219 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb6157-73df-4c68-b65f-2c1f96734c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.872219 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb6157-73df-4c68-b65f-2c1f96734c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.872582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb6157-73df-4c68-b65f-2c1f96734c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:56.873307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb6157-73df-4c68-b65f-2c1f96734c40 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:56.881249 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4ee279a5-9f5c-42cd-93a5-5c1cf208066a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:56.882627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4ee279a5-9f5c-42cd-93a5-5c1cf208066a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:56.892574 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:56.894492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1073/2152] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:56.901893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6814e1-f81c-48ef-b7b2-d2e7baa157a5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.906381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6814e1-f81c-48ef-b7b2-d2e7baa157a5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.906381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6814e1-f81c-48ef-b7b2-d2e7baa157a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.922136 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fd6814e1-f81c-48ef-b7b2-d2e7baa157a5 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:56.923370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fd6814e1-f81c-48ef-b7b2-d2e7baa157a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:56.933156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1074/2153] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:56.936366 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6814e1-f81c-48ef-b7b2-d2e7baa157a5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:56.945731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6814e1-f81c-48ef-b7b2-d2e7baa157a5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:56.952392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528aeec-1a16-4911-ac58-0e92717deccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:56.953070 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528aeec-1a16-4911-ac58-0e92717deccd admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.953357 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528aeec-1a16-4911-ac58-0e92717deccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.953632 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0528aeec-1a16-4911-ac58-0e92717deccd admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.954403 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528aeec-1a16-4911-ac58-0e92717deccd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:56.954712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528aeec-1a16-4911-ac58-0e92717deccd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:56.956364 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0528aeec-1a16-4911-ac58-0e92717deccd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:56.969462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1075/2154] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:56.973982 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528aeec-1a16-4911-ac58-0e92717deccd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:56.985209 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0528aeec-1a16-4911-ac58-0e92717deccd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:56.993858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72717be-1d79-4d9e-981f-d7625b3ba2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:56.994680 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72717be-1d79-4d9e-981f-d7625b3ba2f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:56.994965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72717be-1d79-4d9e-981f-d7625b3ba2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:56.998337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72717be-1d79-4d9e-981f-d7625b3ba2f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:56.998337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72717be-1d79-4d9e-981f-d7625b3ba2f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:56.998618 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1080/2155] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:56 2022] POST /identity/v3/projects => generated 359 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:56.998618 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb6157-73df-4c68-b65f-2c1f96734c40 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:56.998782 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72717be-1d79-4d9e-981f-d7625b3ba2f3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.063087 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb6157-73df-4c68-b65f-2c1f96734c40 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.067945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d9798-34d9-4681-94b0-4000fbb7a7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.068554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9798-34d9-4681-94b0-4000fbb7a7ea admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.069455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9798-34d9-4681-94b0-4000fbb7a7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.069811 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9798-34d9-4681-94b0-4000fbb7a7ea admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.070439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d9798-34d9-4681-94b0-4000fbb7a7ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.072784 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d9798-34d9-4681-94b0-4000fbb7a7ea admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.104625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1076/2156] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:56 2022] POST /identity/v3/projects => generated 391 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:57.108468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72717be-1d79-4d9e-981f-d7625b3ba2f3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.169145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72717be-1d79-4d9e-981f-d7625b3ba2f3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.174039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f135b-46c3-4a17-96d0-b0d5308ecb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.174667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f135b-46c3-4a17-96d0-b0d5308ecb95 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.174948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f135b-46c3-4a17-96d0-b0d5308ecb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.175222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f135b-46c3-4a17-96d0-b0d5308ecb95 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.175855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f135b-46c3-4a17-96d0-b0d5308ecb95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.177857 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f135b-46c3-4a17-96d0-b0d5308ecb95 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.216236 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1081/2157] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:56 2022] POST /identity/v3/users => generated 280 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:57.220397 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d9798-34d9-4681-94b0-4000fbb7a7ea admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.230407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d9798-34d9-4681-94b0-4000fbb7a7ea admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.235566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2864c2-a05a-4acd-af09-373e720ed1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.236208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2864c2-a05a-4acd-af09-373e720ed1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.236580 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2864c2-a05a-4acd-af09-373e720ed1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.236864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2864c2-a05a-4acd-af09-373e720ed1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.237503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2864c2-a05a-4acd-af09-373e720ed1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.239114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2864c2-a05a-4acd-af09-373e720ed1e0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.249488 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1082/2158] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:57.253611 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2864c2-a05a-4acd-af09-373e720ed1e0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.263346 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2864c2-a05a-4acd-af09-373e720ed1e0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.268047 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3b5dc-45e1-45b2-b1ee-9b1bd844b697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.268618 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3b5dc-45e1-45b2-b1ee-9b1bd844b697 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.268902 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3b5dc-45e1-45b2-b1ee-9b1bd844b697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.269171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f3b5dc-45e1-45b2-b1ee-9b1bd844b697 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.269790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3b5dc-45e1-45b2-b1ee-9b1bd844b697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.271392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f3b5dc-45e1-45b2-b1ee-9b1bd844b697 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.282381 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1083/2159] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:57.286935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3b5dc-45e1-45b2-b1ee-9b1bd844b697 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.296035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1077/2160] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:57 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:57.297731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f3b5dc-45e1-45b2-b1ee-9b1bd844b697 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.302118 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f135b-46c3-4a17-96d0-b0d5308ecb95 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.304137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43be2f-16be-4ee8-b686-faec4312565c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.304823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43be2f-16be-4ee8-b686-faec4312565c admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.305147 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43be2f-16be-4ee8-b686-faec4312565c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.305412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43be2f-16be-4ee8-b686-faec4312565c admin admin] PATH_INFO: `/v3/projects/6180f7d2effc4c28982ef19964a9a487/users/3081866d65324d26bc8e47d976c92d67/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.312385 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f135b-46c3-4a17-96d0-b0d5308ecb95 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.317655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523079b-37df-444a-aac3-39a9917d3ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.319382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523079b-37df-444a-aac3-39a9917d3ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.320032 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523079b-37df-444a-aac3-39a9917d3ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.320287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:57.320580 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523079b-37df-444a-aac3-39a9917d3ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.322126 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523079b-37df-444a-aac3-39a9917d3ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.323736 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43be2f-16be-4ee8-b686-faec4312565c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6180f7d2effc4c28982ef19964a9a487, user_id=3081866d65324d26bc8e47d976c92d67, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.324201 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523079b-37df-444a-aac3-39a9917d3ecd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.326507 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43be2f-16be-4ee8-b686-faec4312565c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.336283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1078/2161] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:57.340244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523079b-37df-444a-aac3-39a9917d3ecd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.349676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523079b-37df-444a-aac3-39a9917d3ecd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.354616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ed5bd-20d7-448a-bdbc-36dff0518fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.355199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ed5bd-20d7-448a-bdbc-36dff0518fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.355477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ed5bd-20d7-448a-bdbc-36dff0518fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.355780 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ed5bd-20d7-448a-bdbc-36dff0518fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.356643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ed5bd-20d7-448a-bdbc-36dff0518fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.362446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ed5bd-20d7-448a-bdbc-36dff0518fe9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.370059 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1079/2162] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:57.374359 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ed5bd-20d7-448a-bdbc-36dff0518fe9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.388840 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ed5bd-20d7-448a-bdbc-36dff0518fe9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.393630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae5427-c8a9-4c7d-9927-1d8ac50c609f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.394459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae5427-c8a9-4c7d-9927-1d8ac50c609f admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.394736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae5427-c8a9-4c7d-9927-1d8ac50c609f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.395005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae5427-c8a9-4c7d-9927-1d8ac50c609f admin admin] PATH_INFO: `/v3/projects/4387658ad69c445a868103b4847cca18/users/f30c6f642be3433fa6bcb5bbb4bb7b7e/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.410525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae5427-c8a9-4c7d-9927-1d8ac50c609f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4387658ad69c445a868103b4847cca18, user_id=f30c6f642be3433fa6bcb5bbb4bb7b7e, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.413536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae5427-c8a9-4c7d-9927-1d8ac50c609f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.432771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:57.432965 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1084/2163] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:57 2022] PUT /identity/v3/projects/6180f7d2effc4c28982ef19964a9a487/users/3081866d65324d26bc8e47d976c92d67/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:57.444587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6707b-2020-43a3-bd0c-0aafc4fbcaf9 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.444875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6707b-2020-43a3-bd0c-0aafc4fbcaf9 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.445151 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f6707b-2020-43a3-bd0c-0aafc4fbcaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.467401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1080/2164] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:57 2022] PUT /identity/v3/projects/4387658ad69c445a868103b4847cca18/users/f30c6f642be3433fa6bcb5bbb4bb7b7e/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:57.473294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e7f6707b-2020-43a3-bd0c-0aafc4fbcaf9 None None] MFA Rules not processed for user `3081866d65324d26bc8e47d976c92d67`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:57.474502 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e7f6707b-2020-43a3-bd0c-0aafc4fbcaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:57.478601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec94ef-e04c-45ae-9698-81fa0cec7c32 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.478885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec94ef-e04c-45ae-9698-81fa0cec7c32 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.479154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ec94ef-e04c-45ae-9698-81fa0cec7c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.508223 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-04ec94ef-e04c-45ae-9698-81fa0cec7c32 None None] MFA Rules not processed for user `f30c6f642be3433fa6bcb5bbb4bb7b7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:57.509458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-04ec94ef-e04c-45ae-9698-81fa0cec7c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:57.579891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1085/2165] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:57.619058 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1081/2166] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:57 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:57.622408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6707b-2020-43a3-bd0c-0aafc4fbcaf9 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.626812 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e7f6707b-2020-43a3-bd0c-0aafc4fbcaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:57.629021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec94ef-e04c-45ae-9698-81fa0cec7c32 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.672042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:57.706060 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ec94ef-e04c-45ae-9698-81fa0cec7c32 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.711482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181d0a4-4abe-4082-a783-60a6bd227387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.712068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f6707b-2020-43a3-bd0c-0aafc4fbcaf9 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.712178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181d0a4-4abe-4082-a783-60a6bd227387 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.712384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181d0a4-4abe-4082-a783-60a6bd227387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.712655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181d0a4-4abe-4082-a783-60a6bd227387 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.713278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181d0a4-4abe-4082-a783-60a6bd227387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.715837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d5ae-7bac-4490-993d-81e63cac9989 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.716475 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d5ae-7bac-4490-993d-81e63cac9989 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.716752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d5ae-7bac-4490-993d-81e63cac9989 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.716845 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181d0a4-4abe-4082-a783-60a6bd227387 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.717026 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94d5ae-7bac-4490-993d-81e63cac9989 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.728044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94d5ae-7bac-4490-993d-81e63cac9989 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.729527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94d5ae-7bac-4490-993d-81e63cac9989 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.739790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1086/2167] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:57.756628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d5ae-7bac-4490-993d-81e63cac9989 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.767636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94d5ae-7bac-4490-993d-81e63cac9989 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.773197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db5084-43cb-4d75-b0d8-64457eecc49c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.773820 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db5084-43cb-4d75-b0d8-64457eecc49c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.774093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db5084-43cb-4d75-b0d8-64457eecc49c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.774358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db5084-43cb-4d75-b0d8-64457eecc49c admin admin] PATH_INFO: `/v3/users/3081866d65324d26bc8e47d976c92d67` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.775676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db5084-43cb-4d75-b0d8-64457eecc49c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3081866d65324d26bc8e47d976c92d67)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.777634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1db5084-43cb-4d75-b0d8-64457eecc49c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.804209 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1082/2168] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:57 2022] POST /identity/v3/projects => generated 391 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:57.808310 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181d0a4-4abe-4082-a783-60a6bd227387 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:57.868616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181d0a4-4abe-4082-a783-60a6bd227387 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:57.873321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f51e-1c43-4851-9cd0-7d1c3d532432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:57.873928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f51e-1c43-4851-9cd0-7d1c3d532432 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:57.874210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f51e-1c43-4851-9cd0-7d1c3d532432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:57.877793 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b55f51e-1c43-4851-9cd0-7d1c3d532432 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:57.877793 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55f51e-1c43-4851-9cd0-7d1c3d532432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:57.877793 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b55f51e-1c43-4851-9cd0-7d1c3d532432 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:57.998071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1083/2169] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:57 2022] POST /identity/v3/users => generated 302 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:09:58.001923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f51e-1c43-4851-9cd0-7d1c3d532432 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:58.011734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b55f51e-1c43-4851-9cd0-7d1c3d532432 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:58.016728 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a215f1-fe21-446f-ba84-0838eb1e2cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:58.017347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a215f1-fe21-446f-ba84-0838eb1e2cb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.023085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a215f1-fe21-446f-ba84-0838eb1e2cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.023085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a215f1-fe21-446f-ba84-0838eb1e2cb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.023085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a215f1-fe21-446f-ba84-0838eb1e2cb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:58.023085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a215f1-fe21-446f-ba84-0838eb1e2cb8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:58.027869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c1db5084-43cb-4d75-b0d8-64457eecc49c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3081866d65324d26bc8e47d976c92d67'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:58.031033 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1084/2170] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:58.034936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a215f1-fe21-446f-ba84-0838eb1e2cb8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:58.043907 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c1db5084-43cb-4d75-b0d8-64457eecc49c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3081866d65324d26bc8e47d976c92d67'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:58.044655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c1db5084-43cb-4d75-b0d8-64457eecc49c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3081866d65324d26bc8e47d976c92d67'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:58.045251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a215f1-fe21-446f-ba84-0838eb1e2cb8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:58.045362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c1db5084-43cb-4d75-b0d8-64457eecc49c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3081866d65324d26bc8e47d976c92d67'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:58.049844 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e1444-6a2b-4a9c-8964-e58aeb689030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:58.050418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1444-6a2b-4a9c-8964-e58aeb689030 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.050698 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1444-6a2b-4a9c-8964-e58aeb689030 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.050970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1444-6a2b-4a9c-8964-e58aeb689030 admin admin] PATH_INFO: `/v3/projects/eb0fe78c58424a809c2da249be438374/users/f3735e0c12a7414b8ebba422c381d32e/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.052403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-c1db5084-43cb-4d75-b0d8-64457eecc49c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3081866d65324d26bc8e47d976c92d67'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:58.065520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e1444-6a2b-4a9c-8964-e58aeb689030 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0fe78c58424a809c2da249be438374, user_id=f3735e0c12a7414b8ebba422c381d32e, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:58.068172 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47e1444-6a2b-4a9c-8964-e58aeb689030 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:58.078398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:58.156632 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1087/2171] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:09:57 2022] DELETE /identity/v3/users/3081866d65324d26bc8e47d976c92d67 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:58.161109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e23c45-84f4-4303-a813-a03ecc51abfa None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.161421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e23c45-84f4-4303-a813-a03ecc51abfa None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.161695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e23c45-84f4-4303-a813-a03ecc51abfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.171307 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1085/2172] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:58 2022] PUT /identity/v3/projects/eb0fe78c58424a809c2da249be438374/users/f3735e0c12a7414b8ebba422c381d32e/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:09:58.175294 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e1444-6a2b-4a9c-8964-e58aeb689030 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:58.177497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a47e1444-6a2b-4a9c-8964-e58aeb689030 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:58.182312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-03e23c45-84f4-4303-a813-a03ecc51abfa None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:58.183721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-03e23c45-84f4-4303-a813-a03ecc51abfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:58.230837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:58.245238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1088/2173] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:58.247997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e1444-6a2b-4a9c-8964-e58aeb689030 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:58.252777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc994dfb-fb19-4ecb-918d-c37b18aa245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:58.253388 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc994dfb-fb19-4ecb-918d-c37b18aa245d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.253669 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc994dfb-fb19-4ecb-918d-c37b18aa245d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.254826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc994dfb-fb19-4ecb-918d-c37b18aa245d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.254942 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e23c45-84f4-4303-a813-a03ecc51abfa None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:58.255515 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc994dfb-fb19-4ecb-918d-c37b18aa245d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:58.256282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-03e23c45-84f4-4303-a813-a03ecc51abfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:58.257651 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc994dfb-fb19-4ecb-918d-c37b18aa245d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:58.268159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1086/2174] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:09:58.273314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc994dfb-fb19-4ecb-918d-c37b18aa245d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:58.283728 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc994dfb-fb19-4ecb-918d-c37b18aa245d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:58.290127 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597037c-9637-40d2-8483-b8f6bb278959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:58.290947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597037c-9637-40d2-8483-b8f6bb278959 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.291237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597037c-9637-40d2-8483-b8f6bb278959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.291520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597037c-9637-40d2-8483-b8f6bb278959 admin admin] PATH_INFO: `/v3/projects/eb0fe78c58424a809c2da249be438374/users/f3735e0c12a7414b8ebba422c381d32e/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.293542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597037c-9637-40d2-8483-b8f6bb278959 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0fe78c58424a809c2da249be438374, user_id=f3735e0c12a7414b8ebba422c381d32e, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:58.296254 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597037c-9637-40d2-8483-b8f6bb278959 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:58.317799 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1087/2175] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:09:58 2022] PUT /identity/v3/projects/eb0fe78c58424a809c2da249be438374/users/f3735e0c12a7414b8ebba422c381d32e/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:58.321560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ca1b1-6385-474f-91df-e729f460a7d2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.321560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ca1b1-6385-474f-91df-e729f460a7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.321560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868ca1b1-6385-474f-91df-e729f460a7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.321812 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e23c45-84f4-4303-a813-a03ecc51abfa None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:58.353601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-868ca1b1-6385-474f-91df-e729f460a7d2 None None] MFA Rules not processed for user `f3735e0c12a7414b8ebba422c381d32e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:58.354745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-868ca1b1-6385-474f-91df-e729f460a7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:58.356048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:58.386582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4e7e5-2495-4be5-bf4b-70651543fee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:58.387326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e7e5-2495-4be5-bf4b-70651543fee7 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.387607 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e7e5-2495-4be5-bf4b-70651543fee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.387949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d4e7e5-2495-4be5-bf4b-70651543fee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.432690 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1088/2176] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:58 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:58.446782 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ca1b1-6385-474f-91df-e729f460a7d2 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:58.448956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-868ca1b1-6385-474f-91df-e729f460a7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:58.466747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4e7e5-2495-4be5-bf4b-70651543fee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:58.469648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d4e7e5-2495-4be5-bf4b-70651543fee7 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:58.481272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1089/2177] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:09:58.518145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868ca1b1-6385-474f-91df-e729f460a7d2 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:58.522572 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bbb73-22a8-4c3a-bc13-46641b9e581f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:58.523506 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bbb73-22a8-4c3a-bc13-46641b9e581f service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.523802 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bbb73-22a8-4c3a-bc13-46641b9e581f service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.526974 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bbb73-22a8-4c3a-bc13-46641b9e581f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.533808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bbb73-22a8-4c3a-bc13-46641b9e581f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:58.535324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bbb73-22a8-4c3a-bc13-46641b9e581f service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:58.546358 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1089/2178] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:58 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:58.596037 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4e7e5-2495-4be5-bf4b-70651543fee7 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:58.597478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-07d4e7e5-2495-4be5-bf4b-70651543fee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:58.609390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d4e7e5-2495-4be5-bf4b-70651543fee7 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:58.615476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01b513c-1ce7-4bf7-95d8-defe48064066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:58.616651 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b513c-1ce7-4bf7-95d8-defe48064066 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:58.616927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b513c-1ce7-4bf7-95d8-defe48064066 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:58.617196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01b513c-1ce7-4bf7-95d8-defe48064066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:58.619138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c01b513c-1ce7-4bf7-95d8-defe48064066 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:58.684560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b513c-1ce7-4bf7-95d8-defe48064066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:58.686243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01b513c-1ce7-4bf7-95d8-defe48064066 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:58.696464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1090/2179] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:09:58 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:09:59.051394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bbb73-22a8-4c3a-bc13-46641b9e581f service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:59.054462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f00bbb73-22a8-4c3a-bc13-46641b9e581f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:59.071765 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bbb73-22a8-4c3a-bc13-46641b9e581f service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:59.084281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d579c00-87dd-4851-ab85-9c80f157d62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:59.084934 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d579c00-87dd-4851-ab85-9c80f157d62e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:59.085214 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d579c00-87dd-4851-ab85-9c80f157d62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:59.085490 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d579c00-87dd-4851-ab85-9c80f157d62e admin admin] PATH_INFO: `/v3/projects/6180f7d2effc4c28982ef19964a9a487` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:59.086654 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d579c00-87dd-4851-ab85-9c80f157d62e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6180f7d2effc4c28982ef19964a9a487)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:59.088613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d579c00-87dd-4851-ab85-9c80f157d62e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:59.227792 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1d579c00-87dd-4851-ab85-9c80f157d62e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6180f7d2effc4c28982ef19964a9a487', 'request_id': 'req-1d579c00-87dd-4851-ab85-9c80f157d62e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:59.233940 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1d579c00-87dd-4851-ab85-9c80f157d62e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6180f7d2effc4c28982ef19964a9a487', 'request_id': 'req-1d579c00-87dd-4851-ab85-9c80f157d62e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:59.235621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:59.346556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1d579c00-87dd-4851-ab85-9c80f157d62e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6180f7d2effc4c28982ef19964a9a487', 'request_id': 'req-1d579c00-87dd-4851-ab85-9c80f157d62e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:59.358039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1d579c00-87dd-4851-ab85-9c80f157d62e admin admin] The token cache is being invalidate because project 6180f7d2effc4c28982ef19964a9a487 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:09:59.358322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1d579c00-87dd-4851-ab85-9c80f157d62e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:59.358939 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1d579c00-87dd-4851-ab85-9c80f157d62e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:09:59.360527 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1090/2180] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:09:59 2022] DELETE /identity/v3/projects/6180f7d2effc4c28982ef19964a9a487 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:09:59.367695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789927-bffd-42c1-8cce-5dc0f0a6b00e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:59.368054 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789927-bffd-42c1-8cce-5dc0f0a6b00e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:59.368328 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789927-bffd-42c1-8cce-5dc0f0a6b00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:59.390432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1b789927-bffd-42c1-8cce-5dc0f0a6b00e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:59.391645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1b789927-bffd-42c1-8cce-5dc0f0a6b00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:59.458372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1091/2181] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:09:59.466429 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940c79-611f-4b5a-90e7-adce8a4515a3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:59.466960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940c79-611f-4b5a-90e7-adce8a4515a3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:59.467409 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33940c79-611f-4b5a-90e7-adce8a4515a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:59.625656 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-33940c79-611f-4b5a-90e7-adce8a4515a3 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:09:59.627180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-33940c79-611f-4b5a-90e7-adce8a4515a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:09:59.637800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1091/2182] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:09:59.642469 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b789927-bffd-42c1-8cce-5dc0f0a6b00e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:59.653873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b789927-bffd-42c1-8cce-5dc0f0a6b00e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:59.659168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065e6e2-a700-4228-a49e-2ac5fde816ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:59.659767 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e6e2-a700-4228-a49e-2ac5fde816ef admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:59.660072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e6e2-a700-4228-a49e-2ac5fde816ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:59.660338 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c065e6e2-a700-4228-a49e-2ac5fde816ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:59.660980 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065e6e2-a700-4228-a49e-2ac5fde816ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:09:59.661306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065e6e2-a700-4228-a49e-2ac5fde816ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:59.663576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c065e6e2-a700-4228-a49e-2ac5fde816ef admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:59.676056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1092/2183] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:09:59.681232 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33940c79-611f-4b5a-90e7-adce8a4515a3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:59.690721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33940c79-611f-4b5a-90e7-adce8a4515a3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:59.695748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ff8d-85a5-465f-b563-b42524cb11a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:59.696380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ff8d-85a5-465f-b563-b42524cb11a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:59.696657 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ff8d-85a5-465f-b563-b42524cb11a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:59.696923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0ff8d-85a5-465f-b563-b42524cb11a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:59.697539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0ff8d-85a5-465f-b563-b42524cb11a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:59.699403 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0ff8d-85a5-465f-b563-b42524cb11a4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:59.804743 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1092/2184] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:09:59 2022] POST /identity/v3/projects => generated 371 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:59.808902 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065e6e2-a700-4228-a49e-2ac5fde816ef admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:59.819614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c065e6e2-a700-4228-a49e-2ac5fde816ef admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:59.823474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:09:59.879448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6475ed-9ed6-4a05-8e4c-fc00534463b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:59.880853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6475ed-9ed6-4a05-8e4c-fc00534463b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:59.880853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6475ed-9ed6-4a05-8e4c-fc00534463b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:59.880853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6475ed-9ed6-4a05-8e4c-fc00534463b2 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:59.881477 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6475ed-9ed6-4a05-8e4c-fc00534463b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:59.883674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6475ed-9ed6-4a05-8e4c-fc00534463b2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:59.960230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1093/2185] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:09:59 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:09:59.963946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ff8d-85a5-465f-b563-b42524cb11a4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:09:59.975535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0ff8d-85a5-465f-b563-b42524cb11a4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:09:59.982399 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e42916-51ac-400f-a4fa-a849648dd6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:09:59.983106 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e42916-51ac-400f-a4fa-a849648dd6a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:09:59.983383 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e42916-51ac-400f-a4fa-a849648dd6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:09:59.983783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e42916-51ac-400f-a4fa-a849648dd6a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:09:59.984572 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e42916-51ac-400f-a4fa-a849648dd6a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:09:59.986301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e42916-51ac-400f-a4fa-a849648dd6a7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:09:59.997364 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1093/2186] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:00.002122 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6475ed-9ed6-4a05-8e4c-fc00534463b2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:00.013628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6475ed-9ed6-4a05-8e4c-fc00534463b2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:00.019007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd68f4c-354a-4618-8d7e-55339f77a0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:00.019620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd68f4c-354a-4618-8d7e-55339f77a0ba admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:00.019939 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd68f4c-354a-4618-8d7e-55339f77a0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:00.020211 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd68f4c-354a-4618-8d7e-55339f77a0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:00.020863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd68f4c-354a-4618-8d7e-55339f77a0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:00.023772 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd68f4c-354a-4618-8d7e-55339f77a0ba admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:00.040189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1094/2187] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:00.041375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e42916-51ac-400f-a4fa-a849648dd6a7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:00.052581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e42916-51ac-400f-a4fa-a849648dd6a7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:00.058063 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951d3cd-6ed4-4dc3-b704-71b4a4246000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:00.058872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951d3cd-6ed4-4dc3-b704-71b4a4246000 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:00.059222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951d3cd-6ed4-4dc3-b704-71b4a4246000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:00.059519 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d951d3cd-6ed4-4dc3-b704-71b4a4246000 admin admin] PATH_INFO: `/v3/projects/863f81350f5f41ae9da94bcf285833d6/users/fa8e5c4f16184f8fbfce978037029582/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:00.075732 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951d3cd-6ed4-4dc3-b704-71b4a4246000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=863f81350f5f41ae9da94bcf285833d6, user_id=fa8e5c4f16184f8fbfce978037029582, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:00.078554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d951d3cd-6ed4-4dc3-b704-71b4a4246000 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:00.194142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1094/2188] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:00 2022] PUT /identity/v3/projects/863f81350f5f41ae9da94bcf285833d6/users/fa8e5c4f16184f8fbfce978037029582/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:00.198816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54ac7a-51fa-4621-a9d6-d1064bf89460 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:00.199400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54ac7a-51fa-4621-a9d6-d1064bf89460 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:00.199676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c54ac7a-51fa-4621-a9d6-d1064bf89460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:00.200268 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951d3cd-6ed4-4dc3-b704-71b4a4246000 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:00.202036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d951d3cd-6ed4-4dc3-b704-71b4a4246000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:00.219095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7c54ac7a-51fa-4621-a9d6-d1064bf89460 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:00.220409 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7c54ac7a-51fa-4621-a9d6-d1064bf89460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:00.266087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d951d3cd-6ed4-4dc3-b704-71b4a4246000 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:00.269831 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5630114-5ab2-450e-96f5-41cb89c03c7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:00.270440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5630114-5ab2-450e-96f5-41cb89c03c7e service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:00.270718 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5630114-5ab2-450e-96f5-41cb89c03c7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:00.270994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5630114-5ab2-450e-96f5-41cb89c03c7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:00.274642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c5630114-5ab2-450e-96f5-41cb89c03c7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:00.284420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1095/2189] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:00.295525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54ac7a-51fa-4621-a9d6-d1064bf89460 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:00.297064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7c54ac7a-51fa-4621-a9d6-d1064bf89460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:00.349453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5630114-5ab2-450e-96f5-41cb89c03c7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:00.351268 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5630114-5ab2-450e-96f5-41cb89c03c7e service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:00.356486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c54ac7a-51fa-4621-a9d6-d1064bf89460 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:00.361574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ec489-ae4a-427b-8169-44be1c113854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:00.362337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ec489-ae4a-427b-8169-44be1c113854 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:00.362617 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ec489-ae4a-427b-8169-44be1c113854 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:00.362887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ec489-ae4a-427b-8169-44be1c113854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:00.363196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1095/2190] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:00.372927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ec489-ae4a-427b-8169-44be1c113854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:00.374477 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ec489-ae4a-427b-8169-44be1c113854 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:00.392061 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1096/2191] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:04.133939 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5630114-5ab2-450e-96f5-41cb89c03c7e service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:04.135599 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c5630114-5ab2-450e-96f5-41cb89c03c7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:04.155654 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5630114-5ab2-450e-96f5-41cb89c03c7e service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:04.164180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67829eb2-d527-4020-97fc-56b172a3a141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:04.165584 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829eb2-d527-4020-97fc-56b172a3a141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:04.165960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829eb2-d527-4020-97fc-56b172a3a141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:04.166951 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67829eb2-d527-4020-97fc-56b172a3a141 admin admin] PATH_INFO: `/v3/users/f30c6f642be3433fa6bcb5bbb4bb7b7e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:04.168611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67829eb2-d527-4020-97fc-56b172a3a141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30c6f642be3433fa6bcb5bbb4bb7b7e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:04.170632 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67829eb2-d527-4020-97fc-56b172a3a141 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:04.202805 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=3,keystone:DELETE=7,keystone:SELECT=90 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:04.462553 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-67829eb2-d527-4020-97fc-56b172a3a141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30c6f642be3433fa6bcb5bbb4bb7b7e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:04.463378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-67829eb2-d527-4020-97fc-56b172a3a141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30c6f642be3433fa6bcb5bbb4bb7b7e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:04.464187 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-67829eb2-d527-4020-97fc-56b172a3a141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30c6f642be3433fa6bcb5bbb4bb7b7e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:04.487197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-67829eb2-d527-4020-97fc-56b172a3a141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30c6f642be3433fa6bcb5bbb4bb7b7e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:04.508243 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-67829eb2-d527-4020-97fc-56b172a3a141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30c6f642be3433fa6bcb5bbb4bb7b7e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:04.593003 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1096/2192] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:04 2022] DELETE /identity/v3/users/f30c6f642be3433fa6bcb5bbb4bb7b7e => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:04.594774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beb737-b402-4df1-ac45-8860811f2fe5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:04.595709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beb737-b402-4df1-ac45-8860811f2fe5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:04.595986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0beb737-b402-4df1-ac45-8860811f2fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:04.627214 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c0beb737-b402-4df1-ac45-8860811f2fe5 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:04.628971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c0beb737-b402-4df1-ac45-8860811f2fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:04.666048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:04.728297 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1097/2193] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:04.741664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67829eb2-d527-4020-97fc-56b172a3a141 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:04.743548 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-67829eb2-d527-4020-97fc-56b172a3a141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:04.816955 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67829eb2-d527-4020-97fc-56b172a3a141 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:04.826848 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417a3f4-9a60-474e-ace1-f891447bcaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:04.827779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417a3f4-9a60-474e-ace1-f891447bcaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:04.828273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417a3f4-9a60-474e-ace1-f891447bcaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:04.828793 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417a3f4-9a60-474e-ace1-f891447bcaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:04.842605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417a3f4-9a60-474e-ace1-f891447bcaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:04.844766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417a3f4-9a60-474e-ace1-f891447bcaf0 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:04.858000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1097/2194] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:05.310066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beb737-b402-4df1-ac45-8860811f2fe5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:05.312148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c0beb737-b402-4df1-ac45-8860811f2fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:05.340280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0beb737-b402-4df1-ac45-8860811f2fe5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:05.351352 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:05.352217 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:05.352570 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:05.352985 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] PATH_INFO: `/v3/projects/4387658ad69c445a868103b4847cca18` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:05.354256 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4387658ad69c445a868103b4847cca18)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:05.357051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:05.509371 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4387658ad69c445a868103b4847cca18', 'request_id': 'req-411123c9-575d-4cc9-9eac-a6a2570ba9d0'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:05.518888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4387658ad69c445a868103b4847cca18', 'request_id': 'req-411123c9-575d-4cc9-9eac-a6a2570ba9d0'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:05.527345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4387658ad69c445a868103b4847cca18', 'request_id': 'req-411123c9-575d-4cc9-9eac-a6a2570ba9d0'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:05.620710 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] The token cache is being invalidate because project 4387658ad69c445a868103b4847cca18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:05.621390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:05.621823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:05.623616 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1098/2195] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:05 2022] DELETE /identity/v3/projects/4387658ad69c445a868103b4847cca18 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:05.627370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417a3f4-9a60-474e-ace1-f891447bcaf0 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:05.637128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417a3f4-9a60-474e-ace1-f891447bcaf0 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:05.710760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792043a-b7b9-4a62-a01d-3b1f3655aa77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:05.711529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792043a-b7b9-4a62-a01d-3b1f3655aa77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:05.711963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792043a-b7b9-4a62-a01d-3b1f3655aa77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:05.716482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792043a-b7b9-4a62-a01d-3b1f3655aa77 admin admin] PATH_INFO: `/v3/users/f3735e0c12a7414b8ebba422c381d32e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:05.716482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792043a-b7b9-4a62-a01d-3b1f3655aa77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3735e0c12a7414b8ebba422c381d32e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:05.719394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792043a-b7b9-4a62-a01d-3b1f3655aa77 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:06.036596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:06.039217 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f792043a-b7b9-4a62-a01d-3b1f3655aa77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3735e0c12a7414b8ebba422c381d32e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.040039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f792043a-b7b9-4a62-a01d-3b1f3655aa77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3735e0c12a7414b8ebba422c381d32e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.041551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f792043a-b7b9-4a62-a01d-3b1f3655aa77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3735e0c12a7414b8ebba422c381d32e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.050241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f792043a-b7b9-4a62-a01d-3b1f3655aa77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3735e0c12a7414b8ebba422c381d32e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.066323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f792043a-b7b9-4a62-a01d-3b1f3655aa77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3735e0c12a7414b8ebba422c381d32e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.171270 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1098/2196] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:05 2022] DELETE /identity/v3/users/f3735e0c12a7414b8ebba422c381d32e => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:06.479464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:06.481190 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:06.504160 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411123c9-575d-4cc9-9eac-a6a2570ba9d0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:06.639154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667f3c81-fdf4-422b-9433-bb0b7b38f62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:06.639822 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f3c81-fdf4-422b-9433-bb0b7b38f62b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:06.640128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f3c81-fdf4-422b-9433-bb0b7b38f62b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:06.640395 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667f3c81-fdf4-422b-9433-bb0b7b38f62b admin admin] PATH_INFO: `/v3/users/de944fe62c994fb88b2e79a1b2767d62` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:06.641586 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f3c81-fdf4-422b-9433-bb0b7b38f62b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de944fe62c994fb88b2e79a1b2767d62)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:06.643501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667f3c81-fdf4-422b-9433-bb0b7b38f62b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:06.895252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-667f3c81-fdf4-422b-9433-bb0b7b38f62b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de944fe62c994fb88b2e79a1b2767d62'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.907464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:06.917662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792043a-b7b9-4a62-a01d-3b1f3655aa77 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:06.923197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f792043a-b7b9-4a62-a01d-3b1f3655aa77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:06.945080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-667f3c81-fdf4-422b-9433-bb0b7b38f62b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de944fe62c994fb88b2e79a1b2767d62'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.947221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-667f3c81-fdf4-422b-9433-bb0b7b38f62b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de944fe62c994fb88b2e79a1b2767d62'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.949470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-667f3c81-fdf4-422b-9433-bb0b7b38f62b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de944fe62c994fb88b2e79a1b2767d62'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.954139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792043a-b7b9-4a62-a01d-3b1f3655aa77 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:06.961650 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-667f3c81-fdf4-422b-9433-bb0b7b38f62b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de944fe62c994fb88b2e79a1b2767d62'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:06.971940 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:06.972714 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:06.973113 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:06.973473 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] PATH_INFO: `/v3/projects/eb0fe78c58424a809c2da249be438374` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:06.975263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb0fe78c58424a809c2da249be438374)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:06.977270 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.026527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1099/2197] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:06 2022] DELETE /identity/v3/users/de944fe62c994fb88b2e79a1b2767d62 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:07.027917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc5a57-03f6-402a-87fe-41fc956da773 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.028210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc5a57-03f6-402a-87fe-41fc956da773 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.028486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffc5a57-03f6-402a-87fe-41fc956da773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.056626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3ffc5a57-03f6-402a-87fe-41fc956da773 None None] MFA Rules not processed for user `fa8e5c4f16184f8fbfce978037029582`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:07.057855 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3ffc5a57-03f6-402a-87fe-41fc956da773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:07.074129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb0fe78c58424a809c2da249be438374', 'request_id': 'req-5b87c81c-1271-463e-924b-4bf0aa91e75f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:07.082319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb0fe78c58424a809c2da249be438374', 'request_id': 'req-5b87c81c-1271-463e-924b-4bf0aa91e75f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:07.127289 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1100/2198] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:07.128578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02e168-ae9d-4f01-b72b-dedebcc6883c None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.128862 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02e168-ae9d-4f01-b72b-dedebcc6883c None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.129135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a02e168-ae9d-4f01-b72b-dedebcc6883c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.139188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb0fe78c58424a809c2da249be438374', 'request_id': 'req-5b87c81c-1271-463e-924b-4bf0aa91e75f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:07.149726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6a02e168-ae9d-4f01-b72b-dedebcc6883c None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:07.151109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6a02e168-ae9d-4f01-b72b-dedebcc6883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:07.152223 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] The token cache is being invalidate because project eb0fe78c58424a809c2da249be438374 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:07.152510 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:07.153166 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:07.154671 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1099/2199] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:06 2022] DELETE /identity/v3/projects/eb0fe78c58424a809c2da249be438374 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:07.155407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.157247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:07.229477 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1101/2200] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:07.230769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5031c6c-31d4-42f6-83a7-8309b2dbd8d4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.231049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5031c6c-31d4-42f6-83a7-8309b2dbd8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.231318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5031c6c-31d4-42f6-83a7-8309b2dbd8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.239119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b87c81c-1271-463e-924b-4bf0aa91e75f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.244847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ec1ac-65b6-4a57-ae7d-02f5be1de178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.245497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ec1ac-65b6-4a57-ae7d-02f5be1de178 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.246120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ec1ac-65b6-4a57-ae7d-02f5be1de178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.246404 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ec1ac-65b6-4a57-ae7d-02f5be1de178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.247039 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ec1ac-65b6-4a57-ae7d-02f5be1de178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.248975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678ec1ac-65b6-4a57-ae7d-02f5be1de178 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.252217 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b5031c6c-31d4-42f6-83a7-8309b2dbd8d4 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:07.253426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b5031c6c-31d4-42f6-83a7-8309b2dbd8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:07.261732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1102/2201] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:07.262600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5031c6c-31d4-42f6-83a7-8309b2dbd8d4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.263916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b5031c6c-31d4-42f6-83a7-8309b2dbd8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:07.319645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5031c6c-31d4-42f6-83a7-8309b2dbd8d4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.323387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e4892-8ac3-48b7-9c76-940345b89393 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.324027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e4892-8ac3-48b7-9c76-940345b89393 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.324303 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e4892-8ac3-48b7-9c76-940345b89393 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.324713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e4892-8ac3-48b7-9c76-940345b89393 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.335544 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e4892-8ac3-48b7-9c76-940345b89393 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.337155 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e4892-8ac3-48b7-9c76-940345b89393 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.348005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1103/2202] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:07.349337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898f34-a3d8-41e6-8d2b-4b2109716ffa None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.350187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898f34-a3d8-41e6-8d2b-4b2109716ffa None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.350577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38898f34-a3d8-41e6-8d2b-4b2109716ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.365829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:07.379684 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1100/2203] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:07 2022] POST /identity/v3/projects => generated 371 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:07.385340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-38898f34-a3d8-41e6-8d2b-4b2109716ffa None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:07.385728 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ec1ac-65b6-4a57-ae7d-02f5be1de178 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.389320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-38898f34-a3d8-41e6-8d2b-4b2109716ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:07.463648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:07.497038 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1104/2204] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:07.500319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678ec1ac-65b6-4a57-ae7d-02f5be1de178 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.501494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38898f34-a3d8-41e6-8d2b-4b2109716ffa None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.504999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a183d-5979-4343-a6e0-2afe2506298b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.505642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a183d-5979-4343-a6e0-2afe2506298b admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.505924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a183d-5979-4343-a6e0-2afe2506298b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.506198 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513a183d-5979-4343-a6e0-2afe2506298b admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.506817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a183d-5979-4343-a6e0-2afe2506298b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.508776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513a183d-5979-4343-a6e0-2afe2506298b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.510899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38898f34-a3d8-41e6-8d2b-4b2109716ffa None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.516009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605d02d-366e-4e21-9e76-cf521a4b5e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.516613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605d02d-366e-4e21-9e76-cf521a4b5e5b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.516891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605d02d-366e-4e21-9e76-cf521a4b5e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.517162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605d02d-366e-4e21-9e76-cf521a4b5e5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.517805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605d02d-366e-4e21-9e76-cf521a4b5e5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:07.518108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605d02d-366e-4e21-9e76-cf521a4b5e5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.519720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7605d02d-366e-4e21-9e76-cf521a4b5e5b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.536012 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1105/2205] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:10:07.538036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605d02d-366e-4e21-9e76-cf521a4b5e5b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.554003 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7605d02d-366e-4e21-9e76-cf521a4b5e5b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.559474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fd348-9d26-45f7-96d8-b711d54b19a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.560378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd348-9d26-45f7-96d8-b711d54b19a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.560660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd348-9d26-45f7-96d8-b711d54b19a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.560962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fd348-9d26-45f7-96d8-b711d54b19a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.561597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fd348-9d26-45f7-96d8-b711d54b19a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.563491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fd348-9d26-45f7-96d8-b711d54b19a3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.585168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1101/2206] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:07 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:07.586145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a183d-5979-4343-a6e0-2afe2506298b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.596808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513a183d-5979-4343-a6e0-2afe2506298b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.610621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426111c6-b248-4c56-846e-065ed0016e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.611135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426111c6-b248-4c56-846e-065ed0016e8b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.611459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426111c6-b248-4c56-846e-065ed0016e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.611732 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426111c6-b248-4c56-846e-065ed0016e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.612435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426111c6-b248-4c56-846e-065ed0016e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.617279 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426111c6-b248-4c56-846e-065ed0016e8b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.629185 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1102/2207] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:07.633884 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426111c6-b248-4c56-846e-065ed0016e8b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.644132 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426111c6-b248-4c56-846e-065ed0016e8b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.650429 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81692300-a039-4a49-9962-57c01a9a0abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.651194 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81692300-a039-4a49-9962-57c01a9a0abb admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.651582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81692300-a039-4a49-9962-57c01a9a0abb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.651977 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81692300-a039-4a49-9962-57c01a9a0abb admin admin] PATH_INFO: `/v3/projects/915ac5a7ebe8451c942e84ef6f90951e/users/38d60ba32bd9479496672d28925631d7/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.670080 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81692300-a039-4a49-9962-57c01a9a0abb admin admin] RBAC: Authorizing `identity:create_grant(project_id=915ac5a7ebe8451c942e84ef6f90951e, user_id=38d60ba32bd9479496672d28925631d7, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.673392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1106/2208] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:07 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:07.676443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81692300-a039-4a49-9962-57c01a9a0abb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.678463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fd348-9d26-45f7-96d8-b711d54b19a3 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.750060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fd348-9d26-45f7-96d8-b711d54b19a3 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.754703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe5980-48d0-4ed3-9803-d0df9c0308c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.755310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5980-48d0-4ed3-9803-d0df9c0308c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.755608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5980-48d0-4ed3-9803-d0df9c0308c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.756049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe5980-48d0-4ed3-9803-d0df9c0308c8 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.756672 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe5980-48d0-4ed3-9803-d0df9c0308c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.758563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe5980-48d0-4ed3-9803-d0df9c0308c8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.762923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1103/2209] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:07 2022] PUT /identity/v3/projects/915ac5a7ebe8451c942e84ef6f90951e/users/38d60ba32bd9479496672d28925631d7/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:07.776263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81692300-a039-4a49-9962-57c01a9a0abb admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.857954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81692300-a039-4a49-9962-57c01a9a0abb admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.863244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129312a-5305-41dd-a08e-c209540c9fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.864020 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129312a-5305-41dd-a08e-c209540c9fb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.864366 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129312a-5305-41dd-a08e-c209540c9fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.864758 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e129312a-5305-41dd-a08e-c209540c9fb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.865507 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129312a-5305-41dd-a08e-c209540c9fb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.867243 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e129312a-5305-41dd-a08e-c209540c9fb8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.882129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1104/2211] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:07.883606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129312a-5305-41dd-a08e-c209540c9fb8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.885064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1107/2211] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:07 2022] POST /identity/v3/users => generated 294 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:07.886429 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e129312a-5305-41dd-a08e-c209540c9fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:07.886674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe5980-48d0-4ed3-9803-d0df9c0308c8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.902230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe5980-48d0-4ed3-9803-d0df9c0308c8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.902457 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e129312a-5305-41dd-a08e-c209540c9fb8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.908494 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a1949a-b2f2-4e07-8e93-da78426e3d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.909302 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1949a-b2f2-4e07-8e93-da78426e3d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.909585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1949a-b2f2-4e07-8e93-da78426e3d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.909910 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a1949a-b2f2-4e07-8e93-da78426e3d7c admin admin] PATH_INFO: `/v3/projects/2b4f73ce37fb40f38e6f9b2617c6c948` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.911103 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1949a-b2f2-4e07-8e93-da78426e3d7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b4f73ce37fb40f38e6f9b2617c6c948)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.912825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e9194-7a0c-44f3-b547-8414b9ffff56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.913609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a1949a-b2f2-4e07-8e93-da78426e3d7c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.913940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e9194-7a0c-44f3-b547-8414b9ffff56 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.914412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e9194-7a0c-44f3-b547-8414b9ffff56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.922028 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e9194-7a0c-44f3-b547-8414b9ffff56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.922028 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e9194-7a0c-44f3-b547-8414b9ffff56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.922028 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e9194-7a0c-44f3-b547-8414b9ffff56 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.935267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1108/2212] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:07.939641 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e9194-7a0c-44f3-b547-8414b9ffff56 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:07.952721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e9194-7a0c-44f3-b547-8414b9ffff56 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:07.957811 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f12d3-7550-49ff-b7da-ab91ac9bc23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:07.958475 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f12d3-7550-49ff-b7da-ab91ac9bc23d admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:07.958803 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f12d3-7550-49ff-b7da-ab91ac9bc23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:07.959099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47f12d3-7550-49ff-b7da-ab91ac9bc23d admin admin] PATH_INFO: `/v3/projects/915ac5a7ebe8451c942e84ef6f90951e/users/38d60ba32bd9479496672d28925631d7/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:07.961576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f12d3-7550-49ff-b7da-ab91ac9bc23d admin admin] RBAC: Authorizing `identity:create_grant(project_id=915ac5a7ebe8451c942e84ef6f90951e, user_id=38d60ba32bd9479496672d28925631d7, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:07.965710 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47f12d3-7550-49ff-b7da-ab91ac9bc23d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:07.984125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1109/2213] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:07 2022] PUT /identity/v3/projects/915ac5a7ebe8451c942e84ef6f90951e/users/38d60ba32bd9479496672d28925631d7/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:07.985048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f12d3-7550-49ff-b7da-ab91ac9bc23d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.036760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-47a1949a-b2f2-4e07-8e93-da78426e3d7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b4f73ce37fb40f38e6f9b2617c6c948', 'request_id': 'req-47a1949a-b2f2-4e07-8e93-da78426e3d7c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:08.045648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-47a1949a-b2f2-4e07-8e93-da78426e3d7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b4f73ce37fb40f38e6f9b2617c6c948', 'request_id': 'req-47a1949a-b2f2-4e07-8e93-da78426e3d7c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:08.058332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:08.087621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47f12d3-7550-49ff-b7da-ab91ac9bc23d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.157682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-47a1949a-b2f2-4e07-8e93-da78426e3d7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b4f73ce37fb40f38e6f9b2617c6c948', 'request_id': 'req-47a1949a-b2f2-4e07-8e93-da78426e3d7c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:08.184178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-47a1949a-b2f2-4e07-8e93-da78426e3d7c admin admin] The token cache is being invalidate because project 2b4f73ce37fb40f38e6f9b2617c6c948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:08.184178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-47a1949a-b2f2-4e07-8e93-da78426e3d7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:08.184178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-47a1949a-b2f2-4e07-8e93-da78426e3d7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:08.184178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1105/2214] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:07 2022] DELETE /identity/v3/projects/2b4f73ce37fb40f38e6f9b2617c6c948 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:08.188197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecb682-2f6b-4bc0-b1c8-ac118c7d3526 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.188490 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecb682-2f6b-4bc0-b1c8-ac118c7d3526 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.188763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cecb682-2f6b-4bc0-b1c8-ac118c7d3526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.200045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:08.200951 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaebec3-ee69-4b2a-8d32-90a3475d4e12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.201585 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaebec3-ee69-4b2a-8d32-90a3475d4e12 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.201858 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaebec3-ee69-4b2a-8d32-90a3475d4e12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.202123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaebec3-ee69-4b2a-8d32-90a3475d4e12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.202768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaebec3-ee69-4b2a-8d32-90a3475d4e12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.208526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaebec3-ee69-4b2a-8d32-90a3475d4e12 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.215119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6cecb682-2f6b-4bc0-b1c8-ac118c7d3526 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:08.216354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6cecb682-2f6b-4bc0-b1c8-ac118c7d3526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:08.221406 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1110/2215] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:07 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:08.225283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1106/2216] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:08.229288 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecb682-2f6b-4bc0-b1c8-ac118c7d3526 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.232183 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6cecb682-2f6b-4bc0-b1c8-ac118c7d3526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:08.232788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da2f98-3913-4f82-ae94-c23f96f2be15 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.233143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da2f98-3913-4f82-ae94-c23f96f2be15 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.233488 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da2f98-3913-4f82-ae94-c23f96f2be15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.244271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cecb682-2f6b-4bc0-b1c8-ac118c7d3526 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.249186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c91db-cc04-4bad-b1ff-c7d76a324d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.258959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c91db-cc04-4bad-b1ff-c7d76a324d25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.258959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c91db-cc04-4bad-b1ff-c7d76a324d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.258959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c91db-cc04-4bad-b1ff-c7d76a324d25 admin admin] PATH_INFO: `/v3/projects/15521b4834794bca855f9d18d19a38ec/users/d0b21fe42ff74e41ab05b28c9da18399/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.259281 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e6da2f98-3913-4f82-ae94-c23f96f2be15 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:08.259281 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e6da2f98-3913-4f82-ae94-c23f96f2be15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:08.266419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c91db-cc04-4bad-b1ff-c7d76a324d25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15521b4834794bca855f9d18d19a38ec, user_id=d0b21fe42ff74e41ab05b28c9da18399, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.267893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1111/2217] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:08.269439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c91db-cc04-4bad-b1ff-c7d76a324d25 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.271713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da2f98-3913-4f82-ae94-c23f96f2be15 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.281733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da2f98-3913-4f82-ae94-c23f96f2be15 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.287551 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bd26d-5951-4fa2-bd1e-8ae15944f8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.288228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bd26d-5951-4fa2-bd1e-8ae15944f8fc admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.288506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bd26d-5951-4fa2-bd1e-8ae15944f8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.288777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05bd26d-5951-4fa2-bd1e-8ae15944f8fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.289425 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bd26d-5951-4fa2-bd1e-8ae15944f8fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:08.289731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bd26d-5951-4fa2-bd1e-8ae15944f8fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.291322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05bd26d-5951-4fa2-bd1e-8ae15944f8fc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.303838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1112/2218] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:10:08.308131 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bd26d-5951-4fa2-bd1e-8ae15944f8fc admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.318420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05bd26d-5951-4fa2-bd1e-8ae15944f8fc admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.323586 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2e0db-c6b6-459c-9769-a6962402ea8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.324224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2e0db-c6b6-459c-9769-a6962402ea8d admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.324507 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2e0db-c6b6-459c-9769-a6962402ea8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.324776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2e0db-c6b6-459c-9769-a6962402ea8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.325397 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2e0db-c6b6-459c-9769-a6962402ea8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.327255 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2e0db-c6b6-459c-9769-a6962402ea8d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.392408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1107/2219] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:08 2022] PUT /identity/v3/projects/15521b4834794bca855f9d18d19a38ec/users/d0b21fe42ff74e41ab05b28c9da18399/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:08.404014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdb5da-6b2f-4d21-b03c-8d6448d8ad2a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.404302 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdb5da-6b2f-4d21-b03c-8d6448d8ad2a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.404894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fdb5da-6b2f-4d21-b03c-8d6448d8ad2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.441588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1113/2220] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:08 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:08.445860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2e0db-c6b6-459c-9769-a6962402ea8d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.463271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-74fdb5da-6b2f-4d21-b03c-8d6448d8ad2a None None] MFA Rules not processed for user `d0b21fe42ff74e41ab05b28c9da18399`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:08.468950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-74fdb5da-6b2f-4d21-b03c-8d6448d8ad2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:08.564423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2e0db-c6b6-459c-9769-a6962402ea8d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.569446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c014d6-d3e2-4f64-a401-755e3b4827ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.572044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c014d6-d3e2-4f64-a401-755e3b4827ba admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.572044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c014d6-d3e2-4f64-a401-755e3b4827ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.572044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c014d6-d3e2-4f64-a401-755e3b4827ba admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.572044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c014d6-d3e2-4f64-a401-755e3b4827ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.573376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c014d6-d3e2-4f64-a401-755e3b4827ba admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.575413 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1108/2221] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:08.576647 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdb5da-6b2f-4d21-b03c-8d6448d8ad2a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.591874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fdb5da-6b2f-4d21-b03c-8d6448d8ad2a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.596911 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214e559-cfff-4871-8bb0-9a8b02415aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.597553 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214e559-cfff-4871-8bb0-9a8b02415aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.597833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214e559-cfff-4871-8bb0-9a8b02415aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.598108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f214e559-cfff-4871-8bb0-9a8b02415aa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.598735 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214e559-cfff-4871-8bb0-9a8b02415aa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.601627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f214e559-cfff-4871-8bb0-9a8b02415aa0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.644722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1114/2222] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:08 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:08.648921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c014d6-d3e2-4f64-a401-755e3b4827ba admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.661496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c014d6-d3e2-4f64-a401-755e3b4827ba admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.668797 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb86a7-5787-4d8e-9f22-6f6c4784d40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.675197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb86a7-5787-4d8e-9f22-6f6c4784d40b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.675197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb86a7-5787-4d8e-9f22-6f6c4784d40b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.675197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb86a7-5787-4d8e-9f22-6f6c4784d40b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.675197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb86a7-5787-4d8e-9f22-6f6c4784d40b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.675197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfb86a7-5787-4d8e-9f22-6f6c4784d40b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.686333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1115/2223] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:08.690372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb86a7-5787-4d8e-9f22-6f6c4784d40b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.700620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfb86a7-5787-4d8e-9f22-6f6c4784d40b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.707340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2a8bb-bcf5-4bd6-8d8d-2f2aab358c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.708254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2a8bb-bcf5-4bd6-8d8d-2f2aab358c16 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.708797 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2a8bb-bcf5-4bd6-8d8d-2f2aab358c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.709322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2a8bb-bcf5-4bd6-8d8d-2f2aab358c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.709947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1109/2224] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:08 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:08.710435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2a8bb-bcf5-4bd6-8d8d-2f2aab358c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.712124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2a8bb-bcf5-4bd6-8d8d-2f2aab358c16 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.714024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214e559-cfff-4871-8bb0-9a8b02415aa0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.736020 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:08.747974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1116/2225] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:08.755336 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2a8bb-bcf5-4bd6-8d8d-2f2aab358c16 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.770092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2a8bb-bcf5-4bd6-8d8d-2f2aab358c16 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.804488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f214e559-cfff-4871-8bb0-9a8b02415aa0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.810488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d7b17-306b-4662-80e1-c5f9169ac7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.814499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d7b17-306b-4662-80e1-c5f9169ac7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.814499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d7b17-306b-4662-80e1-c5f9169ac7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.814499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736d7b17-306b-4662-80e1-c5f9169ac7d4 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.814499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d7b17-306b-4662-80e1-c5f9169ac7d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.816149 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736d7b17-306b-4662-80e1-c5f9169ac7d4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.863320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff3ac5-fd41-4fbe-915c-81e7107964a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:08.864418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff3ac5-fd41-4fbe-915c-81e7107964a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.864418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff3ac5-fd41-4fbe-915c-81e7107964a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.866279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff3ac5-fd41-4fbe-915c-81e7107964a6 admin admin] PATH_INFO: `/v3/projects/2d87b90c7bc4449aab2819709471e0ba/users/24c7d365f77347e9908484902b13650a/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.883344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff3ac5-fd41-4fbe-915c-81e7107964a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d87b90c7bc4449aab2819709471e0ba, user_id=24c7d365f77347e9908484902b13650a, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:08.886237 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff3ac5-fd41-4fbe-915c-81e7107964a6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:08.925900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1110/2226] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:08 2022] POST /identity/v3/users => generated 300 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:08.930603 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d7b17-306b-4662-80e1-c5f9169ac7d4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:08.949692 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736d7b17-306b-4662-80e1-c5f9169ac7d4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:08.953032 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1117/2227] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:08 2022] PUT /identity/v3/projects/2d87b90c7bc4449aab2819709471e0ba/users/24c7d365f77347e9908484902b13650a/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:08.962379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c203a8-5651-4ccd-936f-d9fe809fd959 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:08.968542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c203a8-5651-4ccd-936f-d9fe809fd959 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:08.968660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c203a8-5651-4ccd-936f-d9fe809fd959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:08.994479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-39c203a8-5651-4ccd-936f-d9fe809fd959 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:08.995806 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-39c203a8-5651-4ccd-936f-d9fe809fd959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:09.032900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcad600-ae6c-4051-a41b-c6d70cf0106d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:09.033607 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcad600-ae6c-4051-a41b-c6d70cf0106d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.034005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcad600-ae6c-4051-a41b-c6d70cf0106d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.034628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcad600-ae6c-4051-a41b-c6d70cf0106d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.035720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcad600-ae6c-4051-a41b-c6d70cf0106d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:09.037843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcad600-ae6c-4051-a41b-c6d70cf0106d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:09.056568 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1111/2228] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:09.060886 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcad600-ae6c-4051-a41b-c6d70cf0106d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:09.085493 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcad600-ae6c-4051-a41b-c6d70cf0106d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:09.097133 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb4eb4-62c1-4530-a210-6de047864014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:09.099149 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4eb4-62c1-4530-a210-6de047864014 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.102753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4eb4-62c1-4530-a210-6de047864014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.103478 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb4eb4-62c1-4530-a210-6de047864014 admin admin] PATH_INFO: `/v3/projects/a050615938f544eb9955f9eaf42d749b/users/3c1663ee67914729816f648b325da41d/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.107291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:09.129341 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1118/2229] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:09.140523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c203a8-5651-4ccd-936f-d9fe809fd959 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:09.143752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-39c203a8-5651-4ccd-936f-d9fe809fd959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:09.148387 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb4eb4-62c1-4530-a210-6de047864014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a050615938f544eb9955f9eaf42d749b, user_id=3c1663ee67914729816f648b325da41d, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:09.156583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb4eb4-62c1-4530-a210-6de047864014 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:09.221542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c203a8-5651-4ccd-936f-d9fe809fd959 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:09.226738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b2468-6927-48ee-919e-c9a2791d9e10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:09.227359 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b2468-6927-48ee-919e-c9a2791d9e10 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.227640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b2468-6927-48ee-919e-c9a2791d9e10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.227943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3b2468-6927-48ee-919e-c9a2791d9e10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.238114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b2468-6927-48ee-919e-c9a2791d9e10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:09.239614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3b2468-6927-48ee-919e-c9a2791d9e10 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:09.253667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1119/2230] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:09.291456 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1112/2231] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:09 2022] PUT /identity/v3/projects/a050615938f544eb9955f9eaf42d749b/users/3c1663ee67914729816f648b325da41d/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:09.296818 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b2468-6927-48ee-919e-c9a2791d9e10 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:09.314747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3b2468-6927-48ee-919e-c9a2791d9e10 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:09.349432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:09.405798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c039f575-5aec-40b6-a52c-2adec57bd2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:09.406801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039f575-5aec-40b6-a52c-2adec57bd2d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.407220 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039f575-5aec-40b6-a52c-2adec57bd2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.407513 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c039f575-5aec-40b6-a52c-2adec57bd2d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.408499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039f575-5aec-40b6-a52c-2adec57bd2d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:09.411207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c039f575-5aec-40b6-a52c-2adec57bd2d5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:09.428464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1120/2232] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:09.431171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb4eb4-62c1-4530-a210-6de047864014 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:09.442287 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb4eb4-62c1-4530-a210-6de047864014 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:09.447620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a7516-9999-4634-9463-a80aa6c2a1e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:09.448338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a7516-9999-4634-9463-a80aa6c2a1e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.448847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a7516-9999-4634-9463-a80aa6c2a1e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.449128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a7516-9999-4634-9463-a80aa6c2a1e9 admin admin] PATH_INFO: `/v3/projects/a050615938f544eb9955f9eaf42d749b/users/3c1663ee67914729816f648b325da41d/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.451065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a7516-9999-4634-9463-a80aa6c2a1e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a050615938f544eb9955f9eaf42d749b, user_id=3c1663ee67914729816f648b325da41d, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:09.453958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a7516-9999-4634-9463-a80aa6c2a1e9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:09.466649 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1113/2233] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:09 2022] PUT /identity/v3/projects/a050615938f544eb9955f9eaf42d749b/users/3c1663ee67914729816f648b325da41d/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:09.477716 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fb5d0-48a8-44ca-ad5a-ab68b708ea75 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.478058 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fb5d0-48a8-44ca-ad5a-ab68b708ea75 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.478276 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fb5d0-48a8-44ca-ad5a-ab68b708ea75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.514456 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-393fb5d0-48a8-44ca-ad5a-ab68b708ea75 None None] MFA Rules not processed for user `3c1663ee67914729816f648b325da41d`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:09.515694 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-393fb5d0-48a8-44ca-ad5a-ab68b708ea75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:09.615940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1121/2234] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:09.631562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a7516-9999-4634-9463-a80aa6c2a1e9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:09.634125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-cf1a7516-9999-4634-9463-a80aa6c2a1e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:09.759355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a7516-9999-4634-9463-a80aa6c2a1e9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:09.764549 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f9e56-e87e-496c-a6b8-f685e2a3e723 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:09.765498 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f9e56-e87e-496c-a6b8-f685e2a3e723 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:09.774478 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f9e56-e87e-496c-a6b8-f685e2a3e723 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:09.774478 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f9e56-e87e-496c-a6b8-f685e2a3e723 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:09.777968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f9e56-e87e-496c-a6b8-f685e2a3e723 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:09.779784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f9e56-e87e-496c-a6b8-f685e2a3e723 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:09.813948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1114/2235] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:10.845492 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dcbee-2372-411e-a192-412c6ded9561 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:10.846413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dcbee-2372-411e-a192-412c6ded9561 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:10.846896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32dcbee-2372-411e-a192-412c6ded9561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:10.893535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d32dcbee-2372-411e-a192-412c6ded9561 None None] MFA Rules not processed for user `24c7d365f77347e9908484902b13650a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:10.906481 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d32dcbee-2372-411e-a192-412c6ded9561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:11.088074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1122/2236] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:11.129171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f9e56-e87e-496c-a6b8-f685e2a3e723 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:11.133026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7a4f9e56-e87e-496c-a6b8-f685e2a3e723 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:11.149739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f9e56-e87e-496c-a6b8-f685e2a3e723 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:11.158090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4aff1b-e4fa-4585-a360-403b7a0accf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:11.158090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aff1b-e4fa-4585-a360-403b7a0accf1 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:11.158090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aff1b-e4fa-4585-a360-403b7a0accf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:11.158090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4aff1b-e4fa-4585-a360-403b7a0accf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:11.166827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aff1b-e4fa-4585-a360-403b7a0accf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:11.168339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4aff1b-e4fa-4585-a360-403b7a0accf1 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:11.196806 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1115/2237] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:11.926364 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dcbee-2372-411e-a192-412c6ded9561 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:11.998363 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:12.044853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32dcbee-2372-411e-a192-412c6ded9561 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:12.050251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5ef97-1c47-491c-b1af-f3c0e4b5a296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:12.051116 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5ef97-1c47-491c-b1af-f3c0e4b5a296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:12.054934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5ef97-1c47-491c-b1af-f3c0e4b5a296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:12.054934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5ef97-1c47-491c-b1af-f3c0e4b5a296 admin admin] PATH_INFO: `/v3/users/d0b21fe42ff74e41ab05b28c9da18399` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:12.054934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5ef97-1c47-491c-b1af-f3c0e4b5a296 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0b21fe42ff74e41ab05b28c9da18399)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:12.056364 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a5ef97-1c47-491c-b1af-f3c0e4b5a296 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:12.301304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a6a5ef97-1c47-491c-b1af-f3c0e4b5a296 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0b21fe42ff74e41ab05b28c9da18399'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:12.331649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a6a5ef97-1c47-491c-b1af-f3c0e4b5a296 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0b21fe42ff74e41ab05b28c9da18399'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:12.332437 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a6a5ef97-1c47-491c-b1af-f3c0e4b5a296 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0b21fe42ff74e41ab05b28c9da18399'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:12.333227 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a6a5ef97-1c47-491c-b1af-f3c0e4b5a296 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0b21fe42ff74e41ab05b28c9da18399'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:12.343189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a6a5ef97-1c47-491c-b1af-f3c0e4b5a296 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0b21fe42ff74e41ab05b28c9da18399'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:12.434624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1123/2238] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:11 2022] DELETE /identity/v3/users/d0b21fe42ff74e41ab05b28c9da18399 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:12.439498 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3588a43-4196-45ee-a2be-82997a67982d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:12.439977 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3588a43-4196-45ee-a2be-82997a67982d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:12.440054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3588a43-4196-45ee-a2be-82997a67982d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:12.528406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-d3588a43-4196-45ee-a2be-82997a67982d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:12.529774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d3588a43-4196-45ee-a2be-82997a67982d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:12.659423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1116/2239] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:12.670732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5ef97-1c47-491c-b1af-f3c0e4b5a296 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:12.673821 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a6a5ef97-1c47-491c-b1af-f3c0e4b5a296 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:12.760958 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a5ef97-1c47-491c-b1af-f3c0e4b5a296 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:12.769782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db1626-46b0-4888-8b40-91aa3c4ca237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:12.769782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1626-46b0-4888-8b40-91aa3c4ca237 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:12.769782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1626-46b0-4888-8b40-91aa3c4ca237 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:12.769782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db1626-46b0-4888-8b40-91aa3c4ca237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:12.780945 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db1626-46b0-4888-8b40-91aa3c4ca237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:12.782382 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db1626-46b0-4888-8b40-91aa3c4ca237 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:12.793769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1124/2240] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:13.078370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50a172-2387-4ab1-9a8c-715b825cf5b5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:13.078972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50a172-2387-4ab1-9a8c-715b825cf5b5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:13.079398 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c50a172-2387-4ab1-9a8c-715b825cf5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:13.117357 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8c50a172-2387-4ab1-9a8c-715b825cf5b5 None None] MFA Rules not processed for user `24c7d365f77347e9908484902b13650a`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:13.118610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8c50a172-2387-4ab1-9a8c-715b825cf5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:13.165291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:13.252276 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1117/2241] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:13.332334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db1626-46b0-4888-8b40-91aa3c4ca237 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:13.335500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-70db1626-46b0-4888-8b40-91aa3c4ca237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:13.365291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db1626-46b0-4888-8b40-91aa3c4ca237 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:13.372874 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:13.374132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:13.391280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:13.392368 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] PATH_INFO: `/v3/projects/15521b4834794bca855f9d18d19a38ec` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:13.398608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15521b4834794bca855f9d18d19a38ec)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:13.405860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:13.555787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15521b4834794bca855f9d18d19a38ec', 'request_id': 'req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:13.557893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:13.565230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15521b4834794bca855f9d18d19a38ec', 'request_id': 'req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:13.573886 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15521b4834794bca855f9d18d19a38ec', 'request_id': 'req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:13.691590 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] The token cache is being invalidate because project 15521b4834794bca855f9d18d19a38ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:13.691922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:13.692621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:13.694854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1125/2242] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:13 2022] DELETE /identity/v3/projects/15521b4834794bca855f9d18d19a38ec => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:13.698747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50a172-2387-4ab1-9a8c-715b825cf5b5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:13.721079 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c50a172-2387-4ab1-9a8c-715b825cf5b5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:13.792075 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a84b7-e8f5-4f05-b5f9-1fffd4562ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:13.794991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a84b7-e8f5-4f05-b5f9-1fffd4562ffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:13.794991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a84b7-e8f5-4f05-b5f9-1fffd4562ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:13.794991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a84b7-e8f5-4f05-b5f9-1fffd4562ffe admin admin] PATH_INFO: `/v3/users/3c1663ee67914729816f648b325da41d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:13.796295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a84b7-e8f5-4f05-b5f9-1fffd4562ffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c1663ee67914729816f648b325da41d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:13.799247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a84b7-e8f5-4f05-b5f9-1fffd4562ffe admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:14.055015 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1a2a84b7-e8f5-4f05-b5f9-1fffd4562ffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c1663ee67914729816f648b325da41d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:14.055808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1a2a84b7-e8f5-4f05-b5f9-1fffd4562ffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c1663ee67914729816f648b325da41d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:14.056558 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1a2a84b7-e8f5-4f05-b5f9-1fffd4562ffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c1663ee67914729816f648b325da41d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:14.076129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1a2a84b7-e8f5-4f05-b5f9-1fffd4562ffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c1663ee67914729816f648b325da41d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:14.093995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1a2a84b7-e8f5-4f05-b5f9-1fffd4562ffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c1663ee67914729816f648b325da41d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:14.199540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1118/2243] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:13 2022] DELETE /identity/v3/users/3c1663ee67914729816f648b325da41d => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:14.970680 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:14.973464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:15.008708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed043bc6-ffdf-49bf-a9b6-8ee73dd56948 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:15.110152 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:15.111496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:15.116287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:15.116287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] PATH_INFO: `/v3/projects/a050615938f544eb9955f9eaf42d749b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:15.116287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a050615938f544eb9955f9eaf42d749b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:15.117190 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:15.259452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a928e94-3ab3-4318-9035-8a22775e4f2a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:15.259993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a928e94-3ab3-4318-9035-8a22775e4f2a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:15.260073 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a928e94-3ab3-4318-9035-8a22775e4f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:15.304312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-7a928e94-3ab3-4318-9035-8a22775e4f2a None None] MFA Rules not processed for user `38d60ba32bd9479496672d28925631d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:15.306255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7a928e94-3ab3-4318-9035-8a22775e4f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:15.322206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a050615938f544eb9955f9eaf42d749b', 'request_id': 'req-5755bb43-ca37-4b54-b5ef-22b036aca004'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:15.338286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a050615938f544eb9955f9eaf42d749b', 'request_id': 'req-5755bb43-ca37-4b54-b5ef-22b036aca004'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:15.353286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a050615938f544eb9955f9eaf42d749b', 'request_id': 'req-5755bb43-ca37-4b54-b5ef-22b036aca004'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:15.357868 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:15.429442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1119/2244] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:15.472148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] The token cache is being invalidate because project a050615938f544eb9955f9eaf42d749b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:15.472498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:15.474074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:15.483751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dcf2f-4cbe-4af6-8a9a-71fd38bfc35c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:15.484066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dcf2f-4cbe-4af6-8a9a-71fd38bfc35c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:15.484506 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22dcf2f-4cbe-4af6-8a9a-71fd38bfc35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:15.487171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1126/2245] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:14 2022] DELETE /identity/v3/projects/a050615938f544eb9955f9eaf42d749b => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:15.520461 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e22dcf2f-4cbe-4af6-8a9a-71fd38bfc35c None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:15.522557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e22dcf2f-4cbe-4af6-8a9a-71fd38bfc35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:15.578199 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:15.579719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:15.591535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1120/2246] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:15.600705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67ef72-f402-4b93-9d98-234b7ac46553 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:15.601016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67ef72-f402-4b93-9d98-234b7ac46553 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:15.601270 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e67ef72-f402-4b93-9d98-234b7ac46553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:15.666711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3e67ef72-f402-4b93-9d98-234b7ac46553 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:15.669017 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3e67ef72-f402-4b93-9d98-234b7ac46553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:15.679730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1121/2247] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:15.684248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67ef72-f402-4b93-9d98-234b7ac46553 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:15.702600 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e67ef72-f402-4b93-9d98-234b7ac46553 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:15.708138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f038d-5024-4817-ad0f-de7e65147a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:15.709753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f038d-5024-4817-ad0f-de7e65147a26 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:15.710556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f038d-5024-4817-ad0f-de7e65147a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:15.710895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f038d-5024-4817-ad0f-de7e65147a26 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:15.711963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f038d-5024-4817-ad0f-de7e65147a26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:15.712344 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f038d-5024-4817-ad0f-de7e65147a26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:15.714153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f038d-5024-4817-ad0f-de7e65147a26 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:15.733843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1122/2248] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:10:15.738915 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755bb43-ca37-4b54-b5ef-22b036aca004 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:15.741441 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f038d-5024-4817-ad0f-de7e65147a26 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:15.745857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b120be-bef6-46a4-9d1a-440a1c6a97b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:15.746482 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b120be-bef6-46a4-9d1a-440a1c6a97b9 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:15.746762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b120be-bef6-46a4-9d1a-440a1c6a97b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:15.747116 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b120be-bef6-46a4-9d1a-440a1c6a97b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:15.748976 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-74b120be-bef6-46a4-9d1a-440a1c6a97b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:15.754948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f038d-5024-4817-ad0f-de7e65147a26 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:15.756197 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:15.760780 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9c5ba-1aeb-4ce4-b47f-f759265a808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:15.763962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9c5ba-1aeb-4ce4-b47f-f759265a808f admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:15.763962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9c5ba-1aeb-4ce4-b47f-f759265a808f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:15.763962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c9c5ba-1aeb-4ce4-b47f-f759265a808f admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:15.763962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9c5ba-1aeb-4ce4-b47f-f759265a808f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:15.766608 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c9c5ba-1aeb-4ce4-b47f-f759265a808f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:15.879997 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b120be-bef6-46a4-9d1a-440a1c6a97b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:15.879997 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b120be-bef6-46a4-9d1a-440a1c6a97b9 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:15.889856 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1123/2249] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:15 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:15.894227 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9c5ba-1aeb-4ce4-b47f-f759265a808f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:15.895326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1127/2250] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:15 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:16.028436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c9c5ba-1aeb-4ce4-b47f-f759265a808f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:16.037255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be854c-0373-4a92-a992-3e60a757aed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:16.039969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be854c-0373-4a92-a992-3e60a757aed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.040293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be854c-0373-4a92-a992-3e60a757aed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.040624 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be854c-0373-4a92-a992-3e60a757aed9 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.041478 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be854c-0373-4a92-a992-3e60a757aed9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:16.045339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7be854c-0373-4a92-a992-3e60a757aed9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:16.188109 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1124/2251] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:15 2022] POST /identity/v3/users => generated 286 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:16.192157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b120be-bef6-46a4-9d1a-440a1c6a97b9 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:16.207938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b120be-bef6-46a4-9d1a-440a1c6a97b9 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:16.238230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc76e32-e0c9-4845-841a-03a7b8ca1037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:16.239162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc76e32-e0c9-4845-841a-03a7b8ca1037 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.241253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc76e32-e0c9-4845-841a-03a7b8ca1037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.241662 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc76e32-e0c9-4845-841a-03a7b8ca1037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.246871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc76e32-e0c9-4845-841a-03a7b8ca1037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:16.246871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc76e32-e0c9-4845-841a-03a7b8ca1037 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:16.258094 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1128/2252] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:16.262426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be854c-0373-4a92-a992-3e60a757aed9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:16.273685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be854c-0373-4a92-a992-3e60a757aed9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:16.280321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639ec1d-2ae8-4c98-b670-7c777cb1b1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:16.280942 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639ec1d-2ae8-4c98-b670-7c777cb1b1ec admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.281397 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639ec1d-2ae8-4c98-b670-7c777cb1b1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.281716 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639ec1d-2ae8-4c98-b670-7c777cb1b1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.282373 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639ec1d-2ae8-4c98-b670-7c777cb1b1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:16.284840 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639ec1d-2ae8-4c98-b670-7c777cb1b1ec admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:16.296740 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1125/2253] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:16.301009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc76e32-e0c9-4845-841a-03a7b8ca1037 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:16.312528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc76e32-e0c9-4845-841a-03a7b8ca1037 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:16.317219 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2416f0-0656-4e1c-a99d-48e684b6294d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:16.317900 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2416f0-0656-4e1c-a99d-48e684b6294d admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.318176 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2416f0-0656-4e1c-a99d-48e684b6294d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.318451 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2416f0-0656-4e1c-a99d-48e684b6294d admin admin] PATH_INFO: `/v3/projects/3dd0ade1759047c896e4833f3163d4c3/users/be06f1722f3f46e28555b0135ce9521a/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.334023 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2416f0-0656-4e1c-a99d-48e684b6294d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd0ade1759047c896e4833f3163d4c3, user_id=be06f1722f3f46e28555b0135ce9521a, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:16.336799 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2416f0-0656-4e1c-a99d-48e684b6294d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:16.452525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1129/2254] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:16 2022] PUT /identity/v3/projects/3dd0ade1759047c896e4833f3163d4c3/users/be06f1722f3f46e28555b0135ce9521a/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:16.463452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102a300-62b8-4773-a7c8-9a01c5f59681 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.463743 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102a300-62b8-4773-a7c8-9a01c5f59681 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.464057 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102a300-62b8-4773-a7c8-9a01c5f59681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.507974 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1102a300-62b8-4773-a7c8-9a01c5f59681 None None] MFA Rules not processed for user `be06f1722f3f46e28555b0135ce9521a`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:16.509699 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1102a300-62b8-4773-a7c8-9a01c5f59681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:16.605428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1126/2255] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:16.618020 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2416f0-0656-4e1c-a99d-48e684b6294d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:16.619783 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1c2416f0-0656-4e1c-a99d-48e684b6294d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:16.725698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2416f0-0656-4e1c-a99d-48e684b6294d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:16.729890 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff848de1-318e-4e34-9fb8-a1db62f57364 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c83e30a9fd04385b44ee3a3b72e5099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:16.730513 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff848de1-318e-4e34-9fb8-a1db62f57364 service glance] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:16.731145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff848de1-318e-4e34-9fb8-a1db62f57364 service glance] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:16.731580 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff848de1-318e-4e34-9fb8-a1db62f57364 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:16.745245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff848de1-318e-4e34-9fb8-a1db62f57364 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:16.746925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff848de1-318e-4e34-9fb8-a1db62f57364 service glance] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:16.774977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1130/2256] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:17.156273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102a300-62b8-4773-a7c8-9a01c5f59681 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:17.164407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1102a300-62b8-4773-a7c8-9a01c5f59681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:17.288336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102a300-62b8-4773-a7c8-9a01c5f59681 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:17.291116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:17.328551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ae378-dd2c-4069-8830-5482adcc1c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:17.328551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae378-dd2c-4069-8830-5482adcc1c13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:17.328551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae378-dd2c-4069-8830-5482adcc1c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:17.328551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae378-dd2c-4069-8830-5482adcc1c13 admin admin] PATH_INFO: `/v3/users/e1dbb6f7758e47728bc7da60ed1e2486` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:17.329785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ae378-dd2c-4069-8830-5482adcc1c13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1dbb6f7758e47728bc7da60ed1e2486)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:17.331726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ae378-dd2c-4069-8830-5482adcc1c13 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:17.548431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-531ae378-dd2c-4069-8830-5482adcc1c13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1dbb6f7758e47728bc7da60ed1e2486'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:17.548973 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-531ae378-dd2c-4069-8830-5482adcc1c13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1dbb6f7758e47728bc7da60ed1e2486'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:17.549625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-531ae378-dd2c-4069-8830-5482adcc1c13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1dbb6f7758e47728bc7da60ed1e2486'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:17.557196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-531ae378-dd2c-4069-8830-5482adcc1c13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1dbb6f7758e47728bc7da60ed1e2486'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:17.570904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-531ae378-dd2c-4069-8830-5482adcc1c13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1dbb6f7758e47728bc7da60ed1e2486'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:17.651473 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1127/2257] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:17 2022] DELETE /identity/v3/users/e1dbb6f7758e47728bc7da60ed1e2486 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:17.655168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c23f40-614b-4893-8c1a-c0d1147b17c1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:17.655642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c23f40-614b-4893-8c1a-c0d1147b17c1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:17.655760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c23f40-614b-4893-8c1a-c0d1147b17c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:17.679581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a4c23f40-614b-4893-8c1a-c0d1147b17c1 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:17.680711 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a4c23f40-614b-4893-8c1a-c0d1147b17c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:17.751055 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:17.787619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1131/2258] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:17.798531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ae378-dd2c-4069-8830-5482adcc1c13 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:17.800050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-531ae378-dd2c-4069-8830-5482adcc1c13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:17.893922 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ae378-dd2c-4069-8830-5482adcc1c13 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:17.899236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047b4cb-9349-4471-b1f2-b5d10dd2b676 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:17.899875 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047b4cb-9349-4471-b1f2-b5d10dd2b676 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:17.900265 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047b4cb-9349-4471-b1f2-b5d10dd2b676 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:17.900537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047b4cb-9349-4471-b1f2-b5d10dd2b676 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:17.924751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047b4cb-9349-4471-b1f2-b5d10dd2b676 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:17.926338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047b4cb-9349-4471-b1f2-b5d10dd2b676 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:17.956978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1128/2259] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:18.340959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:19.378783 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c23f40-614b-4893-8c1a-c0d1147b17c1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:19.378783 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a4c23f40-614b-4893-8c1a-c0d1147b17c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:19.392920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c23f40-614b-4893-8c1a-c0d1147b17c1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:19.402728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d354e22-c630-45ac-95d9-192d43f06097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:19.402728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d354e22-c630-45ac-95d9-192d43f06097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:19.402728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d354e22-c630-45ac-95d9-192d43f06097 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:19.402728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d354e22-c630-45ac-95d9-192d43f06097 admin admin] PATH_INFO: `/v3/projects/d7e8f39f5c62479f8b9d27757bdf7e5b` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:19.403117 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d354e22-c630-45ac-95d9-192d43f06097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7e8f39f5c62479f8b9d27757bdf7e5b)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:19.404606 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d354e22-c630-45ac-95d9-192d43f06097 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:19.580351 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d354e22-c630-45ac-95d9-192d43f06097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7e8f39f5c62479f8b9d27757bdf7e5b', 'request_id': 'req-8d354e22-c630-45ac-95d9-192d43f06097'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:19.587294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d354e22-c630-45ac-95d9-192d43f06097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7e8f39f5c62479f8b9d27757bdf7e5b', 'request_id': 'req-8d354e22-c630-45ac-95d9-192d43f06097'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:19.593483 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d354e22-c630-45ac-95d9-192d43f06097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7e8f39f5c62479f8b9d27757bdf7e5b', 'request_id': 'req-8d354e22-c630-45ac-95d9-192d43f06097'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:19.688993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d354e22-c630-45ac-95d9-192d43f06097 admin admin] The token cache is being invalidate because project d7e8f39f5c62479f8b9d27757bdf7e5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:19.689531 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d354e22-c630-45ac-95d9-192d43f06097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:19.690652 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8d354e22-c630-45ac-95d9-192d43f06097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:19.693358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1132/2260] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:19 2022] DELETE /identity/v3/projects/d7e8f39f5c62479f8b9d27757bdf7e5b => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:19.697543 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047b4cb-9349-4471-b1f2-b5d10dd2b676 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:19.716100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047b4cb-9349-4471-b1f2-b5d10dd2b676 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:19.794724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85165fd-0ef3-4ca8-a9c3-ef4499db5d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:19.796057 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85165fd-0ef3-4ca8-a9c3-ef4499db5d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:19.796439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85165fd-0ef3-4ca8-a9c3-ef4499db5d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:19.796999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85165fd-0ef3-4ca8-a9c3-ef4499db5d4f admin admin] PATH_INFO: `/v3/users/dc6c455491f24cc59b7e59eb1973d70c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:19.798961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85165fd-0ef3-4ca8-a9c3-ef4499db5d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc6c455491f24cc59b7e59eb1973d70c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:19.801631 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85165fd-0ef3-4ca8-a9c3-ef4499db5d4f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:19.824984 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8856c-f621-4a78-9a63-9f56f7c042b1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:19.825470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8856c-f621-4a78-9a63-9f56f7c042b1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:19.825852 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8856c-f621-4a78-9a63-9f56f7c042b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:19.860533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f2e8856c-f621-4a78-9a63-9f56f7c042b1 None None] MFA Rules not processed for user `fa8e5c4f16184f8fbfce978037029582`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:19.861996 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f2e8856c-f621-4a78-9a63-9f56f7c042b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:19.938036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1133/2261] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:20.080325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f85165fd-0ef3-4ca8-a9c3-ef4499db5d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc6c455491f24cc59b7e59eb1973d70c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:20.081256 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f85165fd-0ef3-4ca8-a9c3-ef4499db5d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc6c455491f24cc59b7e59eb1973d70c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:20.082281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f85165fd-0ef3-4ca8-a9c3-ef4499db5d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc6c455491f24cc59b7e59eb1973d70c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:20.094397 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f85165fd-0ef3-4ca8-a9c3-ef4499db5d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc6c455491f24cc59b7e59eb1973d70c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:20.121751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f85165fd-0ef3-4ca8-a9c3-ef4499db5d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc6c455491f24cc59b7e59eb1973d70c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:20.238204 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1129/2262] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:19 2022] DELETE /identity/v3/users/dc6c455491f24cc59b7e59eb1973d70c => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:21.105482 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8856c-f621-4a78-9a63-9f56f7c042b1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:21.106982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f2e8856c-f621-4a78-9a63-9f56f7c042b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:21.122570 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8856c-f621-4a78-9a63-9f56f7c042b1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:21.246527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d8405-ab32-4703-b600-7eb322d251ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:21.248389 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8405-ab32-4703-b600-7eb322d251ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:21.249481 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8405-ab32-4703-b600-7eb322d251ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:21.249993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d8405-ab32-4703-b600-7eb322d251ec admin admin] PATH_INFO: `/v3/projects/0cf910398c374eaea709156855b4dd32` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:21.251832 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d8405-ab32-4703-b600-7eb322d251ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf910398c374eaea709156855b4dd32)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:21.253828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d8405-ab32-4703-b600-7eb322d251ec admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:21.434114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:21.457600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7b3d8405-ab32-4703-b600-7eb322d251ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf910398c374eaea709156855b4dd32', 'request_id': 'req-7b3d8405-ab32-4703-b600-7eb322d251ec'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.470438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7b3d8405-ab32-4703-b600-7eb322d251ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf910398c374eaea709156855b4dd32', 'request_id': 'req-7b3d8405-ab32-4703-b600-7eb322d251ec'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.480327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7b3d8405-ab32-4703-b600-7eb322d251ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf910398c374eaea709156855b4dd32', 'request_id': 'req-7b3d8405-ab32-4703-b600-7eb322d251ec'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.568433 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7b3d8405-ab32-4703-b600-7eb322d251ec admin admin] The token cache is being invalidate because project 0cf910398c374eaea709156855b4dd32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:21.568747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7b3d8405-ab32-4703-b600-7eb322d251ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.569518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7b3d8405-ab32-4703-b600-7eb322d251ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:21.571320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1134/2263] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:21 2022] DELETE /identity/v3/projects/0cf910398c374eaea709156855b4dd32 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:21.577431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca968e4a-82d7-46e6-bb53-00a514e3581c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:21.577916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca968e4a-82d7-46e6-bb53-00a514e3581c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:21.578283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca968e4a-82d7-46e6-bb53-00a514e3581c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:21.610105 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ca968e4a-82d7-46e6-bb53-00a514e3581c None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:21.611470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ca968e4a-82d7-46e6-bb53-00a514e3581c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:21.657944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:21.687909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1130/2264] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:21.697284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dbe34-962c-409a-8203-01577e159706 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:21.697641 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dbe34-962c-409a-8203-01577e159706 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:21.698005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42dbe34-962c-409a-8203-01577e159706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:21.720475 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d42dbe34-962c-409a-8203-01577e159706 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:21.722135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d42dbe34-962c-409a-8203-01577e159706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:21.735762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1135/2265] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:21.741095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca968e4a-82d7-46e6-bb53-00a514e3581c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:21.754789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca968e4a-82d7-46e6-bb53-00a514e3581c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:21.767251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3058fa-4c4d-452a-aa1c-72e1ecc2f3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:21.767973 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3058fa-4c4d-452a-aa1c-72e1ecc2f3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:21.768254 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3058fa-4c4d-452a-aa1c-72e1ecc2f3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:21.769822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3058fa-4c4d-452a-aa1c-72e1ecc2f3b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:21.769822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3058fa-4c4d-452a-aa1c-72e1ecc2f3b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:21.769822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3058fa-4c4d-452a-aa1c-72e1ecc2f3b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:21.771387 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3058fa-4c4d-452a-aa1c-72e1ecc2f3b0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:21.792244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1131/2266] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:10:21.793614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dbe34-962c-409a-8203-01577e159706 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:21.803646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42dbe34-962c-409a-8203-01577e159706 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:21.808430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a4978-dc7a-46f9-8a82-88a947baa9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:21.809023 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a4978-dc7a-46f9-8a82-88a947baa9cb admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:21.809569 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a4978-dc7a-46f9-8a82-88a947baa9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:21.809951 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a4978-dc7a-46f9-8a82-88a947baa9cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:21.810574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a4978-dc7a-46f9-8a82-88a947baa9cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:21.812532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a4978-dc7a-46f9-8a82-88a947baa9cb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:21.948842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1136/2267] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:21 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:21.949910 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3058fa-4c4d-452a-aa1c-72e1ecc2f3b0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:21.968265 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3058fa-4c4d-452a-aa1c-72e1ecc2f3b0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.045232 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ddc83-e050-4230-ad74-14df8f274917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.046058 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ddc83-e050-4230-ad74-14df8f274917 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.046439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ddc83-e050-4230-ad74-14df8f274917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.046819 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ddc83-e050-4230-ad74-14df8f274917 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.047941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ddc83-e050-4230-ad74-14df8f274917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.054964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ddc83-e050-4230-ad74-14df8f274917 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:22.186207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1132/2268] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:21 2022] POST /identity/v3/users => generated 291 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:22.190880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a4978-dc7a-46f9-8a82-88a947baa9cb admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:22.202264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a4978-dc7a-46f9-8a82-88a947baa9cb admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.208164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e80468-0442-4921-933c-1ac30bd53eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.208164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e80468-0442-4921-933c-1ac30bd53eff admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.208164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e80468-0442-4921-933c-1ac30bd53eff admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.208467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e80468-0442-4921-933c-1ac30bd53eff admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.209221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e80468-0442-4921-933c-1ac30bd53eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.210807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e80468-0442-4921-933c-1ac30bd53eff admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:22.229962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1137/2269] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:22.233982 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ddc83-e050-4230-ad74-14df8f274917 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:22.249792 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ddc83-e050-4230-ad74-14df8f274917 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.255932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353babad-4c33-498d-9337-eb5ba6f09773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.256721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353babad-4c33-498d-9337-eb5ba6f09773 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.257008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353babad-4c33-498d-9337-eb5ba6f09773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.257282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353babad-4c33-498d-9337-eb5ba6f09773 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.257940 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353babad-4c33-498d-9337-eb5ba6f09773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.259547 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353babad-4c33-498d-9337-eb5ba6f09773 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:22.270985 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1133/2270] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:22.278140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e80468-0442-4921-933c-1ac30bd53eff admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:22.292907 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e80468-0442-4921-933c-1ac30bd53eff admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.301370 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2a19f-cce1-4525-acf9-7f426435b666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.302258 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2a19f-cce1-4525-acf9-7f426435b666 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.302631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2a19f-cce1-4525-acf9-7f426435b666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.303517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2a19f-cce1-4525-acf9-7f426435b666 admin admin] PATH_INFO: `/v3/projects/b6e73954dd75495dafb6228a7c182d5e/users/94973c1cbdca47f296eab78cee45370e/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.321739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2a19f-cce1-4525-acf9-7f426435b666 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6e73954dd75495dafb6228a7c182d5e, user_id=94973c1cbdca47f296eab78cee45370e, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.324695 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2a19f-cce1-4525-acf9-7f426435b666 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:22.428323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a80d40-d944-42d0-b4ca-2b6e13ea0f7b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.428744 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a80d40-d944-42d0-b4ca-2b6e13ea0f7b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.429108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a80d40-d944-42d0-b4ca-2b6e13ea0f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.436855 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1138/2271] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:22 2022] PUT /identity/v3/projects/b6e73954dd75495dafb6228a7c182d5e/users/94973c1cbdca47f296eab78cee45370e/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:22.453024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-02a80d40-d944-42d0-b4ca-2b6e13ea0f7b None None] MFA Rules not processed for user `f4b56136da884b79ab26be1bdd99e407`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:22.456485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-02a80d40-d944-42d0-b4ca-2b6e13ea0f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:22.456632 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef54804-0fe1-4046-97fe-fd3127fab5f8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.457319 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef54804-0fe1-4046-97fe-fd3127fab5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.458533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef54804-0fe1-4046-97fe-fd3127fab5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.496522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7ef54804-0fe1-4046-97fe-fd3127fab5f8 None None] MFA Rules not processed for user `94973c1cbdca47f296eab78cee45370e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:22.497919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7ef54804-0fe1-4046-97fe-fd3127fab5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:22.552414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1134/2272] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:22.626744 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1139/2273] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:22 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:22.631552 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a80d40-d944-42d0-b4ca-2b6e13ea0f7b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:22.706245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a80d40-d944-42d0-b4ca-2b6e13ea0f7b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.715255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94543591-f759-4696-923b-ddef7d71b947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.717879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94543591-f759-4696-923b-ddef7d71b947 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.717879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94543591-f759-4696-923b-ddef7d71b947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.717879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94543591-f759-4696-923b-ddef7d71b947 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.717879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94543591-f759-4696-923b-ddef7d71b947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.720072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94543591-f759-4696-923b-ddef7d71b947 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:22.738675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:22.807913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1135/2274] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:22 2022] POST /identity/v3/projects => generated 381 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:22.808115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef54804-0fe1-4046-97fe-fd3127fab5f8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:22.819872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef54804-0fe1-4046-97fe-fd3127fab5f8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:22.869377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:22.892871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ad634-fcf6-4fd8-99c2-dc90bbf80fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:22.893505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad634-fcf6-4fd8-99c2-dc90bbf80fae admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:22.893787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad634-fcf6-4fd8-99c2-dc90bbf80fae admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:22.894059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad634-fcf6-4fd8-99c2-dc90bbf80fae admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:22.894696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ad634-fcf6-4fd8-99c2-dc90bbf80fae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:22.897302 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ad634-fcf6-4fd8-99c2-dc90bbf80fae admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:23.003194 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1140/2275] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:22 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:23.009063 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94543591-f759-4696-923b-ddef7d71b947 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:23.019533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94543591-f759-4696-923b-ddef7d71b947 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:23.027784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccbabc-bc3e-44ba-9cef-189cc45d2b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:23.028664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccbabc-bc3e-44ba-9cef-189cc45d2b40 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:23.029114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccbabc-bc3e-44ba-9cef-189cc45d2b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:23.031770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efccbabc-bc3e-44ba-9cef-189cc45d2b40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:23.031770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccbabc-bc3e-44ba-9cef-189cc45d2b40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:23.032940 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efccbabc-bc3e-44ba-9cef-189cc45d2b40 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:23.047393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1136/2276] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:23.051451 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ad634-fcf6-4fd8-99c2-dc90bbf80fae admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:23.062128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ad634-fcf6-4fd8-99c2-dc90bbf80fae admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:23.066739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b05b76-3f4a-4d68-bf1e-5a7ba875a8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:23.068180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b05b76-3f4a-4d68-bf1e-5a7ba875a8a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:23.068466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b05b76-3f4a-4d68-bf1e-5a7ba875a8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:23.068747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b05b76-3f4a-4d68-bf1e-5a7ba875a8a8 admin admin] PATH_INFO: `/v3/projects/c12647b050174becb88c7a1daf8cb1a4/users/64f766b4915d43458920467e9481c077/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:23.088704 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b05b76-3f4a-4d68-bf1e-5a7ba875a8a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12647b050174becb88c7a1daf8cb1a4, user_id=64f766b4915d43458920467e9481c077, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:23.091366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b05b76-3f4a-4d68-bf1e-5a7ba875a8a8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:23.168631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1141/2277] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:23 2022] PUT /identity/v3/projects/c12647b050174becb88c7a1daf8cb1a4/users/64f766b4915d43458920467e9481c077/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:23.172606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccbabc-bc3e-44ba-9cef-189cc45d2b40 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:23.183725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efccbabc-bc3e-44ba-9cef-189cc45d2b40 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:23.260246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a7d874-cc32-48be-bd96-678b5511c48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:23.260931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d874-cc32-48be-bd96-678b5511c48a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:23.261221 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d874-cc32-48be-bd96-678b5511c48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:23.261634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a7d874-cc32-48be-bd96-678b5511c48a admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:23.262310 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7d874-cc32-48be-bd96-678b5511c48a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:23.263946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a7d874-cc32-48be-bd96-678b5511c48a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:23.277251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1137/2278] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:23.280107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b05b76-3f4a-4d68-bf1e-5a7ba875a8a8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:23.294028 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b05b76-3f4a-4d68-bf1e-5a7ba875a8a8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:23.318301 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a3438-d79b-4363-8349-1f085510bcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:23.319233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a3438-d79b-4363-8349-1f085510bcf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:23.319663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a3438-d79b-4363-8349-1f085510bcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:23.320243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a3438-d79b-4363-8349-1f085510bcf2 admin admin] PATH_INFO: `/v3/projects/c12647b050174becb88c7a1daf8cb1a4/users/64f766b4915d43458920467e9481c077/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:23.324668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a3438-d79b-4363-8349-1f085510bcf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c12647b050174becb88c7a1daf8cb1a4, user_id=64f766b4915d43458920467e9481c077, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:23.327293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911a3438-d79b-4363-8349-1f085510bcf2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:23.356170 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1142/2279] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:23 2022] PUT /identity/v3/projects/c12647b050174becb88c7a1daf8cb1a4/users/64f766b4915d43458920467e9481c077/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:23.372220 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ecc6-4bf9-432f-bab6-27cc46915baa None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:23.372566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ecc6-4bf9-432f-bab6-27cc46915baa None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:23.372847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900ecc6-4bf9-432f-bab6-27cc46915baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:23.416130 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e900ecc6-4bf9-432f-bab6-27cc46915baa None None] MFA Rules not processed for user `64f766b4915d43458920467e9481c077`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:23.417483 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e900ecc6-4bf9-432f-bab6-27cc46915baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:23.496571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1138/2280] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:23.508266 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a3438-d79b-4363-8349-1f085510bcf2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:23.509983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-911a3438-d79b-4363-8349-1f085510bcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:23.570311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911a3438-d79b-4363-8349-1f085510bcf2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:23.574625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5cf42-8941-4caf-992c-9422e641da82 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:23.575339 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5cf42-8941-4caf-992c-9422e641da82 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:23.575615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5cf42-8941-4caf-992c-9422e641da82 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:23.575910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac5cf42-8941-4caf-992c-9422e641da82 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:23.586000 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5cf42-8941-4caf-992c-9422e641da82 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:23.587427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac5cf42-8941-4caf-992c-9422e641da82 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:23.596774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1143/2281] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:23.709174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900ecc6-4bf9-432f-bab6-27cc46915baa None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:23.719234 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900ecc6-4bf9-432f-bab6-27cc46915baa None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:23.722826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83470b2-f036-438f-836c-5c0a9ad2eb9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:23.723426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83470b2-f036-438f-836c-5c0a9ad2eb9b service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:23.724251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83470b2-f036-438f-836c-5c0a9ad2eb9b service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:23.724563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83470b2-f036-438f-836c-5c0a9ad2eb9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:23.772902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:23.790196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83470b2-f036-438f-836c-5c0a9ad2eb9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:23.791663 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83470b2-f036-438f-836c-5c0a9ad2eb9b service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:23.802277 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1139/2282] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:27.331599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5cf42-8941-4caf-992c-9422e641da82 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:27.412353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac5cf42-8941-4caf-992c-9422e641da82 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:27.417109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeed488-1ecf-49a1-96b6-77ed26935304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:27.417735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeed488-1ecf-49a1-96b6-77ed26935304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:27.418014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeed488-1ecf-49a1-96b6-77ed26935304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:27.418287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeed488-1ecf-49a1-96b6-77ed26935304 admin admin] PATH_INFO: `/v3/users/94973c1cbdca47f296eab78cee45370e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:27.419476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeed488-1ecf-49a1-96b6-77ed26935304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94973c1cbdca47f296eab78cee45370e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:27.421963 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeed488-1ecf-49a1-96b6-77ed26935304 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:27.607761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:27.616665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ddeed488-1ecf-49a1-96b6-77ed26935304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94973c1cbdca47f296eab78cee45370e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:27.629967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ddeed488-1ecf-49a1-96b6-77ed26935304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94973c1cbdca47f296eab78cee45370e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:27.631196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ddeed488-1ecf-49a1-96b6-77ed26935304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94973c1cbdca47f296eab78cee45370e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:27.631829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ddeed488-1ecf-49a1-96b6-77ed26935304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94973c1cbdca47f296eab78cee45370e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:27.638586 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ddeed488-1ecf-49a1-96b6-77ed26935304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94973c1cbdca47f296eab78cee45370e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:27.723469 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1144/2283] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:27 2022] DELETE /identity/v3/users/94973c1cbdca47f296eab78cee45370e => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:27.728170 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50152ef-e511-4fa5-9ab3-ddd880ef9ed1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:27.728640 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50152ef-e511-4fa5-9ab3-ddd880ef9ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:27.728769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50152ef-e511-4fa5-9ab3-ddd880ef9ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:27.749340 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e50152ef-e511-4fa5-9ab3-ddd880ef9ed1 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:27.750684 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e50152ef-e511-4fa5-9ab3-ddd880ef9ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:27.822003 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1140/2284] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:27.831989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeed488-1ecf-49a1-96b6-77ed26935304 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:27.833517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ddeed488-1ecf-49a1-96b6-77ed26935304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:27.909816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeed488-1ecf-49a1-96b6-77ed26935304 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:27.914928 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02aac44-faab-4c74-ad7d-9cdb5e24375f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:27.915615 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aac44-faab-4c74-ad7d-9cdb5e24375f service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:27.916001 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aac44-faab-4c74-ad7d-9cdb5e24375f service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:27.916340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02aac44-faab-4c74-ad7d-9cdb5e24375f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:27.925553 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02aac44-faab-4c74-ad7d-9cdb5e24375f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:27.927111 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02aac44-faab-4c74-ad7d-9cdb5e24375f service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:27.937447 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1145/2285] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:10:28.492753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50152ef-e511-4fa5-9ab3-ddd880ef9ed1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:28.494291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e50152ef-e511-4fa5-9ab3-ddd880ef9ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:28.507602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50152ef-e511-4fa5-9ab3-ddd880ef9ed1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:28.513644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:28.514220 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:28.514508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:28.514839 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] PATH_INFO: `/v3/projects/b6e73954dd75495dafb6228a7c182d5e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:28.516327 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6e73954dd75495dafb6228a7c182d5e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:28.519479 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:28.679427 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6e73954dd75495dafb6228a7c182d5e', 'request_id': 'req-dd332706-38d8-4907-946c-9c8061125cd4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:28.686014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6e73954dd75495dafb6228a7c182d5e', 'request_id': 'req-dd332706-38d8-4907-946c-9c8061125cd4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:28.779269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6e73954dd75495dafb6228a7c182d5e', 'request_id': 'req-dd332706-38d8-4907-946c-9c8061125cd4'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:28.795071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] The token cache is being invalidate because project b6e73954dd75495dafb6228a7c182d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:28.796700 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:28.797660 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:28.799286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1141/2286] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:28 2022] DELETE /identity/v3/projects/b6e73954dd75495dafb6228a7c182d5e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:28.804688 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02aac44-faab-4c74-ad7d-9cdb5e24375f service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:28.820622 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02aac44-faab-4c74-ad7d-9cdb5e24375f service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:28.917646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94114cf0-7c54-4ba4-abca-0a4075ffb391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:28.918310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94114cf0-7c54-4ba4-abca-0a4075ffb391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:28.918575 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94114cf0-7c54-4ba4-abca-0a4075ffb391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:28.918847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94114cf0-7c54-4ba4-abca-0a4075ffb391 admin admin] PATH_INFO: `/v3/users/64f766b4915d43458920467e9481c077` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:28.920631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94114cf0-7c54-4ba4-abca-0a4075ffb391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64f766b4915d43458920467e9481c077)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:28.923126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94114cf0-7c54-4ba4-abca-0a4075ffb391 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:29.139780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-94114cf0-7c54-4ba4-abca-0a4075ffb391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64f766b4915d43458920467e9481c077'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:29.159534 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:29.160186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-94114cf0-7c54-4ba4-abca-0a4075ffb391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64f766b4915d43458920467e9481c077'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:29.161126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-94114cf0-7c54-4ba4-abca-0a4075ffb391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64f766b4915d43458920467e9481c077'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:29.161755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-94114cf0-7c54-4ba4-abca-0a4075ffb391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64f766b4915d43458920467e9481c077'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:29.170699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-94114cf0-7c54-4ba4-abca-0a4075ffb391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64f766b4915d43458920467e9481c077'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:29.261249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1146/2287] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:28 2022] DELETE /identity/v3/users/64f766b4915d43458920467e9481c077 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:29.776140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:29.777667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:29.794862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd332706-38d8-4907-946c-9c8061125cd4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:29.860436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:29.861065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:29.861343 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:29.861628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6 admin admin] PATH_INFO: `/v3/projects/c12647b050174becb88c7a1daf8cb1a4` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:29.862724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c12647b050174becb88c7a1daf8cb1a4)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:29.864647 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:29.873152 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:29.993293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c12647b050174becb88c7a1daf8cb1a4', 'request_id': 'req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:29.999510 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c12647b050174becb88c7a1daf8cb1a4', 'request_id': 'req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:30.064616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c12647b050174becb88c7a1daf8cb1a4', 'request_id': 'req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:30.077438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6 admin admin] The token cache is being invalidate because project c12647b050174becb88c7a1daf8cb1a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:30.077716 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:30.078462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-90ea79a2-33d6-4dd9-b0cd-e8d127c747c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:30.080248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1142/2288] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:29 2022] DELETE /identity/v3/projects/c12647b050174becb88c7a1daf8cb1a4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:30.085161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758537e5-c0c4-4cd0-8938-e8cdeb00a0b4 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:30.085653 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758537e5-c0c4-4cd0-8938-e8cdeb00a0b4 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:30.085749 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758537e5-c0c4-4cd0-8938-e8cdeb00a0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:30.104672 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-758537e5-c0c4-4cd0-8938-e8cdeb00a0b4 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:30.105857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-758537e5-c0c4-4cd0-8938-e8cdeb00a0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:30.189401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1147/2289] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:30.189593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f0d94-9f04-49c0-8b74-6b335fe63c07 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:30.189593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f0d94-9f04-49c0-8b74-6b335fe63c07 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:30.189593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f0d94-9f04-49c0-8b74-6b335fe63c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:30.207800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-166f0d94-9f04-49c0-8b74-6b335fe63c07 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:30.209116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-166f0d94-9f04-49c0-8b74-6b335fe63c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:30.219927 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1143/2290] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:30.226374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758537e5-c0c4-4cd0-8938-e8cdeb00a0b4 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:30.239887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758537e5-c0c4-4cd0-8938-e8cdeb00a0b4 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:30.245498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f622d94-b9ea-4ee5-9d37-13b6853c94a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:30.246208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622d94-b9ea-4ee5-9d37-13b6853c94a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:30.246559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622d94-b9ea-4ee5-9d37-13b6853c94a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:30.246905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f622d94-b9ea-4ee5-9d37-13b6853c94a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:30.247560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f622d94-b9ea-4ee5-9d37-13b6853c94a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:10:30.247918 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f622d94-b9ea-4ee5-9d37-13b6853c94a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:30.249567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f622d94-b9ea-4ee5-9d37-13b6853c94a2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:30.262847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1148/2291] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:10:30.267448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f0d94-9f04-49c0-8b74-6b335fe63c07 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:30.276837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f0d94-9f04-49c0-8b74-6b335fe63c07 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:30.281850 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7a10e-6fad-4141-bc6a-102e759277b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:30.282616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a10e-6fad-4141-bc6a-102e759277b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:30.282964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a10e-6fad-4141-bc6a-102e759277b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:30.283399 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a10e-6fad-4141-bc6a-102e759277b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:30.284131 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7a10e-6fad-4141-bc6a-102e759277b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:30.286414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7a10e-6fad-4141-bc6a-102e759277b5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:30.380173 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1144/2292] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:30 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:30.385780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f622d94-b9ea-4ee5-9d37-13b6853c94a2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:30.408375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f622d94-b9ea-4ee5-9d37-13b6853c94a2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:30.472406 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f414bd-198a-496c-ada2-04b88a22e09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:30.473017 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f414bd-198a-496c-ada2-04b88a22e09d admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:30.473292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f414bd-198a-496c-ada2-04b88a22e09d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:30.473564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f414bd-198a-496c-ada2-04b88a22e09d admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:30.474198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f414bd-198a-496c-ada2-04b88a22e09d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:30.476153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f414bd-198a-496c-ada2-04b88a22e09d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:30.574936 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1149/2293] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:30 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:30.579555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7a10e-6fad-4141-bc6a-102e759277b5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:30.591221 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7a10e-6fad-4141-bc6a-102e759277b5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:30.597421 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ad3e0-6cad-4e7e-9a1f-53f1b6f72317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:30.598050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ad3e0-6cad-4e7e-9a1f-53f1b6f72317 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:30.598323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ad3e0-6cad-4e7e-9a1f-53f1b6f72317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:30.598598 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5ad3e0-6cad-4e7e-9a1f-53f1b6f72317 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:30.599319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ad3e0-6cad-4e7e-9a1f-53f1b6f72317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:30.600936 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5ad3e0-6cad-4e7e-9a1f-53f1b6f72317 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:30.611255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1145/2294] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:30.619667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f414bd-198a-496c-ada2-04b88a22e09d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:30.629792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f414bd-198a-496c-ada2-04b88a22e09d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:30.635276 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c73ea4c-70a0-488d-9417-fd7e1fa18a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:30.635897 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73ea4c-70a0-488d-9417-fd7e1fa18a91 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:30.636176 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73ea4c-70a0-488d-9417-fd7e1fa18a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:30.636448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c73ea4c-70a0-488d-9417-fd7e1fa18a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:30.637082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73ea4c-70a0-488d-9417-fd7e1fa18a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:30.638740 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c73ea4c-70a0-488d-9417-fd7e1fa18a91 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:30.651041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1150/2295] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:30.660040 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ad3e0-6cad-4e7e-9a1f-53f1b6f72317 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:30.671463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5ad3e0-6cad-4e7e-9a1f-53f1b6f72317 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:30.677182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad3d64-c1cd-48b6-a182-5841daea3ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:30.678698 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad3d64-c1cd-48b6-a182-5841daea3ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:30.679122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad3d64-c1cd-48b6-a182-5841daea3ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:30.679408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad3d64-c1cd-48b6-a182-5841daea3ddf admin admin] PATH_INFO: `/v3/projects/aadada8c36734a7da3f9960c4e69ff1f/users/499bd50893994d2ba9337a66f3ddbda5/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:30.696231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad3d64-c1cd-48b6-a182-5841daea3ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=aadada8c36734a7da3f9960c4e69ff1f, user_id=499bd50893994d2ba9337a66f3ddbda5, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:30.703038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad3d64-c1cd-48b6-a182-5841daea3ddf admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:30.795313 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1146/2296] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:30 2022] PUT /identity/v3/projects/aadada8c36734a7da3f9960c4e69ff1f/users/499bd50893994d2ba9337a66f3ddbda5/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:30.802137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d4f98-d93a-4ce3-87cd-30a28fd6455e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:30.803049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d4f98-d93a-4ce3-87cd-30a28fd6455e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:30.803384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91d4f98-d93a-4ce3-87cd-30a28fd6455e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:30.824117 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-b91d4f98-d93a-4ce3-87cd-30a28fd6455e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:30.825492 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b91d4f98-d93a-4ce3-87cd-30a28fd6455e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:30.875781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:30.903528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1151/2297] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:30.919654 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad3d64-c1cd-48b6-a182-5841daea3ddf admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:30.921780 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-77ad3d64-c1cd-48b6-a182-5841daea3ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:30.983227 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad3d64-c1cd-48b6-a182-5841daea3ddf admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:30.986999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a4397-a008-4efc-892d-0dadbf001ebc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:30.987652 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a4397-a008-4efc-892d-0dadbf001ebc service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:30.987968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a4397-a008-4efc-892d-0dadbf001ebc service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:30.988245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9a4397-a008-4efc-892d-0dadbf001ebc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:30.998270 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a4397-a008-4efc-892d-0dadbf001ebc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:30.999692 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9a4397-a008-4efc-892d-0dadbf001ebc service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:31.010318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1147/2298] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:32.775101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb702b-256a-4e6b-9836-06750d5f5ec1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:32.775685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb702b-256a-4e6b-9836-06750d5f5ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:32.775802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb702b-256a-4e6b-9836-06750d5f5ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:32.813390 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-34eb702b-256a-4e6b-9836-06750d5f5ec1 None None] MFA Rules not processed for user `499bd50893994d2ba9337a66f3ddbda5`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:32.814816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-34eb702b-256a-4e6b-9836-06750d5f5ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:32.909977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1152/2299] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:32.916606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a4397-a008-4efc-892d-0dadbf001ebc service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:32.944371 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9a4397-a008-4efc-892d-0dadbf001ebc service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:32.951423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67107568-06e2-491d-b9c9-d84f942448c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:32.952998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67107568-06e2-491d-b9c9-d84f942448c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:32.953491 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67107568-06e2-491d-b9c9-d84f942448c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:32.954119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67107568-06e2-491d-b9c9-d84f942448c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:32.957209 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67107568-06e2-491d-b9c9-d84f942448c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:32.960401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67107568-06e2-491d-b9c9-d84f942448c4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:33.046374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1148/2300] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:10:32 2022] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:10:33.051798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb702b-256a-4e6b-9836-06750d5f5ec1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:33.068000 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb702b-256a-4e6b-9836-06750d5f5ec1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:33.092252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899c058-c259-49e1-b4f5-b1dfa7333b29 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:33.092400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899c058-c259-49e1-b4f5-b1dfa7333b29 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:33.092685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899c058-c259-49e1-b4f5-b1dfa7333b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:33.118322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5899c058-c259-49e1-b4f5-b1dfa7333b29 None None] MFA Rules not processed for user `68ee993e0aab4f988751a8b1bf11346c`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:33.120012 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5899c058-c259-49e1-b4f5-b1dfa7333b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:33.132001 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:33.145481 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefeb30-f1f1-4a75-87a4-0e81d7033e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:33.146892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefeb30-f1f1-4a75-87a4-0e81d7033e24 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:33.147489 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefeb30-f1f1-4a75-87a4-0e81d7033e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:33.147946 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeefeb30-f1f1-4a75-87a4-0e81d7033e24 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:33.148668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefeb30-f1f1-4a75-87a4-0e81d7033e24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:33.151505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeefeb30-f1f1-4a75-87a4-0e81d7033e24 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:33.202453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1149/2301] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:33.286579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899c058-c259-49e1-b4f5-b1dfa7333b29 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:33.295125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1153/2302] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:10:33 2022] POST /identity/v3/users => generated 292 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:10:33.300271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899c058-c259-49e1-b4f5-b1dfa7333b29 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:33.306937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4f613-c3bd-4fd1-a03a-73bcc29b0c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:33.308052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4f613-c3bd-4fd1-a03a-73bcc29b0c4d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:33.308520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4f613-c3bd-4fd1-a03a-73bcc29b0c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:33.309196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea4f613-c3bd-4fd1-a03a-73bcc29b0c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:33.309987 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4f613-c3bd-4fd1-a03a-73bcc29b0c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:33.311864 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea4f613-c3bd-4fd1-a03a-73bcc29b0c4d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:33.331378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefeb30-f1f1-4a75-87a4-0e81d7033e24 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:33.340682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1150/2303] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:10:33.348714 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeefeb30-f1f1-4a75-87a4-0e81d7033e24 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:33.357264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de060705-bf98-491b-bf68-4759196cca7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:33.357974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de060705-bf98-491b-bf68-4759196cca7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:33.358260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de060705-bf98-491b-bf68-4759196cca7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:33.358538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de060705-bf98-491b-bf68-4759196cca7d admin admin] PATH_INFO: `/v3/projects/a021253ee6984fbbbe4f2811db2c5286/users/20ed156e7f2f41aaa4f522afdb1e067a/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:33.385908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de060705-bf98-491b-bf68-4759196cca7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a021253ee6984fbbbe4f2811db2c5286, user_id=20ed156e7f2f41aaa4f522afdb1e067a, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:33.390466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de060705-bf98-491b-bf68-4759196cca7d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:33.511992 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1154/2304] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:33 2022] PUT /identity/v3/projects/a021253ee6984fbbbe4f2811db2c5286/users/20ed156e7f2f41aaa4f522afdb1e067a/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:33.516212 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4f613-c3bd-4fd1-a03a-73bcc29b0c4d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:33.527476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea4f613-c3bd-4fd1-a03a-73bcc29b0c4d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:33.627078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad971f5e-cf73-44c3-b05e-68df2ff44db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:33.627828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad971f5e-cf73-44c3-b05e-68df2ff44db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:33.628288 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad971f5e-cf73-44c3-b05e-68df2ff44db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:33.628634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad971f5e-cf73-44c3-b05e-68df2ff44db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:33.630075 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad971f5e-cf73-44c3-b05e-68df2ff44db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:33.632500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad971f5e-cf73-44c3-b05e-68df2ff44db2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:33.644280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1151/2305] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:10:33 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:10:33.649331 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de060705-bf98-491b-bf68-4759196cca7d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:33.659823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de060705-bf98-491b-bf68-4759196cca7d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:33.666434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92bfa3d-d665-4d3b-924a-5cc2b179362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:33.667780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bfa3d-d665-4d3b-924a-5cc2b179362f admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:33.668110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bfa3d-d665-4d3b-924a-5cc2b179362f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:33.668388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bfa3d-d665-4d3b-924a-5cc2b179362f admin admin] PATH_INFO: `/v3/projects/a021253ee6984fbbbe4f2811db2c5286/users/20ed156e7f2f41aaa4f522afdb1e067a/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:33.670432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bfa3d-d665-4d3b-924a-5cc2b179362f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a021253ee6984fbbbe4f2811db2c5286, user_id=20ed156e7f2f41aaa4f522afdb1e067a, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:33.673121 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92bfa3d-d665-4d3b-924a-5cc2b179362f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:33.689987 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1155/2306] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:10:33 2022] PUT /identity/v3/projects/a021253ee6984fbbbe4f2811db2c5286/users/20ed156e7f2f41aaa4f522afdb1e067a/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:10:35.242472 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c740ff-eca3-44a5-8bd4-84c58eed1c03 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:35.243817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c740ff-eca3-44a5-8bd4-84c58eed1c03 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:35.244222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c740ff-eca3-44a5-8bd4-84c58eed1c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:35.285708 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c3c740ff-eca3-44a5-8bd4-84c58eed1c03 None None] MFA Rules not processed for user `20ed156e7f2f41aaa4f522afdb1e067a`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:35.288030 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c3c740ff-eca3-44a5-8bd4-84c58eed1c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:35.400842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1152/2307] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:35.413654 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b7c30-49a5-453e-9ade-7a3579faa821 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:35.414192 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b7c30-49a5-453e-9ade-7a3579faa821 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:35.414457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b7c30-49a5-453e-9ade-7a3579faa821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:35.436794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-344b7c30-49a5-453e-9ade-7a3579faa821 None None] MFA Rules not processed for user `499bd50893994d2ba9337a66f3ddbda5`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:35.438029 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-344b7c30-49a5-453e-9ade-7a3579faa821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:35.462734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:35.501019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1156/2308] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:35.513510 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c740ff-eca3-44a5-8bd4-84c58eed1c03 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:35.514889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c3c740ff-eca3-44a5-8bd4-84c58eed1c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:35.547225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:35.591810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c740ff-eca3-44a5-8bd4-84c58eed1c03 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:35.597558 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b1ef6-04ff-4fab-9b2b-24e6b91e699c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:35.598170 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b1ef6-04ff-4fab-9b2b-24e6b91e699c service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:35.598461 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b1ef6-04ff-4fab-9b2b-24e6b91e699c service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:35.598719 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31b1ef6-04ff-4fab-9b2b-24e6b91e699c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:35.609330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b1ef6-04ff-4fab-9b2b-24e6b91e699c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:35.611059 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31b1ef6-04ff-4fab-9b2b-24e6b91e699c service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:35.622585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1153/2309] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:41.930878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce358f5-695e-4b20-a34d-0b9598b48457 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:41.931542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce358f5-695e-4b20-a34d-0b9598b48457 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:41.931542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce358f5-695e-4b20-a34d-0b9598b48457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:41.953789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2ce358f5-695e-4b20-a34d-0b9598b48457 None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:41.955321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2ce358f5-695e-4b20-a34d-0b9598b48457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:42.018445 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1157/2310] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:10:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:10:42.065096 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b1ef6-04ff-4fab-9b2b-24e6b91e699c service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:42.066481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f31b1ef6-04ff-4fab-9b2b-24e6b91e699c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:42.144411 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31b1ef6-04ff-4fab-9b2b-24e6b91e699c service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:42.150230 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1310f-0579-4714-94da-b384fe11133b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:42.150913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1310f-0579-4714-94da-b384fe11133b service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:42.151408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1310f-0579-4714-94da-b384fe11133b service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:42.151686 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1310f-0579-4714-94da-b384fe11133b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:42.162588 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1310f-0579-4714-94da-b384fe11133b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:42.164233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1310f-0579-4714-94da-b384fe11133b service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:42.173153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1154/2311] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:10:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:10:48.469978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce358f5-695e-4b20-a34d-0b9598b48457 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:48.478953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2ce358f5-695e-4b20-a34d-0b9598b48457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:48.579772 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce358f5-695e-4b20-a34d-0b9598b48457 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:48.587471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e05d22-caa2-482f-9e10-85eb3c920b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:48.588187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e05d22-caa2-482f-9e10-85eb3c920b61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:48.588469 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e05d22-caa2-482f-9e10-85eb3c920b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:48.588738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e05d22-caa2-482f-9e10-85eb3c920b61 admin admin] PATH_INFO: `/v3/users/be06f1722f3f46e28555b0135ce9521a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:48.590106 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e05d22-caa2-482f-9e10-85eb3c920b61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be06f1722f3f46e28555b0135ce9521a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:48.592361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e05d22-caa2-482f-9e10-85eb3c920b61 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:48.844827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e9e05d22-caa2-482f-9e10-85eb3c920b61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be06f1722f3f46e28555b0135ce9521a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.871885 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e9e05d22-caa2-482f-9e10-85eb3c920b61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be06f1722f3f46e28555b0135ce9521a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.871885 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e9e05d22-caa2-482f-9e10-85eb3c920b61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be06f1722f3f46e28555b0135ce9521a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.871885 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e9e05d22-caa2-482f-9e10-85eb3c920b61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be06f1722f3f46e28555b0135ce9521a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.886813 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e9e05d22-caa2-482f-9e10-85eb3c920b61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be06f1722f3f46e28555b0135ce9521a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:48.893576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:49.049175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1158/2312] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:10:48 2022] DELETE /identity/v3/users/be06f1722f3f46e28555b0135ce9521a => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:49.057521 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f5a7e-d037-4e6d-a73a-f240a603174a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:49.058383 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f5a7e-d037-4e6d-a73a-f240a603174a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:49.058383 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110f5a7e-d037-4e6d-a73a-f240a603174a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:49.112811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-110f5a7e-d037-4e6d-a73a-f240a603174a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:10:49.117397 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-110f5a7e-d037-4e6d-a73a-f240a603174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:49.299894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1155/2313] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:10:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:10:49.322124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e05d22-caa2-482f-9e10-85eb3c920b61 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:49.323678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e9e05d22-caa2-482f-9e10-85eb3c920b61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:49.517179 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e05d22-caa2-482f-9e10-85eb3c920b61 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:49.524466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b38cb-5432-44fb-94ad-0d58dc82fe86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:49.525512 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b38cb-5432-44fb-94ad-0d58dc82fe86 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:49.526616 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b38cb-5432-44fb-94ad-0d58dc82fe86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:49.527249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b38cb-5432-44fb-94ad-0d58dc82fe86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:49.550138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b38cb-5432-44fb-94ad-0d58dc82fe86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:49.552750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b38cb-5432-44fb-94ad-0d58dc82fe86 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:49.580320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1159/2314] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:10:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:10:50.907655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f5a7e-d037-4e6d-a73a-f240a603174a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:10:50.911207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-110f5a7e-d037-4e6d-a73a-f240a603174a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:10:50.922559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110f5a7e-d037-4e6d-a73a-f240a603174a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:10:50.928013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5e8b5e-f22c-43b3-89b7-130c201e5090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:10:50.929336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e8b5e-f22c-43b3-89b7-130c201e5090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:10:50.929336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e8b5e-f22c-43b3-89b7-130c201e5090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:10:50.929336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5e8b5e-f22c-43b3-89b7-130c201e5090 admin admin] PATH_INFO: `/v3/projects/3dd0ade1759047c896e4833f3163d4c3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:10:50.930565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e8b5e-f22c-43b3-89b7-130c201e5090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd0ade1759047c896e4833f3163d4c3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:10:50.932688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5e8b5e-f22c-43b3-89b7-130c201e5090 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:10:51.087401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:10:51.103799 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3a5e8b5e-f22c-43b3-89b7-130c201e5090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd0ade1759047c896e4833f3163d4c3', 'request_id': 'req-3a5e8b5e-f22c-43b3-89b7-130c201e5090'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:51.110593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3a5e8b5e-f22c-43b3-89b7-130c201e5090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd0ade1759047c896e4833f3163d4c3', 'request_id': 'req-3a5e8b5e-f22c-43b3-89b7-130c201e5090'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:51.182824 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3a5e8b5e-f22c-43b3-89b7-130c201e5090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd0ade1759047c896e4833f3163d4c3', 'request_id': 'req-3a5e8b5e-f22c-43b3-89b7-130c201e5090'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:51.209591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3a5e8b5e-f22c-43b3-89b7-130c201e5090 admin admin] The token cache is being invalidate because project 3dd0ade1759047c896e4833f3163d4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:10:51.209974 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3a5e8b5e-f22c-43b3-89b7-130c201e5090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:51.211000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3a5e8b5e-f22c-43b3-89b7-130c201e5090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:10:51.212635 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1156/2315] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:10:50 2022] DELETE /identity/v3/projects/3dd0ade1759047c896e4833f3163d4c3 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:10:59.567498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:01.475490 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=10,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:04.499762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade944d-c1d5-428e-bead-6150416ad84b None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:04.500260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade944d-c1d5-428e-bead-6150416ad84b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:04.500474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade944d-c1d5-428e-bead-6150416ad84b None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:04.502101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1160/2316] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 24 08:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:11:04.508078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff2ff5-17d7-4f8c-9918-c4bc56ad93af None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:04.508561 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff2ff5-17d7-4f8c-9918-c4bc56ad93af None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:04.508775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff2ff5-17d7-4f8c-9918-c4bc56ad93af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:04.534156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c3ff2ff5-17d7-4f8c-9918-c4bc56ad93af None None] MFA Rules not processed for user `9b99cff7a5f549adadee002f8ab1f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:04.536139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c3ff2ff5-17d7-4f8c-9918-c4bc56ad93af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:04.608821 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1157/2317] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 24 08:11:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:04.620304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade944d-c1d5-428e-bead-6150416ad84b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:04.622447 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6ade944d-c1d5-428e-bead-6150416ad84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:04.684736 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade944d-c1d5-428e-bead-6150416ad84b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:04.690314 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c6fb9-4785-445f-990c-05cb023eb880 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c83e30a9fd04385b44ee3a3b72e5099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:04.691079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c6fb9-4785-445f-990c-05cb023eb880 service glance] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:04.691618 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c6fb9-4785-445f-990c-05cb023eb880 service glance] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:04.692060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c6fb9-4785-445f-990c-05cb023eb880 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:04.703795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c6fb9-4785-445f-990c-05cb023eb880 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:04.705388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c6fb9-4785-445f-990c-05cb023eb880 service glance] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:04.717830 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1161/2318] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:11:04.932589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65559f27-ac3b-4753-a4eb-777c43bd17f8 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:04.932891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65559f27-ac3b-4753-a4eb-777c43bd17f8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:04.933164 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65559f27-ac3b-4753-a4eb-777c43bd17f8 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:04.934515 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1158/2319] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 24 08:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:11:04.939442 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec1a5f-50e1-4599-8521-d45427165790 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:04.939967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec1a5f-50e1-4599-8521-d45427165790 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:04.940302 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ec1a5f-50e1-4599-8521-d45427165790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:04.961092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d7ec1a5f-50e1-4599-8521-d45427165790 None None] MFA Rules not processed for user `f49116f202774e4da0c96875ffa08288`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:04.962361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d7ec1a5f-50e1-4599-8521-d45427165790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:05.025495 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1162/2320] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 24 08:11:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:05.039286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65559f27-ac3b-4753-a4eb-777c43bd17f8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.041424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-65559f27-ac3b-4753-a4eb-777c43bd17f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:05.072872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65559f27-ac3b-4753-a4eb-777c43bd17f8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.078240 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911e070-fcc6-4794-be6d-3d3cb8a4a91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.078897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911e070-fcc6-4794-be6d-3d3cb8a4a91b service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.079200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911e070-fcc6-4794-be6d-3d3cb8a4a91b service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.079469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911e070-fcc6-4794-be6d-3d3cb8a4a91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.088487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6ab97-b108-4d7b-a392-cb77a41733d5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.088915 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6ab97-b108-4d7b-a392-cb77a41733d5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.094613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6ab97-b108-4d7b-a392-cb77a41733d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.094768 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911e070-fcc6-4794-be6d-3d3cb8a4a91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.094768 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911e070-fcc6-4794-be6d-3d3cb8a4a91b service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.115996 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-eba6ab97-b108-4d7b-a392-cb77a41733d5 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:05.118463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-eba6ab97-b108-4d7b-a392-cb77a41733d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:05.118810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1159/2321] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:05.197280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1163/2322] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 08:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:05.216690 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8230ca3-dc9e-4ded-af89-74e5a72beb93 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.216968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8230ca3-dc9e-4ded-af89-74e5a72beb93 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.217243 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8230ca3-dc9e-4ded-af89-74e5a72beb93 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.218611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1160/2323] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 24 08:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:11:05.224760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b54eb-0516-4d3b-836e-29fb76e8fcbf None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.225046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b54eb-0516-4d3b-836e-29fb76e8fcbf None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.225403 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8230ca3-dc9e-4ded-af89-74e5a72beb93 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.225532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b54eb-0516-4d3b-836e-29fb76e8fcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.227834 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b8230ca3-dc9e-4ded-af89-74e5a72beb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:05.255134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-268b54eb-0516-4d3b-836e-29fb76e8fcbf None None] MFA Rules not processed for user `9b99cff7a5f549adadee002f8ab1f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:05.256985 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-268b54eb-0516-4d3b-836e-29fb76e8fcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:05.259523 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8230ca3-dc9e-4ded-af89-74e5a72beb93 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.266241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ca12f-495a-4ead-a766-e8f9c0fe23d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.266851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca12f-495a-4ead-a766-e8f9c0fe23d5 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.267129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca12f-495a-4ead-a766-e8f9c0fe23d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.267404 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ca12f-495a-4ead-a766-e8f9c0fe23d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.268796 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1164/2324] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 24 08:11:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:05.280470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b54eb-0516-4d3b-836e-29fb76e8fcbf None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:05.286038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ca12f-495a-4ead-a766-e8f9c0fe23d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.288263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ca12f-495a-4ead-a766-e8f9c0fe23d5 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.291011 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b54eb-0516-4d3b-836e-29fb76e8fcbf None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:05.295169 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d7300-9705-4505-b736-850692c89d05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:05.296124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d7300-9705-4505-b736-850692c89d05 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:05.296407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d7300-9705-4505-b736-850692c89d05 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:05.296680 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d7300-9705-4505-b736-850692c89d05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:05.299578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1161/2325] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:05.314148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d7300-9705-4505-b736-850692c89d05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:05.317338 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969d7300-9705-4505-b736-850692c89d05 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:05.337913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1165/2326] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:11:08.426583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ca12f-495a-4ead-a766-e8f9c0fe23d5 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:08.428011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-531ca12f-495a-4ead-a766-e8f9c0fe23d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:08.485809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ca12f-495a-4ead-a766-e8f9c0fe23d5 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:08.489602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9cfb0-33ce-4526-8137-e98b396f9dfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:08.490205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9cfb0-33ce-4526-8137-e98b396f9dfd service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:08.490481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9cfb0-33ce-4526-8137-e98b396f9dfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:08.490755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9cfb0-33ce-4526-8137-e98b396f9dfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:08.492533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-22c9cfb0-33ce-4526-8137-e98b396f9dfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:08.564049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9cfb0-33ce-4526-8137-e98b396f9dfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:08.565481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c9cfb0-33ce-4526-8137-e98b396f9dfd service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:08.575628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1162/2327] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:10.601325 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2097-d0cb-465e-9b2c-6f7fcc470101 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:10.601871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2097-d0cb-465e-9b2c-6f7fcc470101 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:10.601983 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2097-d0cb-465e-9b2c-6f7fcc470101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:10.621260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d71e2097-d0cb-465e-9b2c-6f7fcc470101 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:10.622443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d71e2097-d0cb-465e-9b2c-6f7fcc470101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:10.630906 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1166/2328] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 08:11:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:10.667427 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9cfb0-33ce-4526-8137-e98b396f9dfd service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:10.668860 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-22c9cfb0-33ce-4526-8137-e98b396f9dfd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:10.684879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c9cfb0-33ce-4526-8137-e98b396f9dfd service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:10.690242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447cf7a-f9e0-4a38-8fb0-5a6528932434 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:10.690832 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447cf7a-f9e0-4a38-8fb0-5a6528932434 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:10.691740 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447cf7a-f9e0-4a38-8fb0-5a6528932434 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:10.692034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447cf7a-f9e0-4a38-8fb0-5a6528932434 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:10.700058 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447cf7a-f9e0-4a38-8fb0-5a6528932434 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:10.701605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8447cf7a-f9e0-4a38-8fb0-5a6528932434 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:10.711150 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1163/2329] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:11.671509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e2097-d0cb-465e-9b2c-6f7fcc470101 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:11.672977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d71e2097-d0cb-465e-9b2c-6f7fcc470101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:11.685679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e2097-d0cb-465e-9b2c-6f7fcc470101 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:11.689315 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60d72a-3194-435b-89e0-378ab82b9126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:11.689910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60d72a-3194-435b-89e0-378ab82b9126 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:11.692955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60d72a-3194-435b-89e0-378ab82b9126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:11.692955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60d72a-3194-435b-89e0-378ab82b9126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:11.692955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6b60d72a-3194-435b-89e0-378ab82b9126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:11.717210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:11.755351 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60d72a-3194-435b-89e0-378ab82b9126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:11.756734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60d72a-3194-435b-89e0-378ab82b9126 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:11.766072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1167/2330] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:11:16.093883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6e900-5ebf-42b7-b3ce-3ed9347ba9c2 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.094355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6e900-5ebf-42b7-b3ce-3ed9347ba9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.094454 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6e900-5ebf-42b7-b3ce-3ed9347ba9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.102874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:16.116615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-09a6e900-5ebf-42b7-b3ce-3ed9347ba9c2 None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:16.118694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-09a6e900-5ebf-42b7-b3ce-3ed9347ba9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:16.173527 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1164/2331] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:11:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:16.186760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60d72a-3194-435b-89e0-378ab82b9126 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:16.188174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6b60d72a-3194-435b-89e0-378ab82b9126 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:16.256572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60d72a-3194-435b-89e0-378ab82b9126 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:16.261539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b065d1-7df9-4a4a-90ae-2bd9ad7af3fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:16.262166 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b065d1-7df9-4a4a-90ae-2bd9ad7af3fe service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:16.262449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b065d1-7df9-4a4a-90ae-2bd9ad7af3fe service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:16.262824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b065d1-7df9-4a4a-90ae-2bd9ad7af3fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:16.271132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b065d1-7df9-4a4a-90ae-2bd9ad7af3fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:16.272829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b065d1-7df9-4a4a-90ae-2bd9ad7af3fe service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:16.280953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1168/2332] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:11:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:11:17.495048 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a29b6-d28d-476e-a635-3d9f269e2a6f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:17.495618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a29b6-d28d-476e-a635-3d9f269e2a6f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:17.495978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a29b6-d28d-476e-a635-3d9f269e2a6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:17.524900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3a2a29b6-d28d-476e-a635-3d9f269e2a6f None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:17.526121 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3a2a29b6-d28d-476e-a635-3d9f269e2a6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:17.535557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1165/2333] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 08:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:17.565029 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b065d1-7df9-4a4a-90ae-2bd9ad7af3fe service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:17.578266 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b065d1-7df9-4a4a-90ae-2bd9ad7af3fe service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:17.585170 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93be421-5aca-4e40-95db-554c14e2d634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:17.586016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93be421-5aca-4e40-95db-554c14e2d634 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:17.586111 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93be421-5aca-4e40-95db-554c14e2d634 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:17.586306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93be421-5aca-4e40-95db-554c14e2d634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:17.595919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93be421-5aca-4e40-95db-554c14e2d634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:17.597568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93be421-5aca-4e40-95db-554c14e2d634 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:17.609070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1169/2334] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:27.518687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=27 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:27.603008 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=56 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:33.523827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11420c-a8d8-4bb1-8b63-8132321abfd6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:33.524385 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11420c-a8d8-4bb1-8b63-8132321abfd6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:33.524385 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11420c-a8d8-4bb1-8b63-8132321abfd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:33.543368 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2f11420c-a8d8-4bb1-8b63-8132321abfd6 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:33.544615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2f11420c-a8d8-4bb1-8b63-8132321abfd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:33.553277 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1166/2335] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 08:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:33.579347 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93be421-5aca-4e40-95db-554c14e2d634 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:33.591262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93be421-5aca-4e40-95db-554c14e2d634 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:33.596860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874a7a9-daed-473f-808e-e42e71278443 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:33.597470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874a7a9-daed-473f-808e-e42e71278443 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:33.597749 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874a7a9-daed-473f-808e-e42e71278443 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:33.598018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874a7a9-daed-473f-808e-e42e71278443 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:33.606763 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874a7a9-daed-473f-808e-e42e71278443 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:33.608411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874a7a9-daed-473f-808e-e42e71278443 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:33.618430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1170/2336] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:33.940033 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202a715-92ba-4a82-985a-166abaa74839 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:33.940389 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202a715-92ba-4a82-985a-166abaa74839 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:33.940746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7202a715-92ba-4a82-985a-166abaa74839 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:33.942199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1167/2337] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 24 08:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:11:33.954907 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ee172-9e55-4c66-af71-5a898170ed01 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:33.955219 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ee172-9e55-4c66-af71-5a898170ed01 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:33.955499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ee172-9e55-4c66-af71-5a898170ed01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:33.976871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f07ee172-9e55-4c66-af71-5a898170ed01 None None] MFA Rules not processed for user `d213e29685f3402b804d4d8fbc88ba96`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:33.978075 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f07ee172-9e55-4c66-af71-5a898170ed01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:34.041030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1171/2338] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 24 08:11:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:34.051816 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202a715-92ba-4a82-985a-166abaa74839 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:34.054178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7202a715-92ba-4a82-985a-166abaa74839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:34.072549 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7202a715-92ba-4a82-985a-166abaa74839 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:34.083387 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7a1fe-d786-4ec5-9311-f3c4ff0aaf64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213e29685f3402b804d4d8fbc88ba96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:34.083387 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7a1fe-d786-4ec5-9311-f3c4ff0aaf64 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:34.083387 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7a1fe-d786-4ec5-9311-f3c4ff0aaf64 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:34.083387 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7a1fe-d786-4ec5-9311-f3c4ff0aaf64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:34.098154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7a1fe-d786-4ec5-9311-f3c4ff0aaf64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:34.100695 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7a1fe-d786-4ec5-9311-f3c4ff0aaf64 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:34.112438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1168/2339] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:34.736990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ee172-9e55-4c66-af71-5a898170ed01 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:34.738399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f07ee172-9e55-4c66-af71-5a898170ed01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:34.754143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ee172-9e55-4c66-af71-5a898170ed01 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:34.759569 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744308aa-1540-4b4c-8c10-22b62aa414d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:34.760262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744308aa-1540-4b4c-8c10-22b62aa414d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:34.760538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744308aa-1540-4b4c-8c10-22b62aa414d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:34.765196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744308aa-1540-4b4c-8c10-22b62aa414d1 admin admin] PATH_INFO: `/v3/users/499bd50893994d2ba9337a66f3ddbda5` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:34.765196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744308aa-1540-4b4c-8c10-22b62aa414d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=499bd50893994d2ba9337a66f3ddbda5)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:34.765196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744308aa-1540-4b4c-8c10-22b62aa414d1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:34.937124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-744308aa-1540-4b4c-8c10-22b62aa414d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '499bd50893994d2ba9337a66f3ddbda5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:34.949152 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-744308aa-1540-4b4c-8c10-22b62aa414d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '499bd50893994d2ba9337a66f3ddbda5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:34.949818 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-744308aa-1540-4b4c-8c10-22b62aa414d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '499bd50893994d2ba9337a66f3ddbda5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:34.950434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-744308aa-1540-4b4c-8c10-22b62aa414d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '499bd50893994d2ba9337a66f3ddbda5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:34.957387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-744308aa-1540-4b4c-8c10-22b62aa414d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '499bd50893994d2ba9337a66f3ddbda5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:35.027157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1172/2340] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:34 2022] DELETE /identity/v3/users/499bd50893994d2ba9337a66f3ddbda5 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:35.273389 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7a1fe-d786-4ec5-9311-f3c4ff0aaf64 service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:35.284280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7a1fe-d786-4ec5-9311-f3c4ff0aaf64 service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:35.342646 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:35.343766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:35.344068 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:35.344337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] PATH_INFO: `/v3/projects/aadada8c36734a7da3f9960c4e69ff1f` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:35.345442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aadada8c36734a7da3f9960c4e69ff1f)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:35.347329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:35.484585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aadada8c36734a7da3f9960c4e69ff1f', 'request_id': 'req-a6b466e6-ded8-43ed-91df-9e067222a746'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:35.491344 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aadada8c36734a7da3f9960c4e69ff1f', 'request_id': 'req-a6b466e6-ded8-43ed-91df-9e067222a746'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:35.529988 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aadada8c36734a7da3f9960c4e69ff1f', 'request_id': 'req-a6b466e6-ded8-43ed-91df-9e067222a746'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:35.542785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] The token cache is being invalidate because project aadada8c36734a7da3f9960c4e69ff1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:35.543142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:35.543895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:35.545466 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1169/2341] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:35 2022] DELETE /identity/v3/projects/aadada8c36734a7da3f9960c4e69ff1f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:35.549635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744308aa-1540-4b4c-8c10-22b62aa414d1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:35.551037 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-744308aa-1540-4b4c-8c10-22b62aa414d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:35.566084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744308aa-1540-4b4c-8c10-22b62aa414d1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:35.617852 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:35.624870 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105371e9-1490-4152-8ab4-6ed830bfc432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:35.625511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105371e9-1490-4152-8ab4-6ed830bfc432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:35.627089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105371e9-1490-4152-8ab4-6ed830bfc432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:35.627089 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105371e9-1490-4152-8ab4-6ed830bfc432 admin admin] PATH_INFO: `/v3/users/20ed156e7f2f41aaa4f522afdb1e067a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:35.627266 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105371e9-1490-4152-8ab4-6ed830bfc432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ed156e7f2f41aaa4f522afdb1e067a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:35.629117 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105371e9-1490-4152-8ab4-6ed830bfc432 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:35.778228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-105371e9-1490-4152-8ab4-6ed830bfc432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ed156e7f2f41aaa4f522afdb1e067a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:35.790989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-105371e9-1490-4152-8ab4-6ed830bfc432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ed156e7f2f41aaa4f522afdb1e067a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:35.791681 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-105371e9-1490-4152-8ab4-6ed830bfc432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ed156e7f2f41aaa4f522afdb1e067a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:35.792318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-105371e9-1490-4152-8ab4-6ed830bfc432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ed156e7f2f41aaa4f522afdb1e067a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:35.799250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-105371e9-1490-4152-8ab4-6ed830bfc432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ed156e7f2f41aaa4f522afdb1e067a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:35.872600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1173/2342] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:35 2022] DELETE /identity/v3/users/20ed156e7f2f41aaa4f522afdb1e067a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:36.141846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:36.148928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:36.161589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b466e6-ded8-43ed-91df-9e067222a746 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:36.218580 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:36.219237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:36.219508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:36.219777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1 admin admin] PATH_INFO: `/v3/projects/a021253ee6984fbbbe4f2811db2c5286` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:36.220932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a021253ee6984fbbbe4f2811db2c5286)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:36.222818 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:36.234614 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:36.352979 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a021253ee6984fbbbe4f2811db2c5286', 'request_id': 'req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:36.359190 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a021253ee6984fbbbe4f2811db2c5286', 'request_id': 'req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:36.432813 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a021253ee6984fbbbe4f2811db2c5286', 'request_id': 'req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:36.444181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1 admin admin] The token cache is being invalidate because project a021253ee6984fbbbe4f2811db2c5286 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:36.444696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:36.445843 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0458c026-88ea-4fcd-addd-5d6f6e21a0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:36.447336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1170/2343] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:36 2022] DELETE /identity/v3/projects/a021253ee6984fbbbe4f2811db2c5286 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:36.452408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc59f69-8ac0-40ea-9cb4-1b71f44c8467 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:36.452691 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc59f69-8ac0-40ea-9cb4-1b71f44c8467 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:36.453114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc59f69-8ac0-40ea-9cb4-1b71f44c8467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:36.472086 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fcc59f69-8ac0-40ea-9cb4-1b71f44c8467 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:36.473271 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fcc59f69-8ac0-40ea-9cb4-1b71f44c8467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:36.532013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1174/2344] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:36.540412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a646c79-e096-4b74-b004-c4058a699f80 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:36.540701 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a646c79-e096-4b74-b004-c4058a699f80 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:36.540979 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a646c79-e096-4b74-b004-c4058a699f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:36.561419 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6a646c79-e096-4b74-b004-c4058a699f80 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:36.562621 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6a646c79-e096-4b74-b004-c4058a699f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:36.570746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1171/2345] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:36.574940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc59f69-8ac0-40ea-9cb4-1b71f44c8467 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:36.585222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc59f69-8ac0-40ea-9cb4-1b71f44c8467 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:36.589827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da176b49-02a1-4769-a594-1f02b7915772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:36.590403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da176b49-02a1-4769-a594-1f02b7915772 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:36.590681 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da176b49-02a1-4769-a594-1f02b7915772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:36.590953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da176b49-02a1-4769-a594-1f02b7915772 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:36.591596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da176b49-02a1-4769-a594-1f02b7915772 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:11:36.591920 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da176b49-02a1-4769-a594-1f02b7915772 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:36.593506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da176b49-02a1-4769-a594-1f02b7915772 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:36.605506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1175/2346] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:11:36.609922 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a646c79-e096-4b74-b004-c4058a699f80 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:36.619161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a646c79-e096-4b74-b004-c4058a699f80 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:36.623795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9394b-e33f-4ccb-8066-b6c70f52456c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:36.624422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9394b-e33f-4ccb-8066-b6c70f52456c admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:36.624715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9394b-e33f-4ccb-8066-b6c70f52456c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:36.624979 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9394b-e33f-4ccb-8066-b6c70f52456c admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:36.625602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9394b-e33f-4ccb-8066-b6c70f52456c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:36.627489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9394b-e33f-4ccb-8066-b6c70f52456c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:36.741442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1172/2347] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:36 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:36.742586 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da176b49-02a1-4769-a594-1f02b7915772 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:36.752825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da176b49-02a1-4769-a594-1f02b7915772 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:36.815098 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a53bd-cbc6-432d-b61b-591634898b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:36.816028 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a53bd-cbc6-432d-b61b-591634898b11 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:36.816357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a53bd-cbc6-432d-b61b-591634898b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:36.816691 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77a53bd-cbc6-432d-b61b-591634898b11 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:36.817357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a53bd-cbc6-432d-b61b-591634898b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:36.819544 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77a53bd-cbc6-432d-b61b-591634898b11 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:36.828903 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:36.895123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1176/2348] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:36 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:36.899086 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9394b-e33f-4ccb-8066-b6c70f52456c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:36.910135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9394b-e33f-4ccb-8066-b6c70f52456c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:36.915705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedf7d95-18d0-4688-8deb-f75bc0eb66e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:36.916345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf7d95-18d0-4688-8deb-f75bc0eb66e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:36.916627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf7d95-18d0-4688-8deb-f75bc0eb66e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:36.920159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedf7d95-18d0-4688-8deb-f75bc0eb66e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:36.920159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf7d95-18d0-4688-8deb-f75bc0eb66e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:36.920159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedf7d95-18d0-4688-8deb-f75bc0eb66e5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:36.929409 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1173/2349] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:36.933594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a53bd-cbc6-432d-b61b-591634898b11 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:36.946927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77a53bd-cbc6-432d-b61b-591634898b11 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:36.954916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54730fe8-7e1f-4f11-bbc4-f65feddc2d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:36.956118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54730fe8-7e1f-4f11-bbc4-f65feddc2d2c admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:36.956625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54730fe8-7e1f-4f11-bbc4-f65feddc2d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:36.957100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54730fe8-7e1f-4f11-bbc4-f65feddc2d2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:36.958547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54730fe8-7e1f-4f11-bbc4-f65feddc2d2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:36.961963 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54730fe8-7e1f-4f11-bbc4-f65feddc2d2c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:36.974421 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae924493-ae26-4bcf-ab57-9bdabc0f18b8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:36.977868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1177/2350] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:36.977992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae924493-ae26-4bcf-ab57-9bdabc0f18b8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:36.977992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae924493-ae26-4bcf-ab57-9bdabc0f18b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:36.978799 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54730fe8-7e1f-4f11-bbc4-f65feddc2d2c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:36.988428 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54730fe8-7e1f-4f11-bbc4-f65feddc2d2c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:36.993762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1118f3f9-402d-4ffa-b309-141be35e240d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:36.994421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118f3f9-402d-4ffa-b309-141be35e240d admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:36.994701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118f3f9-402d-4ffa-b309-141be35e240d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:36.994971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1118f3f9-402d-4ffa-b309-141be35e240d admin admin] PATH_INFO: `/v3/projects/ecf5bcc16afc4918a41fae526c1e3c47/users/e989e9affd7e4d2789d69cbce837f8ef/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:36.995121 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ae924493-ae26-4bcf-ab57-9bdabc0f18b8 None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:36.996413 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ae924493-ae26-4bcf-ab57-9bdabc0f18b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:37.010518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118f3f9-402d-4ffa-b309-141be35e240d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecf5bcc16afc4918a41fae526c1e3c47, user_id=e989e9affd7e4d2789d69cbce837f8ef, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:37.013266 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1118f3f9-402d-4ffa-b309-141be35e240d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:37.056046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1174/2351] 10.222.0.62 () {58 vars in 967 bytes} [Wed Aug 24 08:11:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:37.069502 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae924493-ae26-4bcf-ab57-9bdabc0f18b8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:37.070873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ae924493-ae26-4bcf-ab57-9bdabc0f18b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:37.100464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1178/2352] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:36 2022] PUT /identity/v3/projects/ecf5bcc16afc4918a41fae526c1e3c47/users/e989e9affd7e4d2789d69cbce837f8ef/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:11:37.111555 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278c50-6a08-4776-adaf-fb7786bdd16e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:37.111838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278c50-6a08-4776-adaf-fb7786bdd16e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:37.112145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb278c50-6a08-4776-adaf-fb7786bdd16e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:37.140144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cb278c50-6a08-4776-adaf-fb7786bdd16e None None] MFA Rules not processed for user `e989e9affd7e4d2789d69cbce837f8ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:37.141344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cb278c50-6a08-4776-adaf-fb7786bdd16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:37.143247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae924493-ae26-4bcf-ab57-9bdabc0f18b8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:37.149062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:37.204637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081c98c-50d5-4170-bb69-6b3ec1ec0584 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:37.205319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081c98c-50d5-4170-bb69-6b3ec1ec0584 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:37.205610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081c98c-50d5-4170-bb69-6b3ec1ec0584 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:37.205879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081c98c-50d5-4170-bb69-6b3ec1ec0584 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:37.207608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1179/2353] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:11:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:11:37.219701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb278c50-6a08-4776-adaf-fb7786bdd16e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:37.221109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cb278c50-6a08-4776-adaf-fb7786bdd16e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:37.267109 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081c98c-50d5-4170-bb69-6b3ec1ec0584 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:37.268769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081c98c-50d5-4170-bb69-6b3ec1ec0584 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:37.277535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1175/2354] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:11:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:11:37.282638 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb278c50-6a08-4776-adaf-fb7786bdd16e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:37.287606 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfa427-6b83-486e-a95d-3eed82dc7d61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:37.287787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfa427-6b83-486e-a95d-3eed82dc7d61 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:37.288244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfa427-6b83-486e-a95d-3eed82dc7d61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:37.288474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfa427-6b83-486e-a95d-3eed82dc7d61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:37.299955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfa427-6b83-486e-a95d-3eed82dc7d61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:37.299955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfa427-6b83-486e-a95d-3eed82dc7d61 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:37.309269 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1180/2355] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:11:37.766452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e14195-e5fe-46b8-a4fb-4ad0b1df9519 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:37.766993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e14195-e5fe-46b8-a4fb-4ad0b1df9519 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:37.766993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e14195-e5fe-46b8-a4fb-4ad0b1df9519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:37.788574 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-26e14195-e5fe-46b8-a4fb-4ad0b1df9519 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:37.789792 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-26e14195-e5fe-46b8-a4fb-4ad0b1df9519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:37.855420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1176/2356] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 08:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:37.881137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfa427-6b83-486e-a95d-3eed82dc7d61 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:37.882681 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d2dfa427-6b83-486e-a95d-3eed82dc7d61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:37.942037 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:37.974081 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfa427-6b83-486e-a95d-3eed82dc7d61 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:37.980790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6f410-5794-44d8-aee7-de076086572f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:37.981417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6f410-5794-44d8-aee7-de076086572f service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:37.981698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6f410-5794-44d8-aee7-de076086572f service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:37.982154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea6f410-5794-44d8-aee7-de076086572f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:37.994778 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6f410-5794-44d8-aee7-de076086572f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:37.996443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea6f410-5794-44d8-aee7-de076086572f service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:38.007910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1181/2357] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:42.041224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1a0a-85e2-4769-84e5-8ff4aec8bbfe None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:42.041749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1a0a-85e2-4769-84e5-8ff4aec8bbfe None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:42.041847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2a1a0a-85e2-4769-84e5-8ff4aec8bbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:42.062363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2e2a1a0a-85e2-4769-84e5-8ff4aec8bbfe None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:42.063500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2e2a1a0a-85e2-4769-84e5-8ff4aec8bbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:42.072322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1177/2358] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 08:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:42.094595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6f410-5794-44d8-aee7-de076086572f service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:42.095999 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-dea6f410-5794-44d8-aee7-de076086572f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:42.111138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea6f410-5794-44d8-aee7-de076086572f service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:42.116604 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f1fa0-2a70-4812-b4a8-b749986560bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:42.117854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1fa0-2a70-4812-b4a8-b749986560bd service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:42.117854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1fa0-2a70-4812-b4a8-b749986560bd service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:42.117854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f1fa0-2a70-4812-b4a8-b749986560bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:42.126657 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f1fa0-2a70-4812-b4a8-b749986560bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:42.128273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f1fa0-2a70-4812-b4a8-b749986560bd service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:42.137693 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1182/2359] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:48.345559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a1a0a-85e2-4769-84e5-8ff4aec8bbfe None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:48.347079 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2e2a1a0a-85e2-4769-84e5-8ff4aec8bbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:48.427569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:48.450610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2a1a0a-85e2-4769-84e5-8ff4aec8bbfe None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:48.455688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aee75b-6914-48f6-b602-c4126c441f15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213e29685f3402b804d4d8fbc88ba96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:48.456324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee75b-6914-48f6-b602-c4126c441f15 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:48.456604 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee75b-6914-48f6-b602-c4126c441f15 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:48.456871 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aee75b-6914-48f6-b602-c4126c441f15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:48.458575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-87aee75b-6914-48f6-b602-c4126c441f15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:48.474438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aee75b-6914-48f6-b602-c4126c441f15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:48.480249 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aee75b-6914-48f6-b602-c4126c441f15 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:48.486254 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1178/2360] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:52.133476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=18 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:52.363290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f1fa0-2a70-4812-b4a8-b749986560bd service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:52.373917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f1fa0-2a70-4812-b4a8-b749986560bd service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:52.378547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb78a1-2e0a-4968-a242-b9e955018a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:52.379171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb78a1-2e0a-4968-a242-b9e955018a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:52.379448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb78a1-2e0a-4968-a242-b9e955018a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:52.379729 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb78a1-2e0a-4968-a242-b9e955018a99 admin admin] PATH_INFO: `/v3/users/e989e9affd7e4d2789d69cbce837f8ef` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:52.381258 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb78a1-2e0a-4968-a242-b9e955018a99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e989e9affd7e4d2789d69cbce837f8ef)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:52.382851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cb78a1-2e0a-4968-a242-b9e955018a99 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:52.548446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-41cb78a1-2e0a-4968-a242-b9e955018a99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e989e9affd7e4d2789d69cbce837f8ef'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.560419 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-41cb78a1-2e0a-4968-a242-b9e955018a99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e989e9affd7e4d2789d69cbce837f8ef'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.561076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-41cb78a1-2e0a-4968-a242-b9e955018a99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e989e9affd7e4d2789d69cbce837f8ef'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.561670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-41cb78a1-2e0a-4968-a242-b9e955018a99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e989e9affd7e4d2789d69cbce837f8ef'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.568513 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-41cb78a1-2e0a-4968-a242-b9e955018a99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e989e9affd7e4d2789d69cbce837f8ef'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:52.614486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1183/2361] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:52 2022] DELETE /identity/v3/users/e989e9affd7e4d2789d69cbce837f8ef => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:52.622289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da672-b809-4a61-96c5-82b9eb075a01 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:52.622289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da672-b809-4a61-96c5-82b9eb075a01 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:52.622289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da672-b809-4a61-96c5-82b9eb075a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:52.638382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a38da672-b809-4a61-96c5-82b9eb075a01 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:52.639577 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a38da672-b809-4a61-96c5-82b9eb075a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:52.699904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1179/2362] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:52.710351 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb78a1-2e0a-4968-a242-b9e955018a99 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:52.711743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-41cb78a1-2e0a-4968-a242-b9e955018a99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:52.769059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb78a1-2e0a-4968-a242-b9e955018a99 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:52.772737 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700edf1b-90b0-40cb-85ea-74a17f93b089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:52.773342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700edf1b-90b0-40cb-85ea-74a17f93b089 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:52.773622 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700edf1b-90b0-40cb-85ea-74a17f93b089 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:52.773896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700edf1b-90b0-40cb-85ea-74a17f93b089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:52.783634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700edf1b-90b0-40cb-85ea-74a17f93b089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:52.785079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700edf1b-90b0-40cb-85ea-74a17f93b089 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:52.795354 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1184/2363] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:53.261682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38da672-b809-4a61-96c5-82b9eb075a01 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:53.263373 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a38da672-b809-4a61-96c5-82b9eb075a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:53.277287 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38da672-b809-4a61-96c5-82b9eb075a01 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:53.282658 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfd075-bc45-451e-b46f-7695a3db6a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:53.284996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfd075-bc45-451e-b46f-7695a3db6a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:53.284996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfd075-bc45-451e-b46f-7695a3db6a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:53.284996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfd075-bc45-451e-b46f-7695a3db6a65 admin admin] PATH_INFO: `/v3/projects/ecf5bcc16afc4918a41fae526c1e3c47` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:53.285918 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfd075-bc45-451e-b46f-7695a3db6a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecf5bcc16afc4918a41fae526c1e3c47)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:53.287717 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfd075-bc45-451e-b46f-7695a3db6a65 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:53.400116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cdcfd075-bc45-451e-b46f-7695a3db6a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecf5bcc16afc4918a41fae526c1e3c47', 'request_id': 'req-cdcfd075-bc45-451e-b46f-7695a3db6a65'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:53.407086 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cdcfd075-bc45-451e-b46f-7695a3db6a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecf5bcc16afc4918a41fae526c1e3c47', 'request_id': 'req-cdcfd075-bc45-451e-b46f-7695a3db6a65'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:53.464594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cdcfd075-bc45-451e-b46f-7695a3db6a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecf5bcc16afc4918a41fae526c1e3c47', 'request_id': 'req-cdcfd075-bc45-451e-b46f-7695a3db6a65'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:53.475398 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cdcfd075-bc45-451e-b46f-7695a3db6a65 admin admin] The token cache is being invalidate because project ecf5bcc16afc4918a41fae526c1e3c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:53.475677 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cdcfd075-bc45-451e-b46f-7695a3db6a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:53.476449 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cdcfd075-bc45-451e-b46f-7695a3db6a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:53.477950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1180/2364] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:53 2022] DELETE /identity/v3/projects/ecf5bcc16afc4918a41fae526c1e3c47 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:53.483679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37f177-cf0e-48e9-880b-ce467dbf13ed None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:53.484225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37f177-cf0e-48e9-880b-ce467dbf13ed None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:53.484334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f37f177-cf0e-48e9-880b-ce467dbf13ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:53.503556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0f37f177-cf0e-48e9-880b-ce467dbf13ed None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:53.504792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0f37f177-cf0e-48e9-880b-ce467dbf13ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:53.562848 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1185/2365] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:53.570612 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074acf2f-f34a-46c6-90d2-fa823cd7637c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:53.570916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074acf2f-f34a-46c6-90d2-fa823cd7637c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:53.571190 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074acf2f-f34a-46c6-90d2-fa823cd7637c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:53.591064 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-074acf2f-f34a-46c6-90d2-fa823cd7637c None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:53.592283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-074acf2f-f34a-46c6-90d2-fa823cd7637c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:53.600095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1181/2366] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:53.604130 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37f177-cf0e-48e9-880b-ce467dbf13ed None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:53.614544 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f37f177-cf0e-48e9-880b-ce467dbf13ed None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:53.619084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f5eb-db52-443f-8751-a236d7003f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:53.619675 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f5eb-db52-443f-8751-a236d7003f23 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:53.619984 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f5eb-db52-443f-8751-a236d7003f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:53.620267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3f5eb-db52-443f-8751-a236d7003f23 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:53.620890 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3f5eb-db52-443f-8751-a236d7003f23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:11:53.621189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3f5eb-db52-443f-8751-a236d7003f23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:53.622967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b3f5eb-db52-443f-8751-a236d7003f23 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:53.634080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1186/2367] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:11:53.638437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074acf2f-f34a-46c6-90d2-fa823cd7637c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:53.647629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074acf2f-f34a-46c6-90d2-fa823cd7637c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:53.652330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4e4ea-c366-4088-b681-a7cb6b9cc69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:53.653578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4e4ea-c366-4088-b681-a7cb6b9cc69b admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:53.653981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4e4ea-c366-4088-b681-a7cb6b9cc69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:53.654258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4e4ea-c366-4088-b681-a7cb6b9cc69b admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:53.654875 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4e4ea-c366-4088-b681-a7cb6b9cc69b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:53.656799 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f4e4ea-c366-4088-b681-a7cb6b9cc69b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:53.781899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1182/2368] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:53 2022] POST /identity/v3/projects => generated 371 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:53.786429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f5eb-db52-443f-8751-a236d7003f23 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:53.791876 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:53.797264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3f5eb-db52-443f-8751-a236d7003f23 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:53.855634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80f703-98bb-4f88-b85a-59bb6cd490e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:53.856306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80f703-98bb-4f88-b85a-59bb6cd490e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:53.856584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80f703-98bb-4f88-b85a-59bb6cd490e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:53.856851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa80f703-98bb-4f88-b85a-59bb6cd490e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:53.857524 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80f703-98bb-4f88-b85a-59bb6cd490e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:53.859494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa80f703-98bb-4f88-b85a-59bb6cd490e8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:53.953216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1187/2369] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:53 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:53.957019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4e4ea-c366-4088-b681-a7cb6b9cc69b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:53.968097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f4e4ea-c366-4088-b681-a7cb6b9cc69b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:53.972665 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecea7e-38e2-45f2-9b23-638d0ce43d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:53.973263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecea7e-38e2-45f2-9b23-638d0ce43d01 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:53.973536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecea7e-38e2-45f2-9b23-638d0ce43d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:53.973801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecea7e-38e2-45f2-9b23-638d0ce43d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:53.974435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecea7e-38e2-45f2-9b23-638d0ce43d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:53.976069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecea7e-38e2-45f2-9b23-638d0ce43d01 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:53.986233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1183/2370] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:53.992404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80f703-98bb-4f88-b85a-59bb6cd490e8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:53.999894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa80f703-98bb-4f88-b85a-59bb6cd490e8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:54.004499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191f8e9f-4411-4168-b104-e34fb792d641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:54.005072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f8e9f-4411-4168-b104-e34fb792d641 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:54.005347 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f8e9f-4411-4168-b104-e34fb792d641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:54.005620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191f8e9f-4411-4168-b104-e34fb792d641 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:54.006241 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f8e9f-4411-4168-b104-e34fb792d641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:54.007887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191f8e9f-4411-4168-b104-e34fb792d641 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:54.018104 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1188/2371] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:54.021957 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecea7e-38e2-45f2-9b23-638d0ce43d01 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:54.033014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecea7e-38e2-45f2-9b23-638d0ce43d01 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:54.037515 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448df7a-9bf4-480e-a61b-a1e4623dd4f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:54.038173 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448df7a-9bf4-480e-a61b-a1e4623dd4f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:54.038508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448df7a-9bf4-480e-a61b-a1e4623dd4f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:54.038809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448df7a-9bf4-480e-a61b-a1e4623dd4f8 admin admin] PATH_INFO: `/v3/projects/379d623ff8be41ffbe286b5369e98c42/users/dfd41183193b408885d0712e0601e7bd/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:54.054475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448df7a-9bf4-480e-a61b-a1e4623dd4f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=379d623ff8be41ffbe286b5369e98c42, user_id=dfd41183193b408885d0712e0601e7bd, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:54.057513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b448df7a-9bf4-480e-a61b-a1e4623dd4f8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:54.060288 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:54.130038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1184/2372] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:54 2022] PUT /identity/v3/projects/379d623ff8be41ffbe286b5369e98c42/users/dfd41183193b408885d0712e0601e7bd/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:54.140595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5621b0-de41-4378-af18-6b5624a47723 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:54.140908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5621b0-de41-4378-af18-6b5624a47723 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:54.141181 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5621b0-de41-4378-af18-6b5624a47723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:54.169579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-0a5621b0-de41-4378-af18-6b5624a47723 None None] MFA Rules not processed for user `dfd41183193b408885d0712e0601e7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:54.170839 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0a5621b0-de41-4378-af18-6b5624a47723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:54.237498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1189/2373] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:11:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:54.249208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448df7a-9bf4-480e-a61b-a1e4623dd4f8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:54.250982 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b448df7a-9bf4-480e-a61b-a1e4623dd4f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:54.306776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448df7a-9bf4-480e-a61b-a1e4623dd4f8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:54.311541 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed9961-fd90-4337-bf09-5b123f7eca14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:54.312182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed9961-fd90-4337-bf09-5b123f7eca14 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:54.312461 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed9961-fd90-4337-bf09-5b123f7eca14 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:54.312734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed9961-fd90-4337-bf09-5b123f7eca14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:54.321221 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed9961-fd90-4337-bf09-5b123f7eca14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:54.322645 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed9961-fd90-4337-bf09-5b123f7eca14 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:54.332344 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1185/2374] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:54.357139 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5621b0-de41-4378-af18-6b5624a47723 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:54.420423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5621b0-de41-4378-af18-6b5624a47723 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:54.425152 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451dac4-6086-4d95-a476-0a8bd3993b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:54.425785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451dac4-6086-4d95-a476-0a8bd3993b58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:54.426068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451dac4-6086-4d95-a476-0a8bd3993b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:54.426342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b451dac4-6086-4d95-a476-0a8bd3993b58 admin admin] PATH_INFO: `/v3/users/dfd41183193b408885d0712e0601e7bd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:54.427558 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451dac4-6086-4d95-a476-0a8bd3993b58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dfd41183193b408885d0712e0601e7bd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:54.429530 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b451dac4-6086-4d95-a476-0a8bd3993b58 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:54.442943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:54.588368 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b451dac4-6086-4d95-a476-0a8bd3993b58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dfd41183193b408885d0712e0601e7bd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:54.600225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b451dac4-6086-4d95-a476-0a8bd3993b58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dfd41183193b408885d0712e0601e7bd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:54.600924 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b451dac4-6086-4d95-a476-0a8bd3993b58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dfd41183193b408885d0712e0601e7bd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:54.601527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b451dac4-6086-4d95-a476-0a8bd3993b58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dfd41183193b408885d0712e0601e7bd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:54.608871 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-b451dac4-6086-4d95-a476-0a8bd3993b58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dfd41183193b408885d0712e0601e7bd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:54.705836 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1190/2375] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:11:54 2022] DELETE /identity/v3/users/dfd41183193b408885d0712e0601e7bd => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:54.710500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89493ae2-e14b-4b27-b4df-14325cb90468 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:54.710998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89493ae2-e14b-4b27-b4df-14325cb90468 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:54.711093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89493ae2-e14b-4b27-b4df-14325cb90468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:54.734152 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-89493ae2-e14b-4b27-b4df-14325cb90468 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:54.735348 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-89493ae2-e14b-4b27-b4df-14325cb90468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:54.793791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1186/2376] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:54.803713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451dac4-6086-4d95-a476-0a8bd3993b58 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:54.805443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b451dac4-6086-4d95-a476-0a8bd3993b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:54.863328 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b451dac4-6086-4d95-a476-0a8bd3993b58 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:54.866961 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5401d5-9f67-4def-9d67-33eb5d1e7e29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:54.867564 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5401d5-9f67-4def-9d67-33eb5d1e7e29 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:54.867859 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5401d5-9f67-4def-9d67-33eb5d1e7e29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:54.868151 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5401d5-9f67-4def-9d67-33eb5d1e7e29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:54.877073 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5401d5-9f67-4def-9d67-33eb5d1e7e29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:54.878484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5401d5-9f67-4def-9d67-33eb5d1e7e29 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:54.887854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1191/2377] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:11:55.364560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89493ae2-e14b-4b27-b4df-14325cb90468 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:55.366008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-89493ae2-e14b-4b27-b4df-14325cb90468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:55.382343 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89493ae2-e14b-4b27-b4df-14325cb90468 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:55.388364 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0f772-da9f-466e-80a0-2d9b12728a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:55.389166 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0f772-da9f-466e-80a0-2d9b12728a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:55.389542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0f772-da9f-466e-80a0-2d9b12728a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:55.389939 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0f772-da9f-466e-80a0-2d9b12728a5c admin admin] PATH_INFO: `/v3/projects/379d623ff8be41ffbe286b5369e98c42` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:55.391284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0f772-da9f-466e-80a0-2d9b12728a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=379d623ff8be41ffbe286b5369e98c42)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:55.393711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0f772-da9f-466e-80a0-2d9b12728a5c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:55.521309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fef0f772-da9f-466e-80a0-2d9b12728a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '379d623ff8be41ffbe286b5369e98c42', 'request_id': 'req-fef0f772-da9f-466e-80a0-2d9b12728a5c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:55.527470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fef0f772-da9f-466e-80a0-2d9b12728a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '379d623ff8be41ffbe286b5369e98c42', 'request_id': 'req-fef0f772-da9f-466e-80a0-2d9b12728a5c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:55.597109 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fef0f772-da9f-466e-80a0-2d9b12728a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '379d623ff8be41ffbe286b5369e98c42', 'request_id': 'req-fef0f772-da9f-466e-80a0-2d9b12728a5c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:55.607998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fef0f772-da9f-466e-80a0-2d9b12728a5c admin admin] The token cache is being invalidate because project 379d623ff8be41ffbe286b5369e98c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:11:55.608287 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fef0f772-da9f-466e-80a0-2d9b12728a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:55.608904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fef0f772-da9f-466e-80a0-2d9b12728a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:11:55.610399 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1187/2378] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:11:55 2022] DELETE /identity/v3/projects/379d623ff8be41ffbe286b5369e98c42 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:55.615157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17c728-f4e5-4601-b023-af6e153a48a3 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:55.615630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17c728-f4e5-4601-b023-af6e153a48a3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:55.615735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af17c728-f4e5-4601-b023-af6e153a48a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:55.635491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-af17c728-f4e5-4601-b023-af6e153a48a3 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:55.636747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-af17c728-f4e5-4601-b023-af6e153a48a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:55.695452 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1192/2379] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:55.763780 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784412-f4b2-4482-a927-75a0395a86b6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:55.764347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784412-f4b2-4482-a927-75a0395a86b6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:55.764347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784412-f4b2-4482-a927-75a0395a86b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:55.784577 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-11784412-f4b2-4482-a927-75a0395a86b6 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:55.785793 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-11784412-f4b2-4482-a927-75a0395a86b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:55.794007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1188/2380] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:55.798244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17c728-f4e5-4601-b023-af6e153a48a3 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:55.809307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af17c728-f4e5-4601-b023-af6e153a48a3 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:55.814095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2ac0c-d896-4e20-81d0-28a9eeb7c709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:55.814690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2ac0c-d896-4e20-81d0-28a9eeb7c709 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:55.814967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2ac0c-d896-4e20-81d0-28a9eeb7c709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:55.815237 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2ac0c-d896-4e20-81d0-28a9eeb7c709 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:55.815904 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2ac0c-d896-4e20-81d0-28a9eeb7c709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:11:55.816209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2ac0c-d896-4e20-81d0-28a9eeb7c709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:55.817789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2ac0c-d896-4e20-81d0-28a9eeb7c709 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:55.830357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1193/2381] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:11:55.834639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11784412-f4b2-4482-a927-75a0395a86b6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:55.843954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11784412-f4b2-4482-a927-75a0395a86b6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:55.848577 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15032cf2-ec6b-46b7-be00-68729668e8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:55.849165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15032cf2-ec6b-46b7-be00-68729668e8ce admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:55.849443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15032cf2-ec6b-46b7-be00-68729668e8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:55.849711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15032cf2-ec6b-46b7-be00-68729668e8ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:55.850330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15032cf2-ec6b-46b7-be00-68729668e8ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:55.852237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15032cf2-ec6b-46b7-be00-68729668e8ce admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:55.863667 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:55.953170 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1189/2382] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:11:55 2022] POST /identity/v3/projects => generated 375 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:55.957335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2ac0c-d896-4e20-81d0-28a9eeb7c709 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:55.967491 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2ac0c-d896-4e20-81d0-28a9eeb7c709 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:55.984805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:11:56.023891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728db74-eca2-41e5-981d-d1b44762e70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:56.024524 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728db74-eca2-41e5-981d-d1b44762e70a admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:56.024817 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728db74-eca2-41e5-981d-d1b44762e70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:56.025263 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728db74-eca2-41e5-981d-d1b44762e70a admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:56.025936 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728db74-eca2-41e5-981d-d1b44762e70a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:56.028486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728db74-eca2-41e5-981d-d1b44762e70a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:56.099752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1194/2383] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:11:55 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:11:56.103822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15032cf2-ec6b-46b7-be00-68729668e8ce admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:56.114679 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15032cf2-ec6b-46b7-be00-68729668e8ce admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:56.123895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c50a86-8a7b-4843-9f82-c7c256fc3a8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:56.123895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c50a86-8a7b-4843-9f82-c7c256fc3a8c admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:56.123895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c50a86-8a7b-4843-9f82-c7c256fc3a8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:56.123895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c50a86-8a7b-4843-9f82-c7c256fc3a8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:56.124298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c50a86-8a7b-4843-9f82-c7c256fc3a8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:56.124298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c50a86-8a7b-4843-9f82-c7c256fc3a8c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:56.133322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1190/2384] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:56.137110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728db74-eca2-41e5-981d-d1b44762e70a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:56.147120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728db74-eca2-41e5-981d-d1b44762e70a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:56.151785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59050c3a-1712-46a7-a842-fa5717e47279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:56.152405 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59050c3a-1712-46a7-a842-fa5717e47279 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:56.152989 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59050c3a-1712-46a7-a842-fa5717e47279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:56.153275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59050c3a-1712-46a7-a842-fa5717e47279 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:56.153911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59050c3a-1712-46a7-a842-fa5717e47279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:56.155545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59050c3a-1712-46a7-a842-fa5717e47279 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:56.165579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1195/2385] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:11:56.170643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c50a86-8a7b-4843-9f82-c7c256fc3a8c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:56.181019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c50a86-8a7b-4843-9f82-c7c256fc3a8c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:56.186995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900000e-ecf5-4863-8dc9-64458bed6b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:56.187685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900000e-ecf5-4863-8dc9-64458bed6b5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:56.188107 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900000e-ecf5-4863-8dc9-64458bed6b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:56.188279 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0900000e-ecf5-4863-8dc9-64458bed6b5d admin admin] PATH_INFO: `/v3/projects/d789e62ec8d44fdc9e56ccd0b8f572ef/users/3edfd4ab979f4541a6359e7319bbe71a/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:56.206777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900000e-ecf5-4863-8dc9-64458bed6b5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d789e62ec8d44fdc9e56ccd0b8f572ef, user_id=3edfd4ab979f4541a6359e7319bbe71a, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:56.209731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0900000e-ecf5-4863-8dc9-64458bed6b5d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:56.284095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1191/2386] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:11:56 2022] PUT /identity/v3/projects/d789e62ec8d44fdc9e56ccd0b8f572ef/users/3edfd4ab979f4541a6359e7319bbe71a/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:11:56.294988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432c575-5f31-469b-a850-a40e0a415457 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:56.295434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432c575-5f31-469b-a850-a40e0a415457 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:56.295718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432c575-5f31-469b-a850-a40e0a415457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:56.325543 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d432c575-5f31-469b-a850-a40e0a415457 None None] MFA Rules not processed for user `3edfd4ab979f4541a6359e7319bbe71a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:11:56.330597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d432c575-5f31-469b-a850-a40e0a415457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:56.404001 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1196/2387] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:11:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:11:56.414793 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900000e-ecf5-4863-8dc9-64458bed6b5d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:11:56.416563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0900000e-ecf5-4863-8dc9-64458bed6b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:11:56.496514 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0900000e-ecf5-4863-8dc9-64458bed6b5d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:11:56.500952 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a65d235-e52d-4139-b24d-f14c822c4d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:11:56.501582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d235-e52d-4139-b24d-f14c822c4d7e service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:11:56.501862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d235-e52d-4139-b24d-f14c822c4d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:11:56.502144 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a65d235-e52d-4139-b24d-f14c822c4d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:11:56.511508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65d235-e52d-4139-b24d-f14c822c4d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:11:56.513318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a65d235-e52d-4139-b24d-f14c822c4d7e service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:11:56.539753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1192/2388] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:11:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:12:04.226429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe063-74dd-45d0-ae48-dfe77d42f0ba None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:04.226429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe063-74dd-45d0-ae48-dfe77d42f0ba None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:04.226429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defe063-74dd-45d0-ae48-dfe77d42f0ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:04.234552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8defe063-74dd-45d0-ae48-dfe77d42f0ba None None] MFA Rules not processed for user `24c7d365f77347e9908484902b13650a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:12:04.235770 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8defe063-74dd-45d0-ae48-dfe77d42f0ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:04.313182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1197/2389] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:12:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:12:06.468357 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b0d3a-a7b4-4eda-b027-eb06da395599 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:06.468881 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b0d3a-a7b4-4eda-b027-eb06da395599 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:06.468881 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1b0d3a-a7b4-4eda-b027-eb06da395599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:06.487996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3e1b0d3a-a7b4-4eda-b027-eb06da395599 None None] MFA Rules not processed for user `f4b56136da884b79ab26be1bdd99e407`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:12:06.493780 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3e1b0d3a-a7b4-4eda-b027-eb06da395599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:06.544929 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1193/2390] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:12:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:12:08.298934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defe063-74dd-45d0-ae48-dfe77d42f0ba None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:12:08.345251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:08.382938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defe063-74dd-45d0-ae48-dfe77d42f0ba None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:12:08.388454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a2df1-8345-499f-b78e-5770656c4701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:12:08.389935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a2df1-8345-499f-b78e-5770656c4701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:08.390210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a2df1-8345-499f-b78e-5770656c4701 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:08.390474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1a2df1-8345-499f-b78e-5770656c4701 admin admin] PATH_INFO: `/v3/users/3edfd4ab979f4541a6359e7319bbe71a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:08.391624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a2df1-8345-499f-b78e-5770656c4701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3edfd4ab979f4541a6359e7319bbe71a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:12:08.393663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1a2df1-8345-499f-b78e-5770656c4701 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:12:08.604478 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ce1a2df1-8345-499f-b78e-5770656c4701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3edfd4ab979f4541a6359e7319bbe71a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:08.619705 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ce1a2df1-8345-499f-b78e-5770656c4701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3edfd4ab979f4541a6359e7319bbe71a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:08.620511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ce1a2df1-8345-499f-b78e-5770656c4701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3edfd4ab979f4541a6359e7319bbe71a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:08.621123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ce1a2df1-8345-499f-b78e-5770656c4701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3edfd4ab979f4541a6359e7319bbe71a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:08.628951 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-ce1a2df1-8345-499f-b78e-5770656c4701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3edfd4ab979f4541a6359e7319bbe71a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:08.723543 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1198/2391] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:12:08 2022] DELETE /identity/v3/users/3edfd4ab979f4541a6359e7319bbe71a => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:12:08.727963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827edb2a-a80d-4da7-92aa-31dd4e3e7a35 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:08.728788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827edb2a-a80d-4da7-92aa-31dd4e3e7a35 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:08.729065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827edb2a-a80d-4da7-92aa-31dd4e3e7a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:08.751725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-827edb2a-a80d-4da7-92aa-31dd4e3e7a35 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:12:08.764009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-827edb2a-a80d-4da7-92aa-31dd4e3e7a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:08.817003 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1194/2392] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:12:08.827635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a2df1-8345-499f-b78e-5770656c4701 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:12:08.829202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ce1a2df1-8345-499f-b78e-5770656c4701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:08.894708 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1a2df1-8345-499f-b78e-5770656c4701 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:12:08.898598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff260f24-e8e6-4045-b1a7-c3e8c3d39b7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:12:08.899296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff260f24-e8e6-4045-b1a7-c3e8c3d39b7d service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:08.899675 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff260f24-e8e6-4045-b1a7-c3e8c3d39b7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:08.900066 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff260f24-e8e6-4045-b1a7-c3e8c3d39b7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:08.910400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff260f24-e8e6-4045-b1a7-c3e8c3d39b7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:12:08.911952 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff260f24-e8e6-4045-b1a7-c3e8c3d39b7d service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:12:08.922120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1199/2393] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:12:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:12:09.472952 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827edb2a-a80d-4da7-92aa-31dd4e3e7a35 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:12:09.474361 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-827edb2a-a80d-4da7-92aa-31dd4e3e7a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:09.483452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:09.487137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827edb2a-a80d-4da7-92aa-31dd4e3e7a35 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:12:09.491928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771325a2-366a-493a-bb8f-c7489a5922ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:12:09.492557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771325a2-366a-493a-bb8f-c7489a5922ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:09.493008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771325a2-366a-493a-bb8f-c7489a5922ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:09.493276 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771325a2-366a-493a-bb8f-c7489a5922ef admin admin] PATH_INFO: `/v3/projects/d789e62ec8d44fdc9e56ccd0b8f572ef` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:09.494444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771325a2-366a-493a-bb8f-c7489a5922ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=d789e62ec8d44fdc9e56ccd0b8f572ef)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:12:09.497129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771325a2-366a-493a-bb8f-c7489a5922ef admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:12:09.625672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-771325a2-366a-493a-bb8f-c7489a5922ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd789e62ec8d44fdc9e56ccd0b8f572ef', 'request_id': 'req-771325a2-366a-493a-bb8f-c7489a5922ef'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:09.632720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-771325a2-366a-493a-bb8f-c7489a5922ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd789e62ec8d44fdc9e56ccd0b8f572ef', 'request_id': 'req-771325a2-366a-493a-bb8f-c7489a5922ef'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:09.700189 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-771325a2-366a-493a-bb8f-c7489a5922ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd789e62ec8d44fdc9e56ccd0b8f572ef', 'request_id': 'req-771325a2-366a-493a-bb8f-c7489a5922ef'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:09.711991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-771325a2-366a-493a-bb8f-c7489a5922ef admin admin] The token cache is being invalidate because project d789e62ec8d44fdc9e56ccd0b8f572ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:12:09.712284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-771325a2-366a-493a-bb8f-c7489a5922ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:09.712930 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-771325a2-366a-493a-bb8f-c7489a5922ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:12:09.715311 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1195/2394] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:12:09 2022] DELETE /identity/v3/projects/d789e62ec8d44fdc9e56ccd0b8f572ef => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:12:18.917973 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=64,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:19.708597 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:21.586353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c668-951d-4f55-82ee-f28813c74f70 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:21.586922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c668-951d-4f55-82ee-f28813c74f70 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:21.586922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213c668-951d-4f55-82ee-f28813c74f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:21.607960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e213c668-951d-4f55-82ee-f28813c74f70 None None] MFA Rules not processed for user `68ee993e0aab4f988751a8b1bf11346c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:12:21.609852 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e213c668-951d-4f55-82ee-f28813c74f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:21.791206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1200/2395] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:12:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:12:25.945956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c87e-1b40-4e56-8ee1-fbdbc37ffb6a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:25.947665 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c87e-1b40-4e56-8ee1-fbdbc37ffb6a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:25.947665 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c87e-1b40-4e56-8ee1-fbdbc37ffb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:25.966578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9b98c87e-1b40-4e56-8ee1-fbdbc37ffb6a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:12:25.967807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9b98c87e-1b40-4e56-8ee1-fbdbc37ffb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:26.031755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1196/2396] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 08:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:12:26.063160 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213c668-951d-4f55-82ee-f28813c74f70 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:12:26.064684 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e213c668-951d-4f55-82ee-f28813c74f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:26.141047 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213c668-951d-4f55-82ee-f28813c74f70 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:12:26.146625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c7fcc-c934-404d-be14-14b5b38f0844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:12:26.147236 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7fcc-c934-404d-be14-14b5b38f0844 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:26.147515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7fcc-c934-404d-be14-14b5b38f0844 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:26.147784 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c7fcc-c934-404d-be14-14b5b38f0844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:26.157095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c7fcc-c934-404d-be14-14b5b38f0844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:12:26.158658 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c7fcc-c934-404d-be14-14b5b38f0844 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:12:26.168713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1201/2397] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:12:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:12:32.664969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f05c3-2d04-46ad-8851-9353d26de312 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:32.665551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f05c3-2d04-46ad-8851-9353d26de312 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:32.665551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f05c3-2d04-46ad-8851-9353d26de312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:32.685953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c66f05c3-2d04-46ad-8851-9353d26de312 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:12:32.687182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c66f05c3-2d04-46ad-8851-9353d26de312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:32.695345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1197/2398] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 08:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:12:32.717419 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c7fcc-c934-404d-be14-14b5b38f0844 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:12:32.718990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ad3c7fcc-c934-404d-be14-14b5b38f0844 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:32.733948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c7fcc-c934-404d-be14-14b5b38f0844 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:12:32.739949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcc573-5c80-43c4-b903-ace564ec6430 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:12:32.740568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcc573-5c80-43c4-b903-ace564ec6430 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:32.740845 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcc573-5c80-43c4-b903-ace564ec6430 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:32.741288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcc573-5c80-43c4-b903-ace564ec6430 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:32.750758 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcc573-5c80-43c4-b903-ace564ec6430 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:12:32.755531 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcc573-5c80-43c4-b903-ace564ec6430 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:12:32.762909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1202/2399] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:12:36.560239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39fcc8-b0bd-42c5-bcd7-ebd99b45e70b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:36.560776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39fcc8-b0bd-42c5-bcd7-ebd99b45e70b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:36.560776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39fcc8-b0bd-42c5-bcd7-ebd99b45e70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:36.580996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1f39fcc8-b0bd-42c5-bcd7-ebd99b45e70b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:12:36.582252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1f39fcc8-b0bd-42c5-bcd7-ebd99b45e70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:36.590224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1198/2400] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 08:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:12:36.613358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcc573-5c80-43c4-b903-ace564ec6430 service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:12:36.625038 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcc573-5c80-43c4-b903-ace564ec6430 service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:12:36.630670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6364b-8efa-4de0-886e-dd9998027ff8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:12:36.631204 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6364b-8efa-4de0-886e-dd9998027ff8 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:36.631506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6364b-8efa-4de0-886e-dd9998027ff8 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:36.631774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6364b-8efa-4de0-886e-dd9998027ff8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:36.640452 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6364b-8efa-4de0-886e-dd9998027ff8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:12:36.642030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6364b-8efa-4de0-886e-dd9998027ff8 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:12:36.652092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1203/2401] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:12:37.430998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c115ae-b1df-46db-a54a-1b24ddd65073 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:37.431272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c115ae-b1df-46db-a54a-1b24ddd65073 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:37.431550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c115ae-b1df-46db-a54a-1b24ddd65073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:37.450921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-89c115ae-b1df-46db-a54a-1b24ddd65073 None None] MFA Rules not processed for user `8e9558f071244924926df0fe80d3259a`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:12:37.452159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-89c115ae-b1df-46db-a54a-1b24ddd65073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:37.507416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1199/2402] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:12:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:12:39.786741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2f6a9-54d1-4ec0-a5e7-220e5b1426a3 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:39.787254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2f6a9-54d1-4ec0-a5e7-220e5b1426a3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:39.787254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2f6a9-54d1-4ec0-a5e7-220e5b1426a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:39.806932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2fc2f6a9-54d1-4ec0-a5e7-220e5b1426a3 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:12:39.808217 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2fc2f6a9-54d1-4ec0-a5e7-220e5b1426a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:39.816406 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1204/2403] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 08:12:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:12:39.841529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c115ae-b1df-46db-a54a-1b24ddd65073 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:12:39.853974 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c115ae-b1df-46db-a54a-1b24ddd65073 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:12:39.859920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e7b5b-fd5d-4bb9-a004-afd10eee62fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:12:39.860544 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e7b5b-fd5d-4bb9-a004-afd10eee62fc service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:39.860824 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e7b5b-fd5d-4bb9-a004-afd10eee62fc service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:39.861104 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e7b5b-fd5d-4bb9-a004-afd10eee62fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:39.869162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e7b5b-fd5d-4bb9-a004-afd10eee62fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:12:39.870780 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610e7b5b-fd5d-4bb9-a004-afd10eee62fc service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:12:39.881099 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1200/2404] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:12:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:12:43.003665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af3c95-b12d-4daf-8dbb-b05ff43cb461 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:43.005203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af3c95-b12d-4daf-8dbb-b05ff43cb461 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:43.005203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af3c95-b12d-4daf-8dbb-b05ff43cb461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:43.024696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-43af3c95-b12d-4daf-8dbb-b05ff43cb461 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:12:43.026313 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-43af3c95-b12d-4daf-8dbb-b05ff43cb461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:12:43.037703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1205/2405] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 24 08:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:12:43.060381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e7b5b-fd5d-4bb9-a004-afd10eee62fc service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:12:43.071938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e7b5b-fd5d-4bb9-a004-afd10eee62fc service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:12:43.079506 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d7199-f816-43e6-b5fd-9482ef0f1f02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:12:43.080153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d7199-f816-43e6-b5fd-9482ef0f1f02 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:12:43.080436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d7199-f816-43e6-b5fd-9482ef0f1f02 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:12:43.080696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d7199-f816-43e6-b5fd-9482ef0f1f02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:12:43.089770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d7199-f816-43e6-b5fd-9482ef0f1f02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:12:43.091356 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661d7199-f816-43e6-b5fd-9482ef0f1f02 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:12:43.102288 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1201/2406] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:12:53.020079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=77 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:12:53.097034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=70 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:17.262927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af3c95-b12d-4daf-8dbb-b05ff43cb461 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:17.264626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-43af3c95-b12d-4daf-8dbb-b05ff43cb461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:17.278527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af3c95-b12d-4daf-8dbb-b05ff43cb461 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:17.283223 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0b555a-96e7-410d-9c83-62e939b9f2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:17.292579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b555a-96e7-410d-9c83-62e939b9f2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:17.292579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b555a-96e7-410d-9c83-62e939b9f2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:17.292579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0b555a-96e7-410d-9c83-62e939b9f2ca admin admin] PATH_INFO: `/v3/users/24c7d365f77347e9908484902b13650a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:17.292579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b555a-96e7-410d-9c83-62e939b9f2ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c7d365f77347e9908484902b13650a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:17.292579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0b555a-96e7-410d-9c83-62e939b9f2ca admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:17.527591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cd0b555a-96e7-410d-9c83-62e939b9f2ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c7d365f77347e9908484902b13650a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:17.539647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cd0b555a-96e7-410d-9c83-62e939b9f2ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c7d365f77347e9908484902b13650a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:17.540391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cd0b555a-96e7-410d-9c83-62e939b9f2ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c7d365f77347e9908484902b13650a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:17.541000 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cd0b555a-96e7-410d-9c83-62e939b9f2ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c7d365f77347e9908484902b13650a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:17.547747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cd0b555a-96e7-410d-9c83-62e939b9f2ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c7d365f77347e9908484902b13650a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:17.660168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1206/2407] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:13:17 2022] DELETE /identity/v3/users/24c7d365f77347e9908484902b13650a => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:17.922919 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d7199-f816-43e6-b5fd-9482ef0f1f02 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:17.934159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661d7199-f816-43e6-b5fd-9482ef0f1f02 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:17.993704 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:17.994421 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:17.994703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:17.994970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa admin admin] PATH_INFO: `/v3/projects/2d87b90c7bc4449aab2819709471e0ba` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:17.996121 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d87b90c7bc4449aab2819709471e0ba)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:17.998031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:18.089520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d87b90c7bc4449aab2819709471e0ba', 'request_id': 'req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:18.095995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d87b90c7bc4449aab2819709471e0ba', 'request_id': 'req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:18.167018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d87b90c7bc4449aab2819709471e0ba', 'request_id': 'req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:18.178837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa admin admin] The token cache is being invalidate because project 2d87b90c7bc4449aab2819709471e0ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:13:18.179131 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:18.180065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-78435dc3-d76a-4f9f-839d-d2ee2eae47aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:18.181570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1202/2408] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:13:17 2022] DELETE /identity/v3/projects/2d87b90c7bc4449aab2819709471e0ba => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:18.186443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731943d-64cf-4872-a77e-4ae01a3e84f6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:18.186731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731943d-64cf-4872-a77e-4ae01a3e84f6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:18.187006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731943d-64cf-4872-a77e-4ae01a3e84f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:18.206781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1731943d-64cf-4872-a77e-4ae01a3e84f6 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:18.208031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1731943d-64cf-4872-a77e-4ae01a3e84f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:18.279525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1207/2409] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:18.287611 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da1165-d7c8-4147-ab65-0305ed45c0e0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:18.288175 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da1165-d7c8-4147-ab65-0305ed45c0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:18.288629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da1165-d7c8-4147-ab65-0305ed45c0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:18.312193 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-92da1165-d7c8-4147-ab65-0305ed45c0e0 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:18.313624 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-92da1165-d7c8-4147-ab65-0305ed45c0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:18.322501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1203/2410] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:18.326888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731943d-64cf-4872-a77e-4ae01a3e84f6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:18.338199 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731943d-64cf-4872-a77e-4ae01a3e84f6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:18.342938 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ff8bb-bb73-43ee-9297-f8ebc95254ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:18.343539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ff8bb-bb73-43ee-9297-f8ebc95254ff admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:18.343817 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ff8bb-bb73-43ee-9297-f8ebc95254ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:18.344129 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ff8bb-bb73-43ee-9297-f8ebc95254ff admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:18.344780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ff8bb-bb73-43ee-9297-f8ebc95254ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:13:18.345081 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ff8bb-bb73-43ee-9297-f8ebc95254ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:18.346657 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ff8bb-bb73-43ee-9297-f8ebc95254ff admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:18.359435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1208/2411] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:13:18.363819 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da1165-d7c8-4147-ab65-0305ed45c0e0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:18.373946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da1165-d7c8-4147-ab65-0305ed45c0e0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:18.386892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafb979-b6c1-4dd8-853d-056b4ce2891c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:18.387567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafb979-b6c1-4dd8-853d-056b4ce2891c admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:18.387827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafb979-b6c1-4dd8-853d-056b4ce2891c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:18.392248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dafb979-b6c1-4dd8-853d-056b4ce2891c admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:18.392248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafb979-b6c1-4dd8-853d-056b4ce2891c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:18.392248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dafb979-b6c1-4dd8-853d-056b4ce2891c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:18.484306 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1204/2412] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:13:18 2022] POST /identity/v3/projects => generated 397 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:13:18.488334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ff8bb-bb73-43ee-9297-f8ebc95254ff admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:18.498514 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ff8bb-bb73-43ee-9297-f8ebc95254ff admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:18.562916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67f72d-6482-4ce9-9931-1cf195fa6519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:18.564421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f72d-6482-4ce9-9931-1cf195fa6519 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:18.564421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f72d-6482-4ce9-9931-1cf195fa6519 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:18.564421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67f72d-6482-4ce9-9931-1cf195fa6519 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:18.564730 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67f72d-6482-4ce9-9931-1cf195fa6519 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:18.566617 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67f72d-6482-4ce9-9931-1cf195fa6519 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:18.574970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:18.671448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1209/2413] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:13:18 2022] POST /identity/v3/users => generated 299 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:13:18.675580 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafb979-b6c1-4dd8-853d-056b4ce2891c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:18.686531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dafb979-b6c1-4dd8-853d-056b4ce2891c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:18.693956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa302534-1e76-40d4-aac2-7946bd95e700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:18.693956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa302534-1e76-40d4-aac2-7946bd95e700 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:18.693956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa302534-1e76-40d4-aac2-7946bd95e700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:18.693956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa302534-1e76-40d4-aac2-7946bd95e700 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:18.694319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa302534-1e76-40d4-aac2-7946bd95e700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:18.695575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa302534-1e76-40d4-aac2-7946bd95e700 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:18.709844 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1205/2414] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:13:18.711678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67f72d-6482-4ce9-9931-1cf195fa6519 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:18.723108 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67f72d-6482-4ce9-9931-1cf195fa6519 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:18.728454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff25468-b800-4cf4-bbc9-915138c9f03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:18.729056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff25468-b800-4cf4-bbc9-915138c9f03a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:18.729334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff25468-b800-4cf4-bbc9-915138c9f03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:18.729602 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff25468-b800-4cf4-bbc9-915138c9f03a admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:18.730243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff25468-b800-4cf4-bbc9-915138c9f03a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:18.731930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff25468-b800-4cf4-bbc9-915138c9f03a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:18.742778 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1210/2415] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:13:18.747076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa302534-1e76-40d4-aac2-7946bd95e700 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:18.759393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa302534-1e76-40d4-aac2-7946bd95e700 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:18.764065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca68449-8a1d-4cde-9f2d-7d976a9dcbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:18.764721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca68449-8a1d-4cde-9f2d-7d976a9dcbc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:18.764998 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca68449-8a1d-4cde-9f2d-7d976a9dcbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:18.765265 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca68449-8a1d-4cde-9f2d-7d976a9dcbc4 admin admin] PATH_INFO: `/v3/projects/e09cfaabfeaf4dc3933c428c0387e0fd/users/e2054a67464c4b5b8731af89f95289f5/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:18.780924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca68449-8a1d-4cde-9f2d-7d976a9dcbc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09cfaabfeaf4dc3933c428c0387e0fd, user_id=e2054a67464c4b5b8731af89f95289f5, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:18.783927 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca68449-8a1d-4cde-9f2d-7d976a9dcbc4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:18.877436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1206/2416] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:13:18 2022] PUT /identity/v3/projects/e09cfaabfeaf4dc3933c428c0387e0fd/users/e2054a67464c4b5b8731af89f95289f5/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:18.889402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e37fa7-594e-47a7-8649-dead967777e5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:18.889684 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e37fa7-594e-47a7-8649-dead967777e5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:18.889951 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e37fa7-594e-47a7-8649-dead967777e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:18.928525 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-08e37fa7-594e-47a7-8649-dead967777e5 None None] MFA Rules not processed for user `e2054a67464c4b5b8731af89f95289f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:18.930060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-08e37fa7-594e-47a7-8649-dead967777e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:18.994825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1211/2417] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:19.006989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca68449-8a1d-4cde-9f2d-7d976a9dcbc4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:19.011114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0ca68449-8a1d-4cde-9f2d-7d976a9dcbc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:19.039387 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:19.066034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca68449-8a1d-4cde-9f2d-7d976a9dcbc4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:19.070428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c5264-55aa-4e0d-ad03-23ff23331eb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:19.071035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5264-55aa-4e0d-ad03-23ff23331eb3 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:19.071317 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5264-55aa-4e0d-ad03-23ff23331eb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:19.071616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c5264-55aa-4e0d-ad03-23ff23331eb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:19.080310 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c5264-55aa-4e0d-ad03-23ff23331eb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:19.081807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c5264-55aa-4e0d-ad03-23ff23331eb3 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:19.091083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1207/2418] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:19 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:13:24.567583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e37fa7-594e-47a7-8649-dead967777e5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:24.569590 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-08e37fa7-594e-47a7-8649-dead967777e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:24.625292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e37fa7-594e-47a7-8649-dead967777e5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:24.629119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303f79a-d2a3-4cd2-b2b0-bfa26b9baf76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:24.629728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303f79a-d2a3-4cd2-b2b0-bfa26b9baf76 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:24.630004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303f79a-d2a3-4cd2-b2b0-bfa26b9baf76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:24.630270 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303f79a-d2a3-4cd2-b2b0-bfa26b9baf76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:24.632576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a303f79a-d2a3-4cd2-b2b0-bfa26b9baf76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:24.733095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303f79a-d2a3-4cd2-b2b0-bfa26b9baf76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:24.735187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303f79a-d2a3-4cd2-b2b0-bfa26b9baf76 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:24.750836 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1212/2419] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:13:25.017379 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c5264-55aa-4e0d-ad03-23ff23331eb3 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:25.089558 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c5264-55aa-4e0d-ad03-23ff23331eb3 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:25.094326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129b872-3339-4de2-aff9-e70324e7775f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:25.095209 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129b872-3339-4de2-aff9-e70324e7775f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:25.095486 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129b872-3339-4de2-aff9-e70324e7775f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:25.095763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3129b872-3339-4de2-aff9-e70324e7775f admin admin] PATH_INFO: `/v3/users/e2054a67464c4b5b8731af89f95289f5` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:25.096947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129b872-3339-4de2-aff9-e70324e7775f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2054a67464c4b5b8731af89f95289f5)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:25.098928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3129b872-3339-4de2-aff9-e70324e7775f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:25.290424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3129b872-3339-4de2-aff9-e70324e7775f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2054a67464c4b5b8731af89f95289f5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:25.291089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3129b872-3339-4de2-aff9-e70324e7775f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2054a67464c4b5b8731af89f95289f5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:25.291687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3129b872-3339-4de2-aff9-e70324e7775f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2054a67464c4b5b8731af89f95289f5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:25.298525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3129b872-3339-4de2-aff9-e70324e7775f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2054a67464c4b5b8731af89f95289f5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:25.310477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-3129b872-3339-4de2-aff9-e70324e7775f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2054a67464c4b5b8731af89f95289f5'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:25.395404 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1208/2420] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:13:25 2022] DELETE /identity/v3/users/e2054a67464c4b5b8731af89f95289f5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:25.400825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640242c-ca69-46cd-8c35-ab5a1687899d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:25.401115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640242c-ca69-46cd-8c35-ab5a1687899d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:25.401389 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640242c-ca69-46cd-8c35-ab5a1687899d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:25.420856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1640242c-ca69-46cd-8c35-ab5a1687899d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:25.426829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1640242c-ca69-46cd-8c35-ab5a1687899d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:25.426829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:25.482211 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1213/2421] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:25.492372 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129b872-3339-4de2-aff9-e70324e7775f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:25.493812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3129b872-3339-4de2-aff9-e70324e7775f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:25.551107 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:25.555413 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3129b872-3339-4de2-aff9-e70324e7775f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:25.558990 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b8b2e4-d249-45e4-830e-1f843951236b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:25.559605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8b2e4-d249-45e4-830e-1f843951236b service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:25.559908 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8b2e4-d249-45e4-830e-1f843951236b service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:25.560186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b8b2e4-d249-45e4-830e-1f843951236b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:25.570542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8b2e4-d249-45e4-830e-1f843951236b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:25.572022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b8b2e4-d249-45e4-830e-1f843951236b service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:25.581533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1209/2422] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:13:25.990869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640242c-ca69-46cd-8c35-ab5a1687899d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:25.992502 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1640242c-ca69-46cd-8c35-ab5a1687899d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:26.005441 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640242c-ca69-46cd-8c35-ab5a1687899d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:26.011340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f29989-3da3-4c8f-9157-02457e264432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:26.012138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f29989-3da3-4c8f-9157-02457e264432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:26.012654 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f29989-3da3-4c8f-9157-02457e264432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:26.013136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f29989-3da3-4c8f-9157-02457e264432 admin admin] PATH_INFO: `/v3/projects/e09cfaabfeaf4dc3933c428c0387e0fd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:26.014643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f29989-3da3-4c8f-9157-02457e264432 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09cfaabfeaf4dc3933c428c0387e0fd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:26.016809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f29989-3da3-4c8f-9157-02457e264432 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:26.191349 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-58f29989-3da3-4c8f-9157-02457e264432 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09cfaabfeaf4dc3933c428c0387e0fd', 'request_id': 'req-58f29989-3da3-4c8f-9157-02457e264432'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:26.198378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-58f29989-3da3-4c8f-9157-02457e264432 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09cfaabfeaf4dc3933c428c0387e0fd', 'request_id': 'req-58f29989-3da3-4c8f-9157-02457e264432'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:26.204612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-58f29989-3da3-4c8f-9157-02457e264432 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09cfaabfeaf4dc3933c428c0387e0fd', 'request_id': 'req-58f29989-3da3-4c8f-9157-02457e264432'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:26.292416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-58f29989-3da3-4c8f-9157-02457e264432 admin admin] The token cache is being invalidate because project e09cfaabfeaf4dc3933c428c0387e0fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:13:26.292784 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-58f29989-3da3-4c8f-9157-02457e264432 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:26.293496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-58f29989-3da3-4c8f-9157-02457e264432 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:26.295152 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1214/2423] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:13:25 2022] DELETE /identity/v3/projects/e09cfaabfeaf4dc3933c428c0387e0fd => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:26.300237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0b174-ac34-482e-8d58-2f5638903d82 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:26.300765 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0b174-ac34-482e-8d58-2f5638903d82 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:26.300765 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd0b174-ac34-482e-8d58-2f5638903d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:26.323081 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6fd0b174-ac34-482e-8d58-2f5638903d82 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:26.324352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6fd0b174-ac34-482e-8d58-2f5638903d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:26.398669 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1210/2424] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:26.408117 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a66ac-1a27-42de-873d-1b28aec0ba8b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:26.408416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a66ac-1a27-42de-873d-1b28aec0ba8b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:26.408685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a66ac-1a27-42de-873d-1b28aec0ba8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:26.418697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0b174-ac34-482e-8d58-2f5638903d82 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:26.420107 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6fd0b174-ac34-482e-8d58-2f5638903d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:26.429009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7c2a66ac-1a27-42de-873d-1b28aec0ba8b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:26.430698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7c2a66ac-1a27-42de-873d-1b28aec0ba8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:26.449863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1215/2425] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:26.451163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a66ac-1a27-42de-873d-1b28aec0ba8b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:26.482860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a66ac-1a27-42de-873d-1b28aec0ba8b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:26.488569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd0b174-ac34-482e-8d58-2f5638903d82 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:26.488734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcfd22-f65e-4874-a237-47910b8f9d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:26.489229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcfd22-f65e-4874-a237-47910b8f9d4a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:26.489538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcfd22-f65e-4874-a237-47910b8f9d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:26.489835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcfd22-f65e-4874-a237-47910b8f9d4a admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:26.490557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcfd22-f65e-4874-a237-47910b8f9d4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:13:26.491374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcfd22-f65e-4874-a237-47910b8f9d4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:26.493188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcfd22-f65e-4874-a237-47910b8f9d4a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:26.494499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb45b5-d7f8-4e29-a84c-f85986b8e0b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:26.495487 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb45b5-d7f8-4e29-a84c-f85986b8e0b4 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:26.496226 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb45b5-d7f8-4e29-a84c-f85986b8e0b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:26.496689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb45b5-d7f8-4e29-a84c-f85986b8e0b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:26.498827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-15fb45b5-d7f8-4e29-a84c-f85986b8e0b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:26.512418 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1216/2426] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:13:26.513757 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcfd22-f65e-4874-a237-47910b8f9d4a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:26.524862 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcfd22-f65e-4874-a237-47910b8f9d4a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:26.529630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba6f97-709e-44f3-9e5d-a75294047257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:26.530820 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba6f97-709e-44f3-9e5d-a75294047257 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:26.531124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba6f97-709e-44f3-9e5d-a75294047257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:26.531392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba6f97-709e-44f3-9e5d-a75294047257 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:26.532052 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba6f97-709e-44f3-9e5d-a75294047257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:26.534119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba6f97-709e-44f3-9e5d-a75294047257 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:26.582358 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb45b5-d7f8-4e29-a84c-f85986b8e0b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:26.583817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fb45b5-d7f8-4e29-a84c-f85986b8e0b4 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:26.596010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1211/2427] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:13:26.639194 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1217/2428] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:13:26 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:13:26.643497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb45b5-d7f8-4e29-a84c-f85986b8e0b4 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:26.654379 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb45b5-d7f8-4e29-a84c-f85986b8e0b4 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:26.687302 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:26.719657 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187bc0b-0eb6-47d8-ba84-46c37ebc52ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:26.720302 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187bc0b-0eb6-47d8-ba84-46c37ebc52ee admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:26.720931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187bc0b-0eb6-47d8-ba84-46c37ebc52ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:26.720931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187bc0b-0eb6-47d8-ba84-46c37ebc52ee admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:26.721481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187bc0b-0eb6-47d8-ba84-46c37ebc52ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:26.723395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2187bc0b-0eb6-47d8-ba84-46c37ebc52ee admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:26.802749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1212/2429] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:13:26 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:13:26.805590 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba6f97-709e-44f3-9e5d-a75294047257 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:26.835598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba6f97-709e-44f3-9e5d-a75294047257 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:26.842179 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f772b-add6-47dc-acd6-eb82acd535f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:26.842813 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f772b-add6-47dc-acd6-eb82acd535f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:26.843435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f772b-add6-47dc-acd6-eb82acd535f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:26.843435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637f772b-add6-47dc-acd6-eb82acd535f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:26.844048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f772b-add6-47dc-acd6-eb82acd535f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:26.845699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637f772b-add6-47dc-acd6-eb82acd535f4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:26.859467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1218/2430] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:13:26.863488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187bc0b-0eb6-47d8-ba84-46c37ebc52ee admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:26.878838 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187bc0b-0eb6-47d8-ba84-46c37ebc52ee admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:26.884223 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e4108-71ae-42fe-947c-761e9767724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:26.884823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e4108-71ae-42fe-947c-761e9767724e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:26.888686 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e4108-71ae-42fe-947c-761e9767724e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:26.888686 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e4108-71ae-42fe-947c-761e9767724e admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:26.888686 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e4108-71ae-42fe-947c-761e9767724e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:26.888686 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e4108-71ae-42fe-947c-761e9767724e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:26.898314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1213/2431] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:13:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:13:26.905948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f772b-add6-47dc-acd6-eb82acd535f4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:26.913267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637f772b-add6-47dc-acd6-eb82acd535f4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:26.917969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43174f-24aa-435b-9dd2-9437dd2f83a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:26.918610 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43174f-24aa-435b-9dd2-9437dd2f83a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:26.918886 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43174f-24aa-435b-9dd2-9437dd2f83a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:26.919155 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca43174f-24aa-435b-9dd2-9437dd2f83a1 admin admin] PATH_INFO: `/v3/projects/38c096f91e0c44a8b46c07e5aaf54b47/users/3a971d4b3ffb435cb3227385d80277d3/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:26.934470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43174f-24aa-435b-9dd2-9437dd2f83a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38c096f91e0c44a8b46c07e5aaf54b47, user_id=3a971d4b3ffb435cb3227385d80277d3, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:26.937139 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca43174f-24aa-435b-9dd2-9437dd2f83a1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:27.003097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1219/2432] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:13:26 2022] PUT /identity/v3/projects/38c096f91e0c44a8b46c07e5aaf54b47/users/3a971d4b3ffb435cb3227385d80277d3/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:27.008732 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de23eea-e7ce-4d60-99ef-aafa2278f9a5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:27.009014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de23eea-e7ce-4d60-99ef-aafa2278f9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:27.021035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de23eea-e7ce-4d60-99ef-aafa2278f9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:27.031718 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3de23eea-e7ce-4d60-99ef-aafa2278f9a5 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:27.032971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3de23eea-e7ce-4d60-99ef-aafa2278f9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:27.096082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1214/2433] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:27.105847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43174f-24aa-435b-9dd2-9437dd2f83a1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:27.123797 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:27.162704 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca43174f-24aa-435b-9dd2-9437dd2f83a1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:27.167145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe8c43-b5b5-40c7-957f-a7ddc771656f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:27.168657 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe8c43-b5b5-40c7-957f-a7ddc771656f service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:27.168657 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe8c43-b5b5-40c7-957f-a7ddc771656f service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:27.168657 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfe8c43-b5b5-40c7-957f-a7ddc771656f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:27.177701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe8c43-b5b5-40c7-957f-a7ddc771656f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:27.179159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfe8c43-b5b5-40c7-957f-a7ddc771656f service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:27.189031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1220/2434] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:13:29.854579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331da49-e937-4bad-a2ae-de65189a8992 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:29.855088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331da49-e937-4bad-a2ae-de65189a8992 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:29.855274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331da49-e937-4bad-a2ae-de65189a8992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:29.880013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3331da49-e937-4bad-a2ae-de65189a8992 None None] MFA Rules not processed for user `f4b56136da884b79ab26be1bdd99e407`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:29.880013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3331da49-e937-4bad-a2ae-de65189a8992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:29.938514 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1215/2435] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:34.081752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe8c43-b5b5-40c7-957f-a7ddc771656f service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:34.092787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfe8c43-b5b5-40c7-957f-a7ddc771656f service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:34.097072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c7614-9406-40ff-959b-0acd7c9cecd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:34.098347 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c7614-9406-40ff-959b-0acd7c9cecd1 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:34.098795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c7614-9406-40ff-959b-0acd7c9cecd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:34.099227 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c7614-9406-40ff-959b-0acd7c9cecd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:34.101528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1d6c7614-9406-40ff-959b-0acd7c9cecd1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:34.116649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c7614-9406-40ff-959b-0acd7c9cecd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:34.118645 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c7614-9406-40ff-959b-0acd7c9cecd1 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:34.139195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1221/2436] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:13:34.218160 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d9411-3c37-4665-b05a-0a94af469afe None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:34.218160 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d9411-3c37-4665-b05a-0a94af469afe None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:34.218160 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d9411-3c37-4665-b05a-0a94af469afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:34.254471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a47d9411-3c37-4665-b05a-0a94af469afe None None] MFA Rules not processed for user `3a971d4b3ffb435cb3227385d80277d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:34.257477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a47d9411-3c37-4665-b05a-0a94af469afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:34.347661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:34.389884 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1216/2437] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:34.394516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c7614-9406-40ff-959b-0acd7c9cecd1 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:34.407326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c7614-9406-40ff-959b-0acd7c9cecd1 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:34.413921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbdf4c-e606-4f2a-b83a-48da7947d0f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:34.414642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbdf4c-e606-4f2a-b83a-48da7947d0f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:34.414924 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbdf4c-e606-4f2a-b83a-48da7947d0f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:34.415468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbdf4c-e606-4f2a-b83a-48da7947d0f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:34.416169 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbdf4c-e606-4f2a-b83a-48da7947d0f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:34.418202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcbdf4c-e606-4f2a-b83a-48da7947d0f9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:34.541908 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1222/2438] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:13:34 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:13:34.543826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d9411-3c37-4665-b05a-0a94af469afe None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:34.556128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d9411-3c37-4665-b05a-0a94af469afe None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:34.688001 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf21e0-1936-4dc7-abbf-e7cc21a78348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:34.691986 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf21e0-1936-4dc7-abbf-e7cc21a78348 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:34.692344 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf21e0-1936-4dc7-abbf-e7cc21a78348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:34.692576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaf21e0-1936-4dc7-abbf-e7cc21a78348 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:34.693238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf21e0-1936-4dc7-abbf-e7cc21a78348 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:34.703978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaf21e0-1936-4dc7-abbf-e7cc21a78348 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:34.830470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbdf4c-e606-4f2a-b83a-48da7947d0f9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:34.832229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1217/2439] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:13:34 2022] POST /identity/v3/users => generated 299 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:13:34.846317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbdf4c-e606-4f2a-b83a-48da7947d0f9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:34.853967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486822a2-14b3-4af3-85ef-8bb0c8054d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:34.854595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486822a2-14b3-4af3-85ef-8bb0c8054d0b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:34.855006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486822a2-14b3-4af3-85ef-8bb0c8054d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:34.855276 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486822a2-14b3-4af3-85ef-8bb0c8054d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:34.856379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486822a2-14b3-4af3-85ef-8bb0c8054d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:34.857802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486822a2-14b3-4af3-85ef-8bb0c8054d0b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:34.893856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1223/2440] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:13:34.898389 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf21e0-1936-4dc7-abbf-e7cc21a78348 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:34.914525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaf21e0-1936-4dc7-abbf-e7cc21a78348 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:34.920282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145af1b-8bba-4146-b6b0-cee701d9df79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:34.924935 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145af1b-8bba-4146-b6b0-cee701d9df79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:34.924935 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145af1b-8bba-4146-b6b0-cee701d9df79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:34.924935 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f145af1b-8bba-4146-b6b0-cee701d9df79 admin admin] PATH_INFO: `/v3/projects/88d1532e25974dcdbb8b9386a923e872/users/2e4b7284faaf4dee9f87bdccdd8b5c98/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:34.950606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145af1b-8bba-4146-b6b0-cee701d9df79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d1532e25974dcdbb8b9386a923e872, user_id=2e4b7284faaf4dee9f87bdccdd8b5c98, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:34.954854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f145af1b-8bba-4146-b6b0-cee701d9df79 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:35.056037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1218/2441] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:13:34 2022] PUT /identity/v3/projects/88d1532e25974dcdbb8b9386a923e872/users/2e4b7284faaf4dee9f87bdccdd8b5c98/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:35.058421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486822a2-14b3-4af3-85ef-8bb0c8054d0b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:35.072442 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486822a2-14b3-4af3-85ef-8bb0c8054d0b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:35.157769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15ced49-8d82-478a-83e4-96197bafdfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:35.158432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ced49-8d82-478a-83e4-96197bafdfe0 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:35.158713 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ced49-8d82-478a-83e4-96197bafdfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:35.158934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15ced49-8d82-478a-83e4-96197bafdfe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:35.159588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ced49-8d82-478a-83e4-96197bafdfe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:35.161439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15ced49-8d82-478a-83e4-96197bafdfe0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:35.175303 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1224/2442] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:13:35.179732 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145af1b-8bba-4146-b6b0-cee701d9df79 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:35.195969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f145af1b-8bba-4146-b6b0-cee701d9df79 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:35.206012 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a679f-a99b-499f-9c51-f0b88b4d4c9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:35.206824 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a679f-a99b-499f-9c51-f0b88b4d4c9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:35.211499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a679f-a99b-499f-9c51-f0b88b4d4c9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:35.211499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a679f-a99b-499f-9c51-f0b88b4d4c9b admin admin] PATH_INFO: `/v3/projects/88d1532e25974dcdbb8b9386a923e872/users/2e4b7284faaf4dee9f87bdccdd8b5c98/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:35.211499 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a679f-a99b-499f-9c51-f0b88b4d4c9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=88d1532e25974dcdbb8b9386a923e872, user_id=2e4b7284faaf4dee9f87bdccdd8b5c98, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:35.212689 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a679f-a99b-499f-9c51-f0b88b4d4c9b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:35.233101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1219/2443] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:13:35 2022] PUT /identity/v3/projects/88d1532e25974dcdbb8b9386a923e872/users/2e4b7284faaf4dee9f87bdccdd8b5c98/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:39.539957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ea54e-286b-4c73-9910-ff8afdf4172d None None] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:39.540472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ea54e-286b-4c73-9910-ff8afdf4172d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:39.540572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ea54e-286b-4c73-9910-ff8afdf4172d None None] PATH_INFO: `/` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:39.542460 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1225/2444] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 24 08:13:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:13:39.549005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecbfa6-f640-475b-bf1b-9492aebeef7c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:39.549948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecbfa6-f640-475b-bf1b-9492aebeef7c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:39.550385 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faecbfa6-f640-475b-bf1b-9492aebeef7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:39.583637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-faecbfa6-f640-475b-bf1b-9492aebeef7c None None] MFA Rules not processed for user `f49116f202774e4da0c96875ffa08288`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:39.586370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-faecbfa6-f640-475b-bf1b-9492aebeef7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:39.677174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1220/2445] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 24 08:13:39 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:13:39.729628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ea54e-286b-4c73-9910-ff8afdf4172d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:39.732013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-b52ea54e-286b-4c73-9910-ff8afdf4172d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:39.760656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ea54e-286b-4c73-9910-ff8afdf4172d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:39.767447 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8afad-a1b2-4086-bb15-133a3a030546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:39.770133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8afad-a1b2-4086-bb15-133a3a030546 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:39.770440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8afad-a1b2-4086-bb15-133a3a030546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:39.770686 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8afad-a1b2-4086-bb15-133a3a030546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:39.797222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8afad-a1b2-4086-bb15-133a3a030546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:39.798731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8afad-a1b2-4086-bb15-133a3a030546 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:39.813926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1226/2446] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:13:40.117413 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78017ddc-ad09-42ff-96a4-74314b8742d9 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:40.117946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78017ddc-ad09-42ff-96a4-74314b8742d9 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:40.118875 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78017ddc-ad09-42ff-96a4-74314b8742d9 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:40.121544 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1221/2447] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 24 08:13:40 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:13:40.127712 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69fa05-07a8-4b97-8087-3018837c58be None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:40.128238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69fa05-07a8-4b97-8087-3018837c58be None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:40.134988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69fa05-07a8-4b97-8087-3018837c58be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:40.162770 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-de69fa05-07a8-4b97-8087-3018837c58be None None] MFA Rules not processed for user `9b99cff7a5f549adadee002f8ab1f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:40.166631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-de69fa05-07a8-4b97-8087-3018837c58be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:40.248848 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:40.268940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1227/2448] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 24 08:13:40 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:40.288953 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78017ddc-ad09-42ff-96a4-74314b8742d9 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:40.305983 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78017ddc-ad09-42ff-96a4-74314b8742d9 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:40.337190 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ced83b-9eeb-4bdd-beae-1efd58964512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:40.338892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ced83b-9eeb-4bdd-beae-1efd58964512 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:40.339711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ced83b-9eeb-4bdd-beae-1efd58964512 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:40.340178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ced83b-9eeb-4bdd-beae-1efd58964512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:40.358648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ced83b-9eeb-4bdd-beae-1efd58964512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:40.360339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ced83b-9eeb-4bdd-beae-1efd58964512 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:40.373191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1222/2449] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:13:40.977539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69fa05-07a8-4b97-8087-3018837c58be None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:40.980827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-de69fa05-07a8-4b97-8087-3018837c58be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:40.989972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ced83b-9eeb-4bdd-beae-1efd58964512 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:40.992897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a7ced83b-9eeb-4bdd-beae-1efd58964512 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:41.006967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69fa05-07a8-4b97-8087-3018837c58be None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:41.016360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60cd58-46e0-4ec6-b4ce-6c4b318f1b2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:41.017794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60cd58-46e0-4ec6-b4ce-6c4b318f1b2a service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:41.018277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60cd58-46e0-4ec6-b4ce-6c4b318f1b2a service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:41.018970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d60cd58-46e0-4ec6-b4ce-6c4b318f1b2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:41.022021 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3d60cd58-46e0-4ec6-b4ce-6c4b318f1b2a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:41.077332 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:41.131134 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ced83b-9eeb-4bdd-beae-1efd58964512 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:41.132254 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60cd58-46e0-4ec6-b4ce-6c4b318f1b2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:41.135721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d60cd58-46e0-4ec6-b4ce-6c4b318f1b2a service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:41.144879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102df9d2-5548-4590-b334-957a0d134021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:41.145550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df9d2-5548-4590-b334-957a0d134021 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:41.145836 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df9d2-5548-4590-b334-957a0d134021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:41.146115 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102df9d2-5548-4590-b334-957a0d134021 admin admin] PATH_INFO: `/v3/users/68ee993e0aab4f988751a8b1bf11346c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:41.147159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1228/2450] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:40 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:13:41.147318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102df9d2-5548-4590-b334-957a0d134021 admin admin] RBAC: Authorizing `identity:delete_user(user_id=68ee993e0aab4f988751a8b1bf11346c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:41.151440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102df9d2-5548-4590-b334-957a0d134021 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:41.462927 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-102df9d2-5548-4590-b334-957a0d134021 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68ee993e0aab4f988751a8b1bf11346c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:41.463828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-102df9d2-5548-4590-b334-957a0d134021 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68ee993e0aab4f988751a8b1bf11346c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:41.464636 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-102df9d2-5548-4590-b334-957a0d134021 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68ee993e0aab4f988751a8b1bf11346c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:41.479365 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-102df9d2-5548-4590-b334-957a0d134021 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68ee993e0aab4f988751a8b1bf11346c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:41.494122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-102df9d2-5548-4590-b334-957a0d134021 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68ee993e0aab4f988751a8b1bf11346c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:41.593477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1223/2451] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:13:40 2022] DELETE /identity/v3/users/68ee993e0aab4f988751a8b1bf11346c => generated 0 bytes in 604 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:41.870868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60cd58-46e0-4ec6-b4ce-6c4b318f1b2a service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:41.885163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d60cd58-46e0-4ec6-b4ce-6c4b318f1b2a service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:42.023332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:42.024975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:42.025429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:42.026235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71 admin admin] PATH_INFO: `/v3/projects/22a77f51d295458bb3c8051214f7eeb3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:42.033307 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22a77f51d295458bb3c8051214f7eeb3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:42.044085 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:42.325171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22a77f51d295458bb3c8051214f7eeb3', 'request_id': 'req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:42.334607 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22a77f51d295458bb3c8051214f7eeb3', 'request_id': 'req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:42.341934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22a77f51d295458bb3c8051214f7eeb3', 'request_id': 'req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:42.459321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71 admin admin] The token cache is being invalidate because project 22a77f51d295458bb3c8051214f7eeb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:13:42.459928 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:42.461246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-99978ac3-0106-48e2-84cc-6ee9bd2d5c71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:42.468519 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb988ee-6297-49a7-aaca-5af6299f7d8b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:42.469535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb988ee-6297-49a7-aaca-5af6299f7d8b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:42.470591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb988ee-6297-49a7-aaca-5af6299f7d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:42.474476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1229/2452] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:13:41 2022] DELETE /identity/v3/projects/22a77f51d295458bb3c8051214f7eeb3 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:42.492954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4eb988ee-6297-49a7-aaca-5af6299f7d8b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:42.494983 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4eb988ee-6297-49a7-aaca-5af6299f7d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:42.589121 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1224/2453] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:42.591181 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d67426-0177-4a33-9022-84c9053b2975 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:42.591485 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d67426-0177-4a33-9022-84c9053b2975 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:42.591757 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d67426-0177-4a33-9022-84c9053b2975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:42.645842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e4d67426-0177-4a33-9022-84c9053b2975 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:42.646857 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e4d67426-0177-4a33-9022-84c9053b2975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:42.656589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1230/2454] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:42.660658 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb988ee-6297-49a7-aaca-5af6299f7d8b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:42.673101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb988ee-6297-49a7-aaca-5af6299f7d8b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:42.683747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035baa49-bc81-4481-b5a9-123e08ccdb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:42.684481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035baa49-bc81-4481-b5a9-123e08ccdb4b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:42.684711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035baa49-bc81-4481-b5a9-123e08ccdb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:42.685010 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035baa49-bc81-4481-b5a9-123e08ccdb4b admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:42.685693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035baa49-bc81-4481-b5a9-123e08ccdb4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:13:42.686161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035baa49-bc81-4481-b5a9-123e08ccdb4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:42.687947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035baa49-bc81-4481-b5a9-123e08ccdb4b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:42.703524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1225/2455] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:13:42.707771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d67426-0177-4a33-9022-84c9053b2975 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:42.718109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d67426-0177-4a33-9022-84c9053b2975 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:42.724693 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbaa53-d487-4d90-b4d8-d68b5083a7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:42.726069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbaa53-d487-4d90-b4d8-d68b5083a7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:42.726600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbaa53-d487-4d90-b4d8-d68b5083a7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:42.727063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cbaa53-d487-4d90-b4d8-d68b5083a7f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:42.727986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbaa53-d487-4d90-b4d8-d68b5083a7f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:42.733960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cbaa53-d487-4d90-b4d8-d68b5083a7f9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:42.737171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:42.872402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1231/2456] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:13:42 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:13:42.876513 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035baa49-bc81-4481-b5a9-123e08ccdb4b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:42.889581 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035baa49-bc81-4481-b5a9-123e08ccdb4b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:42.950349 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:42.980876 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32905c-86a5-4dfd-b47d-612f0e445f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:42.981504 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32905c-86a5-4dfd-b47d-612f0e445f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:42.981794 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32905c-86a5-4dfd-b47d-612f0e445f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:42.982087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb32905c-86a5-4dfd-b47d-612f0e445f1c admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:42.983054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32905c-86a5-4dfd-b47d-612f0e445f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:42.993148 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb32905c-86a5-4dfd-b47d-612f0e445f1c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:43.099958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1226/2457] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:13:42 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:13:43.103240 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbaa53-d487-4d90-b4d8-d68b5083a7f9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:43.116704 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cbaa53-d487-4d90-b4d8-d68b5083a7f9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:43.121760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0974d-e777-4c70-a762-df73531c2776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:43.128016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0974d-e777-4c70-a762-df73531c2776 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:43.128016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0974d-e777-4c70-a762-df73531c2776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:43.128016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad0974d-e777-4c70-a762-df73531c2776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:43.128016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0974d-e777-4c70-a762-df73531c2776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:43.128016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad0974d-e777-4c70-a762-df73531c2776 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:43.172627 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1232/2458] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:13:43.176873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32905c-86a5-4dfd-b47d-612f0e445f1c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:43.203944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb32905c-86a5-4dfd-b47d-612f0e445f1c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:43.209475 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2190fb-2c3d-4795-a996-711da038c8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:43.210857 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2190fb-2c3d-4795-a996-711da038c8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:43.211142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2190fb-2c3d-4795-a996-711da038c8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:43.211575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2190fb-2c3d-4795-a996-711da038c8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:43.212385 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2190fb-2c3d-4795-a996-711da038c8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:43.214234 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2190fb-2c3d-4795-a996-711da038c8b1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:43.239283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1227/2459] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:13:43.240616 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0974d-e777-4c70-a762-df73531c2776 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:43.259317 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca982-ae5b-4119-bf4e-4d7e9804485f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:43.259633 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca982-ae5b-4119-bf4e-4d7e9804485f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:43.260199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ca982-ae5b-4119-bf4e-4d7e9804485f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:43.262229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad0974d-e777-4c70-a762-df73531c2776 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:43.268060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd49eb75-5aa2-430e-9cb4-9b2bc5242432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:43.269236 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49eb75-5aa2-430e-9cb4-9b2bc5242432 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:43.269706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49eb75-5aa2-430e-9cb4-9b2bc5242432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:43.272104 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd49eb75-5aa2-430e-9cb4-9b2bc5242432 admin admin] PATH_INFO: `/v3/projects/610642b52bc64a01b3b2636f99d99fe2/users/c454beb471f946b0bf56daa5d1278f26/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:43.288583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49eb75-5aa2-430e-9cb4-9b2bc5242432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=610642b52bc64a01b3b2636f99d99fe2, user_id=c454beb471f946b0bf56daa5d1278f26, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:43.291663 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd49eb75-5aa2-430e-9cb4-9b2bc5242432 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:43.300316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4c1ca982-ae5b-4119-bf4e-4d7e9804485f None None] MFA Rules not processed for user `2e4b7284faaf4dee9f87bdccdd8b5c98`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:43.301889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4c1ca982-ae5b-4119-bf4e-4d7e9804485f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:43.344257 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1233/2460] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:13:43 2022] PUT /identity/v3/projects/610642b52bc64a01b3b2636f99d99fe2/users/c454beb471f946b0bf56daa5d1278f26/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:43.356726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fa50c-5ec2-4630-8e35-68d36c17e9ae None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:43.357085 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fa50c-5ec2-4630-8e35-68d36c17e9ae None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:43.357434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240fa50c-5ec2-4630-8e35-68d36c17e9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:43.394752 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1228/2461] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:13:43.400231 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-240fa50c-5ec2-4630-8e35-68d36c17e9ae None None] MFA Rules not processed for user `c454beb471f946b0bf56daa5d1278f26`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:43.401642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-240fa50c-5ec2-4630-8e35-68d36c17e9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:43.407572 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca982-ae5b-4119-bf4e-4d7e9804485f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:43.409035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4c1ca982-ae5b-4119-bf4e-4d7e9804485f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:43.495528 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ca982-ae5b-4119-bf4e-4d7e9804485f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:43.499586 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1234/2462] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:13:43.506173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fa50c-5ec2-4630-8e35-68d36c17e9ae None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:43.582202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c238609-9e89-4177-b230-268cdb95b7c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c83e30a9fd04385b44ee3a3b72e5099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:43.583259 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c238609-9e89-4177-b230-268cdb95b7c3 service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:43.583710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c238609-9e89-4177-b230-268cdb95b7c3 service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:43.584238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c238609-9e89-4177-b230-268cdb95b7c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:43.587410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5c238609-9e89-4177-b230-268cdb95b7c3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:43.644563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240fa50c-5ec2-4630-8e35-68d36c17e9ae None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:43.654178 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ece85-d98f-4bc9-9b95-bb9ca7ba9692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:43.654847 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ece85-d98f-4bc9-9b95-bb9ca7ba9692 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:43.655133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ece85-d98f-4bc9-9b95-bb9ca7ba9692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:43.655403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8ece85-d98f-4bc9-9b95-bb9ca7ba9692 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:43.657858 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ece85-d98f-4bc9-9b95-bb9ca7ba9692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:43.659820 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8ece85-d98f-4bc9-9b95-bb9ca7ba9692 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:43.743832 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c238609-9e89-4177-b230-268cdb95b7c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:43.748191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c238609-9e89-4177-b230-268cdb95b7c3 service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:43.760640 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1229/2463] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:13:43.794445 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1235/2464] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:13:43 2022] POST /identity/v3/projects => generated 379 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:13:43.795055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c238609-9e89-4177-b230-268cdb95b7c3 service glance] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:43.816545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c238609-9e89-4177-b230-268cdb95b7c3 service glance] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:43.917797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298626b-7096-45c0-a763-f3ee58b4f86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:43.918866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298626b-7096-45c0-a763-f3ee58b4f86d admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:43.919152 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298626b-7096-45c0-a763-f3ee58b4f86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:43.919428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298626b-7096-45c0-a763-f3ee58b4f86d admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:43.920116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298626b-7096-45c0-a763-f3ee58b4f86d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:43.922060 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298626b-7096-45c0-a763-f3ee58b4f86d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:44.073083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ece85-d98f-4bc9-9b95-bb9ca7ba9692 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:44.075764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1230/2465] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:13:43 2022] POST /identity/v3/users => generated 296 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:13:44.087967 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8ece85-d98f-4bc9-9b95-bb9ca7ba9692 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:44.094484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83d3d3-04ac-4406-bd25-54b68ef32f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:44.096069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83d3d3-04ac-4406-bd25-54b68ef32f51 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:44.096453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83d3d3-04ac-4406-bd25-54b68ef32f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:44.096834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83d3d3-04ac-4406-bd25-54b68ef32f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:44.098455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83d3d3-04ac-4406-bd25-54b68ef32f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:44.100291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83d3d3-04ac-4406-bd25-54b68ef32f51 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:44.116423 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1236/2466] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:13:44.118590 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298626b-7096-45c0-a763-f3ee58b4f86d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:44.137063 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298626b-7096-45c0-a763-f3ee58b4f86d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:44.144045 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e129d8a-4016-4fcd-aec8-13c9233461db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:44.144739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e129d8a-4016-4fcd-aec8-13c9233461db admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:44.145021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e129d8a-4016-4fcd-aec8-13c9233461db admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:44.148671 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5abb6-e3b4-4ead-841b-61351f998c96 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:44.148807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e129d8a-4016-4fcd-aec8-13c9233461db admin admin] PATH_INFO: `/v3/projects/e81c90fcc1d444e5ad8121bc11613f95/users/cb4b0ba45a8e4b9487e0a471dff3ca6c/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:44.148913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5abb6-e3b4-4ead-841b-61351f998c96 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:44.148913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f5abb6-e3b4-4ead-841b-61351f998c96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:44.169467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e129d8a-4016-4fcd-aec8-13c9233461db admin admin] RBAC: Authorizing `identity:create_grant(project_id=e81c90fcc1d444e5ad8121bc11613f95, user_id=cb4b0ba45a8e4b9487e0a471dff3ca6c, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:44.172176 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a8f5abb6-e3b4-4ead-841b-61351f998c96 None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:44.172822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e129d8a-4016-4fcd-aec8-13c9233461db admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:44.173466 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a8f5abb6-e3b4-4ead-841b-61351f998c96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:44.193018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:44.220754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:44.267436 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1237/2467] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:13:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:13:44.337450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1231/2468] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:13:44 2022] PUT /identity/v3/projects/e81c90fcc1d444e5ad8121bc11613f95/users/cb4b0ba45a8e4b9487e0a471dff3ca6c/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:44.341980 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5abb6-e3b4-4ead-841b-61351f998c96 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:44.362342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f5abb6-e3b4-4ead-841b-61351f998c96 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:44.436905 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e129d8a-4016-4fcd-aec8-13c9233461db admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:44.439374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0e129d8a-4016-4fcd-aec8-13c9233461db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:44.453916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43996bf1-cd96-4903-a69b-fbcbb27244fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:44.454633 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43996bf1-cd96-4903-a69b-fbcbb27244fe admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:44.454968 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43996bf1-cd96-4903-a69b-fbcbb27244fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:44.455296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43996bf1-cd96-4903-a69b-fbcbb27244fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:44.456062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43996bf1-cd96-4903-a69b-fbcbb27244fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:44.457901 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43996bf1-cd96-4903-a69b-fbcbb27244fe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:44.488562 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1238/2469] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:13:44 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:13:44.493026 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43996bf1-cd96-4903-a69b-fbcbb27244fe admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:44.513482 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43996bf1-cd96-4903-a69b-fbcbb27244fe admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:44.527934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b475618-fbaa-42c8-8880-1a57f8b32379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:44.528756 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b475618-fbaa-42c8-8880-1a57f8b32379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:44.529130 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b475618-fbaa-42c8-8880-1a57f8b32379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:44.529638 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b475618-fbaa-42c8-8880-1a57f8b32379 admin admin] PATH_INFO: `/v3/projects/e81c90fcc1d444e5ad8121bc11613f95/users/cb4b0ba45a8e4b9487e0a471dff3ca6c/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:44.532172 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b475618-fbaa-42c8-8880-1a57f8b32379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e81c90fcc1d444e5ad8121bc11613f95, user_id=cb4b0ba45a8e4b9487e0a471dff3ca6c, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:44.553262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b475618-fbaa-42c8-8880-1a57f8b32379 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:44.572863 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e129d8a-4016-4fcd-aec8-13c9233461db admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:44.594723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1239/2470] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:13:44 2022] PUT /identity/v3/projects/e81c90fcc1d444e5ad8121bc11613f95/users/cb4b0ba45a8e4b9487e0a471dff3ca6c/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:13:44.596513 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc65900-6a29-4b2b-9599-06f1614a271b None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:44.596921 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc65900-6a29-4b2b-9599-06f1614a271b None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:44.597287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc65900-6a29-4b2b-9599-06f1614a271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:44.630683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:44.637625 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fcc65900-6a29-4b2b-9599-06f1614a271b None None] MFA Rules not processed for user `cb4b0ba45a8e4b9487e0a471dff3ca6c`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:44.639493 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fcc65900-6a29-4b2b-9599-06f1614a271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:44.718162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd8e98-736a-448b-ab8d-04e5a932f2e1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:44.719130 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd8e98-736a-448b-ab8d-04e5a932f2e1 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:44.719729 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd8e98-736a-448b-ab8d-04e5a932f2e1 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:44.720363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd8e98-736a-448b-ab8d-04e5a932f2e1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:44.737624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1240/2471] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:44.749573 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc65900-6a29-4b2b-9599-06f1614a271b None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:44.751226 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fcc65900-6a29-4b2b-9599-06f1614a271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:44.803479 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd8e98-736a-448b-ab8d-04e5a932f2e1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:44.806497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abd8e98-736a-448b-ab8d-04e5a932f2e1 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:44.828493 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1232/2472] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:13:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 08:13:44.835174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:44.918352 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc65900-6a29-4b2b-9599-06f1614a271b None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:44.930869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48208c-bcd0-4178-8007-d8eeaea4426d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:44.931518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48208c-bcd0-4178-8007-d8eeaea4426d service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:44.931799 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48208c-bcd0-4178-8007-d8eeaea4426d service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:44.932097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48208c-bcd0-4178-8007-d8eeaea4426d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:44.963321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48208c-bcd0-4178-8007-d8eeaea4426d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:44.964879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a48208c-bcd0-4178-8007-d8eeaea4426d service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:45.004363 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1241/2473] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:13:45.283289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd8e98-736a-448b-ab8d-04e5a932f2e1 service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:45.302235 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd8e98-736a-448b-ab8d-04e5a932f2e1 service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:45.314350 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f9f0a-e032-4e53-ad96-a5235b973e05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:45.315135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f9f0a-e032-4e53-ad96-a5235b973e05 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:45.315534 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f9f0a-e032-4e53-ad96-a5235b973e05 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:45.315933 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f9f0a-e032-4e53-ad96-a5235b973e05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:45.449135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f9f0a-e032-4e53-ad96-a5235b973e05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:45.450707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f9f0a-e032-4e53-ad96-a5235b973e05 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:45.470098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1233/2474] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:13:45.605665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48208c-bcd0-4178-8007-d8eeaea4426d service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:45.607216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4a48208c-bcd0-4178-8007-d8eeaea4426d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:45.717886 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48208c-bcd0-4178-8007-d8eeaea4426d service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:45.721644 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de8d57-bf61-4ddb-bbc8-183bc76e20f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:45.723358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8d57-bf61-4ddb-bbc8-183bc76e20f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:45.723492 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8d57-bf61-4ddb-bbc8-183bc76e20f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:45.723743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de8d57-bf61-4ddb-bbc8-183bc76e20f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:45.726724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d4de8d57-bf61-4ddb-bbc8-183bc76e20f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:45.838432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de8d57-bf61-4ddb-bbc8-183bc76e20f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:45.845723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de8d57-bf61-4ddb-bbc8-183bc76e20f9 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:45.871910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1242/2475] 10.222.0.62 () {60 vars in 1396 bytes} [Wed Aug 24 08:13:45 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3260 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:13:55.462066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=71 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:55.862211 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=61 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:55.973086 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f9f0a-e032-4e53-ad96-a5235b973e05 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:56.052382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f9f0a-e032-4e53-ad96-a5235b973e05 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:56.059398 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaa972-4261-4b22-9d7d-e8e437d888df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:56.060217 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa972-4261-4b22-9d7d-e8e437d888df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:56.060675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa972-4261-4b22-9d7d-e8e437d888df admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:56.061062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caaa972-4261-4b22-9d7d-e8e437d888df admin admin] PATH_INFO: `/v3/users/c454beb471f946b0bf56daa5d1278f26` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:56.062382 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaa972-4261-4b22-9d7d-e8e437d888df admin admin] RBAC: Authorizing `identity:delete_user(user_id=c454beb471f946b0bf56daa5d1278f26)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:56.064587 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caaa972-4261-4b22-9d7d-e8e437d888df admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:56.673820 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4caaa972-4261-4b22-9d7d-e8e437d888df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c454beb471f946b0bf56daa5d1278f26'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:56.674493 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4caaa972-4261-4b22-9d7d-e8e437d888df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c454beb471f946b0bf56daa5d1278f26'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:56.675066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4caaa972-4261-4b22-9d7d-e8e437d888df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c454beb471f946b0bf56daa5d1278f26'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:56.682728 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4caaa972-4261-4b22-9d7d-e8e437d888df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c454beb471f946b0bf56daa5d1278f26'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:56.694469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-4caaa972-4261-4b22-9d7d-e8e437d888df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c454beb471f946b0bf56daa5d1278f26'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:56.751928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1234/2476] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:13:55 2022] DELETE /identity/v3/users/c454beb471f946b0bf56daa5d1278f26 => generated 0 bytes in 776 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:56.753461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7fe0-bf6a-428b-a96c-d954847f6ed3 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:56.753859 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7fe0-bf6a-428b-a96c-d954847f6ed3 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:56.754293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae7fe0-bf6a-428b-a96c-d954847f6ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:56.776198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-16ae7fe0-bf6a-428b-a96c-d954847f6ed3 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:56.777539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-16ae7fe0-bf6a-428b-a96c-d954847f6ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:56.852752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1243/2477] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:56.866099 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaa972-4261-4b22-9d7d-e8e437d888df admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:56.868560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4caaa972-4261-4b22-9d7d-e8e437d888df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:56.939414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caaa972-4261-4b22-9d7d-e8e437d888df admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:56.947540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ad65a-a2c8-4686-8cab-b479e2abaccf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:56.950238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad65a-a2c8-4686-8cab-b479e2abaccf service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:56.950238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad65a-a2c8-4686-8cab-b479e2abaccf service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:56.950238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ad65a-a2c8-4686-8cab-b479e2abaccf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:56.961057 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ad65a-a2c8-4686-8cab-b479e2abaccf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:56.962622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ad65a-a2c8-4686-8cab-b479e2abaccf service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:56.975277 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1235/2478] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:13:57.485064 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4ce6f-0a3d-4a9a-bd67-25a8370122de None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:57.486532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4ce6f-0a3d-4a9a-bd67-25a8370122de None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:57.486532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4ce6f-0a3d-4a9a-bd67-25a8370122de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:57.486758 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ad65a-a2c8-4686-8cab-b479e2abaccf service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:57.487473 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c18ad65a-a2c8-4686-8cab-b479e2abaccf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:57.504737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ad65a-a2c8-4686-8cab-b479e2abaccf service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:57.506948 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-eff4ce6f-0a3d-4a9a-bd67-25a8370122de None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:57.508812 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-eff4ce6f-0a3d-4a9a-bd67-25a8370122de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:57.510688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b3db6-deb0-4e24-8e47-562e8f25bd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:57.511965 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b3db6-deb0-4e24-8e47-562e8f25bd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:57.512310 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b3db6-deb0-4e24-8e47-562e8f25bd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:57.515397 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b3db6-deb0-4e24-8e47-562e8f25bd38 admin admin] PATH_INFO: `/v3/projects/610642b52bc64a01b3b2636f99d99fe2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:57.515397 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b3db6-deb0-4e24-8e47-562e8f25bd38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=610642b52bc64a01b3b2636f99d99fe2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:57.517220 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b3db6-deb0-4e24-8e47-562e8f25bd38 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:57.537026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:57.570369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1244/2479] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:13:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:57.582117 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4ce6f-0a3d-4a9a-bd67-25a8370122de None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:57.583467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-eff4ce6f-0a3d-4a9a-bd67-25a8370122de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:57.638602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-412b3db6-deb0-4e24-8e47-562e8f25bd38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '610642b52bc64a01b3b2636f99d99fe2', 'request_id': 'req-412b3db6-deb0-4e24-8e47-562e8f25bd38'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:57.644896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-412b3db6-deb0-4e24-8e47-562e8f25bd38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '610642b52bc64a01b3b2636f99d99fe2', 'request_id': 'req-412b3db6-deb0-4e24-8e47-562e8f25bd38'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:57.654909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4ce6f-0a3d-4a9a-bd67-25a8370122de None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:57.700694 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:57.716060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a398570-469d-4af3-8484-90c167675a2e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:57.716670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398570-469d-4af3-8484-90c167675a2e service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:57.716951 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398570-469d-4af3-8484-90c167675a2e service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:57.717224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a398570-469d-4af3-8484-90c167675a2e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:57.728800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-412b3db6-deb0-4e24-8e47-562e8f25bd38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '610642b52bc64a01b3b2636f99d99fe2', 'request_id': 'req-412b3db6-deb0-4e24-8e47-562e8f25bd38'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:57.741216 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-412b3db6-deb0-4e24-8e47-562e8f25bd38 admin admin] The token cache is being invalidate because project 610642b52bc64a01b3b2636f99d99fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:13:57.742138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-412b3db6-deb0-4e24-8e47-562e8f25bd38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:57.742904 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-412b3db6-deb0-4e24-8e47-562e8f25bd38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:57.747942 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1236/2480] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:13:57 2022] DELETE /identity/v3/projects/610642b52bc64a01b3b2636f99d99fe2 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:57.747942 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339228c-178c-44b6-989b-75ae38fd19a6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:57.747942 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339228c-178c-44b6-989b-75ae38fd19a6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:57.747942 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339228c-178c-44b6-989b-75ae38fd19a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:57.765781 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1339228c-178c-44b6-989b-75ae38fd19a6 None None] MFA Rules not processed for user `3a971d4b3ffb435cb3227385d80277d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:57.766989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1339228c-178c-44b6-989b-75ae38fd19a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:57.784249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a398570-469d-4af3-8484-90c167675a2e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:57.786503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a398570-469d-4af3-8484-90c167675a2e service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:57.802468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1245/2481] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:13:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 08:13:57.803472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a398570-469d-4af3-8484-90c167675a2e service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:57.838072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1237/2482] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:57.875376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a398570-469d-4af3-8484-90c167675a2e service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:57.880966 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9e75f-3990-45db-abdb-ba087e0ca2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:57.881532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9e75f-3990-45db-abdb-ba087e0ca2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:57.881532 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9e75f-3990-45db-abdb-ba087e0ca2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:57.881832 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd9e75f-3990-45db-abdb-ba087e0ca2d7 admin admin] PATH_INFO: `/v3/users/cb4b0ba45a8e4b9487e0a471dff3ca6c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:57.883395 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9e75f-3990-45db-abdb-ba087e0ca2d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4b0ba45a8e4b9487e0a471dff3ca6c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:57.885321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd9e75f-3990-45db-abdb-ba087e0ca2d7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:58.095209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fdd9e75f-3990-45db-abdb-ba087e0ca2d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4b0ba45a8e4b9487e0a471dff3ca6c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:58.118506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fdd9e75f-3990-45db-abdb-ba087e0ca2d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4b0ba45a8e4b9487e0a471dff3ca6c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:58.119264 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fdd9e75f-3990-45db-abdb-ba087e0ca2d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4b0ba45a8e4b9487e0a471dff3ca6c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:58.120014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fdd9e75f-3990-45db-abdb-ba087e0ca2d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4b0ba45a8e4b9487e0a471dff3ca6c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:58.131516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-fdd9e75f-3990-45db-abdb-ba087e0ca2d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4b0ba45a8e4b9487e0a471dff3ca6c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:58.188706 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339228c-178c-44b6-989b-75ae38fd19a6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:58.190119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1339228c-178c-44b6-989b-75ae38fd19a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:58.233816 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1246/2483] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:13:57 2022] DELETE /identity/v3/users/cb4b0ba45a8e4b9487e0a471dff3ca6c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:58.294924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339228c-178c-44b6-989b-75ae38fd19a6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:58.389149 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04eb5d8-7ea9-43f8-9f9b-0f60cce4049b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:58.390002 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eb5d8-7ea9-43f8-9f9b-0f60cce4049b service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:58.390494 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eb5d8-7ea9-43f8-9f9b-0f60cce4049b service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:58.390785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04eb5d8-7ea9-43f8-9f9b-0f60cce4049b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:58.392963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b04eb5d8-7ea9-43f8-9f9b-0f60cce4049b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:58.408983 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04eb5d8-7ea9-43f8-9f9b-0f60cce4049b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:58.410738 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04eb5d8-7ea9-43f8-9f9b-0f60cce4049b service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:58.420641 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1238/2484] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:13:58.873992 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9e75f-3990-45db-abdb-ba087e0ca2d7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:58.875542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fdd9e75f-3990-45db-abdb-ba087e0ca2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:58.890711 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:58.989453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd9e75f-3990-45db-abdb-ba087e0ca2d7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:58.994488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04eb5d8-7ea9-43f8-9f9b-0f60cce4049b service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:58.996123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b04eb5d8-7ea9-43f8-9f9b-0f60cce4049b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:59.006661 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52b78cb-0ac2-4207-bf47-3e3477de23cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:59.008009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b78cb-0ac2-4207-bf47-3e3477de23cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:59.008474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b78cb-0ac2-4207-bf47-3e3477de23cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:59.008928 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52b78cb-0ac2-4207-bf47-3e3477de23cb admin admin] PATH_INFO: `/v3/projects/e81c90fcc1d444e5ad8121bc11613f95` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:59.009840 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:13:59.010947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b78cb-0ac2-4207-bf47-3e3477de23cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e81c90fcc1d444e5ad8121bc11613f95)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:59.013585 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52b78cb-0ac2-4207-bf47-3e3477de23cb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:59.130516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04eb5d8-7ea9-43f8-9f9b-0f60cce4049b service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:59.142269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabece9a-e8bf-464a-9a66-80e0a47561ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213e29685f3402b804d4d8fbc88ba96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:59.143461 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabece9a-e8bf-464a-9a66-80e0a47561ff service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:59.143800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabece9a-e8bf-464a-9a66-80e0a47561ff service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:59.144159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabece9a-e8bf-464a-9a66-80e0a47561ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:59.146068 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-eabece9a-e8bf-464a-9a66-80e0a47561ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:59.154310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e52b78cb-0ac2-4207-bf47-3e3477de23cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e81c90fcc1d444e5ad8121bc11613f95', 'request_id': 'req-e52b78cb-0ac2-4207-bf47-3e3477de23cb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:59.161670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabece9a-e8bf-464a-9a66-80e0a47561ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:59.161905 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e52b78cb-0ac2-4207-bf47-3e3477de23cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e81c90fcc1d444e5ad8121bc11613f95', 'request_id': 'req-e52b78cb-0ac2-4207-bf47-3e3477de23cb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:59.164168 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabece9a-e8bf-464a-9a66-80e0a47561ff service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:59.169892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e52b78cb-0ac2-4207-bf47-3e3477de23cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e81c90fcc1d444e5ad8121bc11613f95', 'request_id': 'req-e52b78cb-0ac2-4207-bf47-3e3477de23cb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:59.175873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1239/2485] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:13:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:13:59.308911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e52b78cb-0ac2-4207-bf47-3e3477de23cb admin admin] The token cache is being invalidate because project e81c90fcc1d444e5ad8121bc11613f95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:13:59.308911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e52b78cb-0ac2-4207-bf47-3e3477de23cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:59.308911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e52b78cb-0ac2-4207-bf47-3e3477de23cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:13:59.308911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1247/2486] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:13:58 2022] DELETE /identity/v3/projects/e81c90fcc1d444e5ad8121bc11613f95 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:13:59.309705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aed4c-68f3-4348-b949-0e23e7d81691 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:59.309978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aed4c-68f3-4348-b949-0e23e7d81691 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:59.310252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aed4c-68f3-4348-b949-0e23e7d81691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:59.337031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f66aed4c-68f3-4348-b949-0e23e7d81691 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:59.342541 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f66aed4c-68f3-4348-b949-0e23e7d81691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:59.416122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1240/2487] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:59.423157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2809e5-b4df-44a3-a25b-dc18eebe401a None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:59.423527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2809e5-b4df-44a3-a25b-dc18eebe401a None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:59.423893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2809e5-b4df-44a3-a25b-dc18eebe401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:59.454030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3b2809e5-b4df-44a3-a25b-dc18eebe401a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:13:59.455590 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3b2809e5-b4df-44a3-a25b-dc18eebe401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:13:59.465262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1248/2488] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:13:59.469570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aed4c-68f3-4348-b949-0e23e7d81691 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:59.482153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aed4c-68f3-4348-b949-0e23e7d81691 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:59.485330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4b45a-dcb0-4f9e-9ec5-1ef0169b89aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:59.485952 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b45a-dcb0-4f9e-9ec5-1ef0169b89aa admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:59.486231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b45a-dcb0-4f9e-9ec5-1ef0169b89aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:59.486778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4b45a-dcb0-4f9e-9ec5-1ef0169b89aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:59.487446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4b45a-dcb0-4f9e-9ec5-1ef0169b89aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:13:59.487744 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4b45a-dcb0-4f9e-9ec5-1ef0169b89aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:59.489365 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4b45a-dcb0-4f9e-9ec5-1ef0169b89aa admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:59.508407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1241/2489] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:13:59.509668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2809e5-b4df-44a3-a25b-dc18eebe401a None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:59.520125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2809e5-b4df-44a3-a25b-dc18eebe401a None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:59.531044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e54b8-b98b-486e-b388-5089782a1d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:59.531856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e54b8-b98b-486e-b388-5089782a1d40 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:59.532164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e54b8-b98b-486e-b388-5089782a1d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:59.532439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e54b8-b98b-486e-b388-5089782a1d40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:59.533077 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e54b8-b98b-486e-b388-5089782a1d40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:59.534975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e54b8-b98b-486e-b388-5089782a1d40 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:59.660049 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1249/2490] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:13:59 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:13:59.661516 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4b45a-dcb0-4f9e-9ec5-1ef0169b89aa admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:59.675038 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4b45a-dcb0-4f9e-9ec5-1ef0169b89aa admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:59.760244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c98879-9c5b-4c3c-ae4e-f1efcc8dd2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:59.760244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c98879-9c5b-4c3c-ae4e-f1efcc8dd2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:59.760244 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c98879-9c5b-4c3c-ae4e-f1efcc8dd2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:59.760958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c98879-9c5b-4c3c-ae4e-f1efcc8dd2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:59.761084 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c98879-9c5b-4c3c-ae4e-f1efcc8dd2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:59.763251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c98879-9c5b-4c3c-ae4e-f1efcc8dd2a6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:59.874764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1242/2491] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:13:59 2022] POST /identity/v3/users => generated 285 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:13:59.878977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e54b8-b98b-486e-b388-5089782a1d40 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:59.911280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e54b8-b98b-486e-b388-5089782a1d40 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:59.929788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ad108-f3d6-4d63-a045-f6e713a30b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:59.931144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad108-f3d6-4d63-a045-f6e713a30b20 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:59.933810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad108-f3d6-4d63-a045-f6e713a30b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:59.936298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ad108-f3d6-4d63-a045-f6e713a30b20 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:59.936298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ad108-f3d6-4d63-a045-f6e713a30b20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:59.937273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ad108-f3d6-4d63-a045-f6e713a30b20 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:13:59.949773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1250/2492] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:13:59.953851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c98879-9c5b-4c3c-ae4e-f1efcc8dd2a6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:13:59.974800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c98879-9c5b-4c3c-ae4e-f1efcc8dd2a6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:13:59.986117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e8a42-b129-4afc-8930-93e69313b4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:13:59.986743 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e8a42-b129-4afc-8930-93e69313b4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:13:59.987026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e8a42-b129-4afc-8930-93e69313b4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:13:59.987339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e8a42-b129-4afc-8930-93e69313b4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:13:59.988020 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e8a42-b129-4afc-8930-93e69313b4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:13:59.996279 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e8a42-b129-4afc-8930-93e69313b4a4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:00.022592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1243/2493] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:13:59 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:00.025380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ad108-f3d6-4d63-a045-f6e713a30b20 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:00.040132 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ad108-f3d6-4d63-a045-f6e713a30b20 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:00.045643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad689b-f2f1-46ae-95b7-2ea682300aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:00.046557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad689b-f2f1-46ae-95b7-2ea682300aae admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:00.048071 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad689b-f2f1-46ae-95b7-2ea682300aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:00.048071 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ad689b-f2f1-46ae-95b7-2ea682300aae admin admin] PATH_INFO: `/v3/projects/8de0c73c976549a4805d93023e8e5b58/users/29cd8e1298874cda9bc9d6916eb2e8dd/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:00.122598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad689b-f2f1-46ae-95b7-2ea682300aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de0c73c976549a4805d93023e8e5b58, user_id=29cd8e1298874cda9bc9d6916eb2e8dd, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:00.135906 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ad689b-f2f1-46ae-95b7-2ea682300aae admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:00.255621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1251/2494] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:14:00 2022] PUT /identity/v3/projects/8de0c73c976549a4805d93023e8e5b58/users/29cd8e1298874cda9bc9d6916eb2e8dd/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:00.267415 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55d7d-6c49-418b-894d-13cf4fe79141 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:00.267705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55d7d-6c49-418b-894d-13cf4fe79141 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:00.268028 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd55d7d-6c49-418b-894d-13cf4fe79141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:00.281650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:00.305710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-9cd55d7d-6c49-418b-894d-13cf4fe79141 None None] MFA Rules not processed for user `29cd8e1298874cda9bc9d6916eb2e8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:00.307253 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9cd55d7d-6c49-418b-894d-13cf4fe79141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:00.400694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1244/2495] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:00.405092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad689b-f2f1-46ae-95b7-2ea682300aae admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:00.456923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:00.481993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ad689b-f2f1-46ae-95b7-2ea682300aae admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:00.487040 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32f81a-1be2-4211-92da-ce8b00893a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:00.487665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32f81a-1be2-4211-92da-ce8b00893a34 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:00.488031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32f81a-1be2-4211-92da-ce8b00893a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:00.488640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32f81a-1be2-4211-92da-ce8b00893a34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:00.489297 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32f81a-1be2-4211-92da-ce8b00893a34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:00.491207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32f81a-1be2-4211-92da-ce8b00893a34 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:00.583773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1252/2496] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:14:00 2022] POST /identity/v3/projects => generated 367 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:14:00.588154 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd55d7d-6c49-418b-894d-13cf4fe79141 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:00.604345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd55d7d-6c49-418b-894d-13cf4fe79141 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:00.676025 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601e54f-4969-4969-8945-f02505b2c4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:00.677042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e54f-4969-4969-8945-f02505b2c4b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:00.677324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e54f-4969-4969-8945-f02505b2c4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:00.677598 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f601e54f-4969-4969-8945-f02505b2c4b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:00.678318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601e54f-4969-4969-8945-f02505b2c4b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:00.682261 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f601e54f-4969-4969-8945-f02505b2c4b8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:00.776590 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1245/2497] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:14:00 2022] POST /identity/v3/users => generated 290 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:14:00.780529 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32f81a-1be2-4211-92da-ce8b00893a34 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:00.795467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32f81a-1be2-4211-92da-ce8b00893a34 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:00.800698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c430bc1-55d9-47cc-8c88-8a7d8728bfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:00.801306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c430bc1-55d9-47cc-8c88-8a7d8728bfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:00.801594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c430bc1-55d9-47cc-8c88-8a7d8728bfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:00.801877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c430bc1-55d9-47cc-8c88-8a7d8728bfc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:00.802508 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c430bc1-55d9-47cc-8c88-8a7d8728bfc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:00.804780 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c430bc1-55d9-47cc-8c88-8a7d8728bfc1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:00.821435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1253/2498] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:00.824067 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601e54f-4969-4969-8945-f02505b2c4b8 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:00.836846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f601e54f-4969-4969-8945-f02505b2c4b8 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:00.845518 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3fffd-13de-43fd-b537-e9aa2d9d821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:00.846208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3fffd-13de-43fd-b537-e9aa2d9d821f admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:00.846520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3fffd-13de-43fd-b537-e9aa2d9d821f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:00.846801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3fffd-13de-43fd-b537-e9aa2d9d821f admin admin] PATH_INFO: `/v3/projects/acfb621d4f984d468878113f3f22569c/users/1b58524113da4601a7417345267dd500/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:00.866617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3fffd-13de-43fd-b537-e9aa2d9d821f admin admin] RBAC: Authorizing `identity:create_grant(project_id=acfb621d4f984d468878113f3f22569c, user_id=1b58524113da4601a7417345267dd500, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:00.869703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3fffd-13de-43fd-b537-e9aa2d9d821f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:00.949727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1246/2499] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:14:00 2022] PUT /identity/v3/projects/acfb621d4f984d468878113f3f22569c/users/1b58524113da4601a7417345267dd500/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:14:00.954114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c430bc1-55d9-47cc-8c88-8a7d8728bfc1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:00.974720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c430bc1-55d9-47cc-8c88-8a7d8728bfc1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:01.052594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a7f82-d8b8-48f4-8419-09de7636f771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:01.053168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a7f82-d8b8-48f4-8419-09de7636f771 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:01.053449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a7f82-d8b8-48f4-8419-09de7636f771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:01.053722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a7f82-d8b8-48f4-8419-09de7636f771 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:01.055168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a7f82-d8b8-48f4-8419-09de7636f771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:01.057085 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a7f82-d8b8-48f4-8419-09de7636f771 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:01.070854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1254/2500] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:01.079790 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3fffd-13de-43fd-b537-e9aa2d9d821f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:01.093148 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3fffd-13de-43fd-b537-e9aa2d9d821f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:01.108423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b52fde-0433-42c5-99bb-52b78005ec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:01.109345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b52fde-0433-42c5-99bb-52b78005ec73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:01.109719 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b52fde-0433-42c5-99bb-52b78005ec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:01.110068 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b52fde-0433-42c5-99bb-52b78005ec73 admin admin] PATH_INFO: `/v3/projects/acfb621d4f984d468878113f3f22569c/users/1b58524113da4601a7417345267dd500/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:01.123879 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b52fde-0433-42c5-99bb-52b78005ec73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=acfb621d4f984d468878113f3f22569c, user_id=1b58524113da4601a7417345267dd500, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:01.140900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b52fde-0433-42c5-99bb-52b78005ec73 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:01.144579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1247/2501] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:14:01 2022] PUT /identity/v3/projects/acfb621d4f984d468878113f3f22569c/users/1b58524113da4601a7417345267dd500/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:01.156111 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc8b11-31d9-4ed1-8087-b76b8a32555f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:01.157536 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc8b11-31d9-4ed1-8087-b76b8a32555f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:01.157536 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc8b11-31d9-4ed1-8087-b76b8a32555f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:01.208579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9dbc8b11-31d9-4ed1-8087-b76b8a32555f None None] MFA Rules not processed for user `1b58524113da4601a7417345267dd500`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:01.208579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9dbc8b11-31d9-4ed1-8087-b76b8a32555f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:01.265109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1255/2502] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:01.276261 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b52fde-0433-42c5-99bb-52b78005ec73 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:01.281828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-23b52fde-0433-42c5-99bb-52b78005ec73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:01.338354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:01.343646 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b52fde-0433-42c5-99bb-52b78005ec73 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:01.347323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adbb25-d61e-48b7-8124-fa47b9358b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:01.347966 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adbb25-d61e-48b7-8124-fa47b9358b15 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:01.348252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adbb25-d61e-48b7-8124-fa47b9358b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:01.348523 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0adbb25-d61e-48b7-8124-fa47b9358b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:01.357495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adbb25-d61e-48b7-8124-fa47b9358b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:01.358933 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0adbb25-d61e-48b7-8124-fa47b9358b15 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:01.368267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1248/2503] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:02.998200 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196520d2-7fbe-4dca-bacf-546702bba916 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:02.998772 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196520d2-7fbe-4dca-bacf-546702bba916 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:02.998772 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196520d2-7fbe-4dca-bacf-546702bba916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:03.032436 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-196520d2-7fbe-4dca-bacf-546702bba916 None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:03.032436 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-196520d2-7fbe-4dca-bacf-546702bba916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:03.076777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:03.122183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1256/2504] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:14:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:03.138526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adbb25-d61e-48b7-8124-fa47b9358b15 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:03.140467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c0adbb25-d61e-48b7-8124-fa47b9358b15 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:03.265073 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0adbb25-d61e-48b7-8124-fa47b9358b15 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:03.270844 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a9dc4-efbf-4c7b-8079-d385894c8f87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:03.271540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a9dc4-efbf-4c7b-8079-d385894c8f87 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:03.271922 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a9dc4-efbf-4c7b-8079-d385894c8f87 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:03.272286 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a9dc4-efbf-4c7b-8079-d385894c8f87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:03.287412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a9dc4-efbf-4c7b-8079-d385894c8f87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:03.288991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a9dc4-efbf-4c7b-8079-d385894c8f87 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:03.298665 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1249/2505] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:14:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:14:03.736809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196520d2-7fbe-4dca-bacf-546702bba916 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:03.738271 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-196520d2-7fbe-4dca-bacf-546702bba916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:03.856683 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196520d2-7fbe-4dca-bacf-546702bba916 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:03.861632 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8eb23-9cad-4148-9e7d-b5a702cfd6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:03.876343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8eb23-9cad-4148-9e7d-b5a702cfd6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:03.876343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8eb23-9cad-4148-9e7d-b5a702cfd6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:03.876343 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8eb23-9cad-4148-9e7d-b5a702cfd6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:03.880677 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3dd8eb23-9cad-4148-9e7d-b5a702cfd6b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:03.900037 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8eb23-9cad-4148-9e7d-b5a702cfd6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:03.901554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8eb23-9cad-4148-9e7d-b5a702cfd6b5 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:03.911787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1257/2506] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:05.596217 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a9dc4-efbf-4c7b-8079-d385894c8f87 service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:05.597923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-096a9dc4-efbf-4c7b-8079-d385894c8f87 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:05.712016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a9dc4-efbf-4c7b-8079-d385894c8f87 service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:05.718064 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d500aba-be79-4dd1-a634-f8c255dae849 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:05.718681 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d500aba-be79-4dd1-a634-f8c255dae849 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:05.718964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d500aba-be79-4dd1-a634-f8c255dae849 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:05.719290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d500aba-be79-4dd1-a634-f8c255dae849 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:05.721296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6d500aba-be79-4dd1-a634-f8c255dae849 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:05.735280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d500aba-be79-4dd1-a634-f8c255dae849 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:05.737157 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d500aba-be79-4dd1-a634-f8c255dae849 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:05.762720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1250/2507] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:06.155556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8eb23-9cad-4148-9e7d-b5a702cfd6b5 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:06.258462 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8eb23-9cad-4148-9e7d-b5a702cfd6b5 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:06.267706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3078a-d64d-4035-b562-608e91fe9a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:06.268577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3078a-d64d-4035-b562-608e91fe9a87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:06.271527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3078a-d64d-4035-b562-608e91fe9a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:06.271527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e3078a-d64d-4035-b562-608e91fe9a87 admin admin] PATH_INFO: `/v3/users/29cd8e1298874cda9bc9d6916eb2e8dd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:06.271527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3078a-d64d-4035-b562-608e91fe9a87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29cd8e1298874cda9bc9d6916eb2e8dd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:06.273426 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e3078a-d64d-4035-b562-608e91fe9a87 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:06.511103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-08e3078a-d64d-4035-b562-608e91fe9a87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29cd8e1298874cda9bc9d6916eb2e8dd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:06.579158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-08e3078a-d64d-4035-b562-608e91fe9a87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29cd8e1298874cda9bc9d6916eb2e8dd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:06.580026 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-08e3078a-d64d-4035-b562-608e91fe9a87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29cd8e1298874cda9bc9d6916eb2e8dd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:06.580714 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-08e3078a-d64d-4035-b562-608e91fe9a87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29cd8e1298874cda9bc9d6916eb2e8dd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:06.590141 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-08e3078a-d64d-4035-b562-608e91fe9a87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29cd8e1298874cda9bc9d6916eb2e8dd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:06.673473 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:06.687565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534feb4d-3fc7-4ab1-a30d-b797d46bea5f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:06.688173 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534feb4d-3fc7-4ab1-a30d-b797d46bea5f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:06.688173 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534feb4d-3fc7-4ab1-a30d-b797d46bea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:06.691891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1258/2508] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:14:06 2022] DELETE /identity/v3/users/29cd8e1298874cda9bc9d6916eb2e8dd => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:06.712088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-534feb4d-3fc7-4ab1-a30d-b797d46bea5f None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:06.713433 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-534feb4d-3fc7-4ab1-a30d-b797d46bea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:06.809544 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1251/2509] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:06.817198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3078a-d64d-4035-b562-608e91fe9a87 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:06.821533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-08e3078a-d64d-4035-b562-608e91fe9a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:06.911005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e3078a-d64d-4035-b562-608e91fe9a87 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:06.915392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e7b70-79ae-4d05-9f5e-a3faa33bdd49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:06.916626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e7b70-79ae-4d05-9f5e-a3faa33bdd49 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:06.917235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e7b70-79ae-4d05-9f5e-a3faa33bdd49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:06.917742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48e7b70-79ae-4d05-9f5e-a3faa33bdd49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:06.931710 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e7b70-79ae-4d05-9f5e-a3faa33bdd49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:06.933617 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48e7b70-79ae-4d05-9f5e-a3faa33bdd49 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:06.964251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1259/2510] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:08.006967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534feb4d-3fc7-4ab1-a30d-b797d46bea5f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:08.010013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-534feb4d-3fc7-4ab1-a30d-b797d46bea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:08.032797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:08.032797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534feb4d-3fc7-4ab1-a30d-b797d46bea5f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:08.058169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:08.058169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:08.058169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:08.058169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] PATH_INFO: `/v3/projects/8de0c73c976549a4805d93023e8e5b58` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:08.058983 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de0c73c976549a4805d93023e8e5b58)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:08.060005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:08.219052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de0c73c976549a4805d93023e8e5b58', 'request_id': 'req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:08.227055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de0c73c976549a4805d93023e8e5b58', 'request_id': 'req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:08.291462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de0c73c976549a4805d93023e8e5b58', 'request_id': 'req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:08.307764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] The token cache is being invalidate because project 8de0c73c976549a4805d93023e8e5b58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:14:08.308788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:08.309144 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:08.313944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1252/2511] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:14:08 2022] DELETE /identity/v3/projects/8de0c73c976549a4805d93023e8e5b58 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:08.315892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e7b70-79ae-4d05-9f5e-a3faa33bdd49 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:08.328280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48e7b70-79ae-4d05-9f5e-a3faa33bdd49 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:08.438409 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7443a-bdda-4d13-8b97-f1e47cfdbc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:08.439136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7443a-bdda-4d13-8b97-f1e47cfdbc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:08.439424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7443a-bdda-4d13-8b97-f1e47cfdbc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:08.439697 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7443a-bdda-4d13-8b97-f1e47cfdbc85 admin admin] PATH_INFO: `/v3/users/1b58524113da4601a7417345267dd500` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:08.444216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7443a-bdda-4d13-8b97-f1e47cfdbc85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b58524113da4601a7417345267dd500)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:08.447332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7443a-bdda-4d13-8b97-f1e47cfdbc85 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:08.635607 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-93c7443a-bdda-4d13-8b97-f1e47cfdbc85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b58524113da4601a7417345267dd500'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:08.657482 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-93c7443a-bdda-4d13-8b97-f1e47cfdbc85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b58524113da4601a7417345267dd500'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:08.658552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-93c7443a-bdda-4d13-8b97-f1e47cfdbc85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b58524113da4601a7417345267dd500'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:08.659356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-93c7443a-bdda-4d13-8b97-f1e47cfdbc85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b58524113da4601a7417345267dd500'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:08.685167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-93c7443a-bdda-4d13-8b97-f1e47cfdbc85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b58524113da4601a7417345267dd500'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:08.783545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1260/2512] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:14:08 2022] DELETE /identity/v3/users/1b58524113da4601a7417345267dd500 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:09.397365 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:09.397365 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:09.409399 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7316d4b1-dffe-4234-8491-4a4cdb3efcb6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:09.494732 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bef743e-59c3-4f59-a7ee-f74070d5ec71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:09.495664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef743e-59c3-4f59-a7ee-f74070d5ec71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:09.496927 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef743e-59c3-4f59-a7ee-f74070d5ec71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:09.497279 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bef743e-59c3-4f59-a7ee-f74070d5ec71 admin admin] PATH_INFO: `/v3/projects/acfb621d4f984d468878113f3f22569c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:09.505285 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef743e-59c3-4f59-a7ee-f74070d5ec71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=acfb621d4f984d468878113f3f22569c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:09.505285 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bef743e-59c3-4f59-a7ee-f74070d5ec71 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:09.658033 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7bef743e-59c3-4f59-a7ee-f74070d5ec71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'acfb621d4f984d468878113f3f22569c', 'request_id': 'req-7bef743e-59c3-4f59-a7ee-f74070d5ec71'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:09.675949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7bef743e-59c3-4f59-a7ee-f74070d5ec71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'acfb621d4f984d468878113f3f22569c', 'request_id': 'req-7bef743e-59c3-4f59-a7ee-f74070d5ec71'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:09.746479 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7bef743e-59c3-4f59-a7ee-f74070d5ec71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'acfb621d4f984d468878113f3f22569c', 'request_id': 'req-7bef743e-59c3-4f59-a7ee-f74070d5ec71'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:09.762273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7bef743e-59c3-4f59-a7ee-f74070d5ec71 admin admin] The token cache is being invalidate because project acfb621d4f984d468878113f3f22569c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:14:09.762609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7bef743e-59c3-4f59-a7ee-f74070d5ec71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:09.764047 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7bef743e-59c3-4f59-a7ee-f74070d5ec71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:09.769612 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1253/2513] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:14:09 2022] DELETE /identity/v3/projects/acfb621d4f984d468878113f3f22569c => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:09.771349 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6668adf-b972-448e-8019-a295dea13aa0 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:09.771903 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6668adf-b972-448e-8019-a295dea13aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:09.771903 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6668adf-b972-448e-8019-a295dea13aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:09.813041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f6668adf-b972-448e-8019-a295dea13aa0 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:09.814271 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f6668adf-b972-448e-8019-a295dea13aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:09.828619 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:09.888759 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1261/2514] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:09.896752 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976b687-03ed-41d7-93f7-28225e614681 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:09.897460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976b687-03ed-41d7-93f7-28225e614681 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:09.898823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2976b687-03ed-41d7-93f7-28225e614681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:09.922149 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2976b687-03ed-41d7-93f7-28225e614681 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:09.923460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2976b687-03ed-41d7-93f7-28225e614681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:09.939014 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1254/2515] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:09.940300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6668adf-b972-448e-8019-a295dea13aa0 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:09.959929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6668adf-b972-448e-8019-a295dea13aa0 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:09.978768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c9a76-4e31-4616-afa1-51f1493a973b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:09.980864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c9a76-4e31-4616-afa1-51f1493a973b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:09.981246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c9a76-4e31-4616-afa1-51f1493a973b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:09.982289 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c9a76-4e31-4616-afa1-51f1493a973b admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:09.983760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c9a76-4e31-4616-afa1-51f1493a973b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:14:09.984096 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c9a76-4e31-4616-afa1-51f1493a973b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:09.989557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c9a76-4e31-4616-afa1-51f1493a973b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:10.016249 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1262/2516] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:14:10.020245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976b687-03ed-41d7-93f7-28225e614681 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:10.045250 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2976b687-03ed-41d7-93f7-28225e614681 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:10.050254 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75458b0c-9c95-4b99-b759-0af8124a6b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:10.050865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75458b0c-9c95-4b99-b759-0af8124a6b2a admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:10.051303 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75458b0c-9c95-4b99-b759-0af8124a6b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:10.051567 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75458b0c-9c95-4b99-b759-0af8124a6b2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:10.052234 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75458b0c-9c95-4b99-b759-0af8124a6b2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:10.054745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75458b0c-9c95-4b99-b759-0af8124a6b2a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:10.067215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:10.199150 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1255/2517] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:14:10 2022] POST /identity/v3/projects => generated 397 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:14:10.199504 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c9a76-4e31-4616-afa1-51f1493a973b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:10.244649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c9a76-4e31-4616-afa1-51f1493a973b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:10.345411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059c1be-9307-4639-b0d8-462584c96155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:10.346071 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059c1be-9307-4639-b0d8-462584c96155 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:10.346354 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059c1be-9307-4639-b0d8-462584c96155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:10.346887 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e059c1be-9307-4639-b0d8-462584c96155 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:10.348203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059c1be-9307-4639-b0d8-462584c96155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:10.350529 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e059c1be-9307-4639-b0d8-462584c96155 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:10.492995 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1263/2518] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:14:10 2022] POST /identity/v3/users => generated 299 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:14:10.498650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75458b0c-9c95-4b99-b759-0af8124a6b2a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:10.509991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75458b0c-9c95-4b99-b759-0af8124a6b2a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:10.514582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74149f99-5d43-4f63-b995-48b63a943f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:10.515184 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74149f99-5d43-4f63-b995-48b63a943f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:10.515463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74149f99-5d43-4f63-b995-48b63a943f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:10.515776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74149f99-5d43-4f63-b995-48b63a943f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:10.516575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74149f99-5d43-4f63-b995-48b63a943f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:10.518163 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74149f99-5d43-4f63-b995-48b63a943f29 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:10.529661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1256/2519] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:10.533829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059c1be-9307-4639-b0d8-462584c96155 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:10.544136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e059c1be-9307-4639-b0d8-462584c96155 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:10.548715 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e026c270-480b-4acc-a706-5d7e3a790eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:10.549353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c270-480b-4acc-a706-5d7e3a790eaf admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:10.549632 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c270-480b-4acc-a706-5d7e3a790eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:10.549898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e026c270-480b-4acc-a706-5d7e3a790eaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:10.550584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c270-480b-4acc-a706-5d7e3a790eaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:10.552203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e026c270-480b-4acc-a706-5d7e3a790eaf admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:10.568411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1264/2520] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:10 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:10.569470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74149f99-5d43-4f63-b995-48b63a943f29 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:10.592398 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74149f99-5d43-4f63-b995-48b63a943f29 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:10.598973 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c7bf4-bebc-47aa-a404-c7ea84fcd3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:10.600205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c7bf4-bebc-47aa-a404-c7ea84fcd3d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:10.600749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c7bf4-bebc-47aa-a404-c7ea84fcd3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:10.601840 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c7bf4-bebc-47aa-a404-c7ea84fcd3d7 admin admin] PATH_INFO: `/v3/projects/bf3c62ef16284101b5dc0b5e6dde12bc/users/c1b41ed1730741478655a84d915fc2eb/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:10.630319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c7bf4-bebc-47aa-a404-c7ea84fcd3d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf3c62ef16284101b5dc0b5e6dde12bc, user_id=c1b41ed1730741478655a84d915fc2eb, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:10.636138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c7bf4-bebc-47aa-a404-c7ea84fcd3d7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:10.732842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1257/2521] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:14:10 2022] PUT /identity/v3/projects/bf3c62ef16284101b5dc0b5e6dde12bc/users/c1b41ed1730741478655a84d915fc2eb/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:14:10.742677 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718e35d-c4fb-454b-aab7-f9f3d0ddfbd8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:10.742962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718e35d-c4fb-454b-aab7-f9f3d0ddfbd8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:10.743232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8718e35d-c4fb-454b-aab7-f9f3d0ddfbd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:10.772149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8718e35d-c4fb-454b-aab7-f9f3d0ddfbd8 None None] MFA Rules not processed for user `c1b41ed1730741478655a84d915fc2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:10.776202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8718e35d-c4fb-454b-aab7-f9f3d0ddfbd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:10.858090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1265/2522] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:10 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:10.863082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c7bf4-bebc-47aa-a404-c7ea84fcd3d7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:10.936707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c7bf4-bebc-47aa-a404-c7ea84fcd3d7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:10.941697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e9234-1452-440b-955a-a27fa8247ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:10.942313 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e9234-1452-440b-955a-a27fa8247ace admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:10.942593 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e9234-1452-440b-955a-a27fa8247ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:10.942864 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4e9234-1452-440b-955a-a27fa8247ace admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:10.943503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e9234-1452-440b-955a-a27fa8247ace admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:10.945504 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4e9234-1452-440b-955a-a27fa8247ace admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:11.033177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1258/2523] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:14:10 2022] POST /identity/v3/projects => generated 401 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:14:11.037378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718e35d-c4fb-454b-aab7-f9f3d0ddfbd8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:11.049665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8718e35d-c4fb-454b-aab7-f9f3d0ddfbd8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:11.063115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:11.113150 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20597e-de4f-4d70-9371-77258a32768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:11.113767 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20597e-de4f-4d70-9371-77258a32768a admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:11.114051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20597e-de4f-4d70-9371-77258a32768a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:11.114320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20597e-de4f-4d70-9371-77258a32768a admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:11.114957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20597e-de4f-4d70-9371-77258a32768a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:11.117605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20597e-de4f-4d70-9371-77258a32768a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:11.215797 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1266/2524] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:14:11 2022] POST /identity/v3/users => generated 307 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:14:11.220746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e9234-1452-440b-955a-a27fa8247ace admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:11.231778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4e9234-1452-440b-955a-a27fa8247ace admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:11.236547 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed03a6-68bf-4fe2-9175-747230609283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:11.237163 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed03a6-68bf-4fe2-9175-747230609283 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:11.237442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed03a6-68bf-4fe2-9175-747230609283 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:11.237716 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ed03a6-68bf-4fe2-9175-747230609283 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:11.238358 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed03a6-68bf-4fe2-9175-747230609283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:11.240326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ed03a6-68bf-4fe2-9175-747230609283 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:11.251745 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1259/2525] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:14:11.255925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20597e-de4f-4d70-9371-77258a32768a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:11.267014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20597e-de4f-4d70-9371-77258a32768a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:11.271661 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1621f-714b-46a1-904e-6e841537408c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:11.272344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1621f-714b-46a1-904e-6e841537408c admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:11.272623 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1621f-714b-46a1-904e-6e841537408c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:11.273538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d1621f-714b-46a1-904e-6e841537408c admin admin] PATH_INFO: `/v3/projects/c7d35e7c45144bf7bb658e95eeb3ed1b/users/9dc04a035ae2446ab6feb622c4a6c8c9/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:11.289097 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1621f-714b-46a1-904e-6e841537408c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d35e7c45144bf7bb658e95eeb3ed1b, user_id=9dc04a035ae2446ab6feb622c4a6c8c9, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:11.291755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d1621f-714b-46a1-904e-6e841537408c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:11.362786 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1267/2526] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:14:11 2022] PUT /identity/v3/projects/c7d35e7c45144bf7bb658e95eeb3ed1b/users/9dc04a035ae2446ab6feb622c4a6c8c9/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:11.366898 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed03a6-68bf-4fe2-9175-747230609283 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:11.390519 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ed03a6-68bf-4fe2-9175-747230609283 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:11.455198 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b42afd-5338-4ca3-b67f-6e113ffe4af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:11.456532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b42afd-5338-4ca3-b67f-6e113ffe4af1 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:11.456827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b42afd-5338-4ca3-b67f-6e113ffe4af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:11.457413 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b42afd-5338-4ca3-b67f-6e113ffe4af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:11.458392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b42afd-5338-4ca3-b67f-6e113ffe4af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:11.460327 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b42afd-5338-4ca3-b67f-6e113ffe4af1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:11.472073 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1260/2527] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:11.475966 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1621f-714b-46a1-904e-6e841537408c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:11.487516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d1621f-714b-46a1-904e-6e841537408c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:11.493191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0458abf-c226-4f9c-8f20-4c636e8003cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:11.493833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0458abf-c226-4f9c-8f20-4c636e8003cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:11.494112 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0458abf-c226-4f9c-8f20-4c636e8003cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:11.494384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0458abf-c226-4f9c-8f20-4c636e8003cb admin admin] PATH_INFO: `/v3/projects/c7d35e7c45144bf7bb658e95eeb3ed1b/users/9dc04a035ae2446ab6feb622c4a6c8c9/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:11.496373 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0458abf-c226-4f9c-8f20-4c636e8003cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7d35e7c45144bf7bb658e95eeb3ed1b, user_id=9dc04a035ae2446ab6feb622c4a6c8c9, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:11.499075 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0458abf-c226-4f9c-8f20-4c636e8003cb admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:11.518421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1268/2528] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:14:11 2022] PUT /identity/v3/projects/c7d35e7c45144bf7bb658e95eeb3ed1b/users/9dc04a035ae2446ab6feb622c4a6c8c9/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:14:11.529183 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc41cd8-c6b0-4458-a841-c25265435b54 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:11.530155 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc41cd8-c6b0-4458-a841-c25265435b54 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:11.530646 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc41cd8-c6b0-4458-a841-c25265435b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:11.577210 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5cc41cd8-c6b0-4458-a841-c25265435b54 None None] MFA Rules not processed for user `9dc04a035ae2446ab6feb622c4a6c8c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:11.578448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5cc41cd8-c6b0-4458-a841-c25265435b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:11.591817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:11.700964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1261/2529] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:11 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:14:11.710060 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0458abf-c226-4f9c-8f20-4c636e8003cb admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:11.712458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d0458abf-c226-4f9c-8f20-4c636e8003cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:11.784270 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0458abf-c226-4f9c-8f20-4c636e8003cb admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:11.790425 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409b142-ef1a-4c88-8c6a-098f909c87b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:11.791539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409b142-ef1a-4c88-8c6a-098f909c87b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:11.792327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409b142-ef1a-4c88-8c6a-098f909c87b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:11.792776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409b142-ef1a-4c88-8c6a-098f909c87b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:11.803267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409b142-ef1a-4c88-8c6a-098f909c87b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:11.805379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4409b142-ef1a-4c88-8c6a-098f909c87b3 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:11.815416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1269/2530] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:11 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:12.047709 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc41cd8-c6b0-4458-a841-c25265435b54 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:12.058666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc41cd8-c6b0-4458-a841-c25265435b54 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:12.062273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6785808b-f9ec-4290-8213-9585fa8cc3ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:12.062911 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785808b-f9ec-4290-8213-9585fa8cc3ae service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:12.063188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785808b-f9ec-4290-8213-9585fa8cc3ae service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:12.063462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6785808b-f9ec-4290-8213-9585fa8cc3ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:12.137242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785808b-f9ec-4290-8213-9585fa8cc3ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:12.138700 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6785808b-f9ec-4290-8213-9585fa8cc3ae service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:12.149726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1262/2531] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:12 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:17.875913 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409b142-ef1a-4c88-8c6a-098f909c87b3 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:17.940872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409b142-ef1a-4c88-8c6a-098f909c87b3 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:17.946374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5898d-e4dc-46c3-8b58-b011ace658d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:17.947150 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5898d-e4dc-46c3-8b58-b011ace658d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:17.947431 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5898d-e4dc-46c3-8b58-b011ace658d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:17.947699 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d5898d-e4dc-46c3-8b58-b011ace658d8 admin admin] PATH_INFO: `/v3/users/c1b41ed1730741478655a84d915fc2eb` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:17.948875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5898d-e4dc-46c3-8b58-b011ace658d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1b41ed1730741478655a84d915fc2eb)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:17.950868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d5898d-e4dc-46c3-8b58-b011ace658d8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:17.964165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:18.143784 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-79d5898d-e4dc-46c3-8b58-b011ace658d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1b41ed1730741478655a84d915fc2eb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:18.157860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-79d5898d-e4dc-46c3-8b58-b011ace658d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1b41ed1730741478655a84d915fc2eb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:18.158571 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-79d5898d-e4dc-46c3-8b58-b011ace658d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1b41ed1730741478655a84d915fc2eb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:18.159223 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-79d5898d-e4dc-46c3-8b58-b011ace658d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1b41ed1730741478655a84d915fc2eb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:18.166220 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-79d5898d-e4dc-46c3-8b58-b011ace658d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1b41ed1730741478655a84d915fc2eb'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:18.220995 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1270/2532] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:14:17 2022] DELETE /identity/v3/users/c1b41ed1730741478655a84d915fc2eb => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:18.225525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231986-062a-49c5-b041-fccca47700ca None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:18.226061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231986-062a-49c5-b041-fccca47700ca None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:18.226061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13231986-062a-49c5-b041-fccca47700ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:18.245999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-13231986-062a-49c5-b041-fccca47700ca None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:18.247209 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-13231986-062a-49c5-b041-fccca47700ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:18.308128 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1263/2533] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:18.317845 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5898d-e4dc-46c3-8b58-b011ace658d8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:18.319278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-79d5898d-e4dc-46c3-8b58-b011ace658d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:18.386852 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d5898d-e4dc-46c3-8b58-b011ace658d8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:18.390653 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eaf9de-9d00-4911-b840-688e50be3d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:18.391296 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaf9de-9d00-4911-b840-688e50be3d2d service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:18.391572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaf9de-9d00-4911-b840-688e50be3d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:18.391875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eaf9de-9d00-4911-b840-688e50be3d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:18.402241 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eaf9de-9d00-4911-b840-688e50be3d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:18.403684 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eaf9de-9d00-4911-b840-688e50be3d2d service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:18.414368 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1271/2534] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:18.817532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13231986-062a-49c5-b041-fccca47700ca None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:18.820094 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-13231986-062a-49c5-b041-fccca47700ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:18.832766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13231986-062a-49c5-b041-fccca47700ca None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:18.837980 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:18.849289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:18.849289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:18.849289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] PATH_INFO: `/v3/projects/bf3c62ef16284101b5dc0b5e6dde12bc` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:18.849289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf3c62ef16284101b5dc0b5e6dde12bc)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:18.849289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:18.928948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:18.933502 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf3c62ef16284101b5dc0b5e6dde12bc', 'request_id': 'req-203ff74f-42d1-47ca-8700-154ef2916a26'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:18.939993 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf3c62ef16284101b5dc0b5e6dde12bc', 'request_id': 'req-203ff74f-42d1-47ca-8700-154ef2916a26'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:19.015584 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf3c62ef16284101b5dc0b5e6dde12bc', 'request_id': 'req-203ff74f-42d1-47ca-8700-154ef2916a26'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:19.026325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] The token cache is being invalidate because project bf3c62ef16284101b5dc0b5e6dde12bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:14:19.026603 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:19.027207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:19.028721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1264/2535] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:14:18 2022] DELETE /identity/v3/projects/bf3c62ef16284101b5dc0b5e6dde12bc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:19.032698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eaf9de-9d00-4911-b840-688e50be3d2d service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:19.042563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eaf9de-9d00-4911-b840-688e50be3d2d service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:19.100375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a653c-41af-4d46-8446-da38c5b336ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:19.101001 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a653c-41af-4d46-8446-da38c5b336ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:19.101469 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a653c-41af-4d46-8446-da38c5b336ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:19.101804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83a653c-41af-4d46-8446-da38c5b336ec admin admin] PATH_INFO: `/v3/users/9dc04a035ae2446ab6feb622c4a6c8c9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:19.103018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a653c-41af-4d46-8446-da38c5b336ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc04a035ae2446ab6feb622c4a6c8c9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:19.104944 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83a653c-41af-4d46-8446-da38c5b336ec admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:19.300034 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:19.310587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a83a653c-41af-4d46-8446-da38c5b336ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc04a035ae2446ab6feb622c4a6c8c9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:19.322747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a83a653c-41af-4d46-8446-da38c5b336ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc04a035ae2446ab6feb622c4a6c8c9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:19.323404 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a83a653c-41af-4d46-8446-da38c5b336ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc04a035ae2446ab6feb622c4a6c8c9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:19.324028 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a83a653c-41af-4d46-8446-da38c5b336ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc04a035ae2446ab6feb622c4a6c8c9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:19.330829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-a83a653c-41af-4d46-8446-da38c5b336ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc04a035ae2446ab6feb622c4a6c8c9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:19.424242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1272/2536] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:14:19 2022] DELETE /identity/v3/users/9dc04a035ae2446ab6feb622c4a6c8c9 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:19.844823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:19.846470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:19.861956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ff74f-42d1-47ca-8700-154ef2916a26 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:19.926080 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:19.926844 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:19.927229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:19.930678 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f admin admin] PATH_INFO: `/v3/projects/c7d35e7c45144bf7bb658e95eeb3ed1b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:19.932271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7d35e7c45144bf7bb658e95eeb3ed1b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:19.935735 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:20.065757 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a653c-41af-4d46-8446-da38c5b336ec admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:20.068267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a83a653c-41af-4d46-8446-da38c5b336ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:20.078262 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7d35e7c45144bf7bb658e95eeb3ed1b', 'request_id': 'req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:20.089162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7d35e7c45144bf7bb658e95eeb3ed1b', 'request_id': 'req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:20.169644 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83a653c-41af-4d46-8446-da38c5b336ec admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:20.175474 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7d35e7c45144bf7bb658e95eeb3ed1b', 'request_id': 'req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:20.188280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f admin admin] The token cache is being invalidate because project c7d35e7c45144bf7bb658e95eeb3ed1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:14:20.188790 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:20.190484 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-0e65d6d5-ce9b-4ebb-a5c2-a3af7185a04f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:20.192546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1265/2537] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:14:19 2022] DELETE /identity/v3/projects/c7d35e7c45144bf7bb658e95eeb3ed1b => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:20.197703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394c499-a773-4cf5-9caf-3f5dcfa48f21 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:20.198595 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394c499-a773-4cf5-9caf-3f5dcfa48f21 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:20.199176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394c499-a773-4cf5-9caf-3f5dcfa48f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:20.224042 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4394c499-a773-4cf5-9caf-3f5dcfa48f21 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:20.225308 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4394c499-a773-4cf5-9caf-3f5dcfa48f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:20.255509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55695d88-e916-4ffa-bc89-ed551c9121e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:20.256175 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695d88-e916-4ffa-bc89-ed551c9121e9 service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:20.256453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695d88-e916-4ffa-bc89-ed551c9121e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:20.257185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55695d88-e916-4ffa-bc89-ed551c9121e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:20.259052 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-55695d88-e916-4ffa-bc89-ed551c9121e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:20.273170 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55695d88-e916-4ffa-bc89-ed551c9121e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:20.274642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55695d88-e916-4ffa-bc89-ed551c9121e9 service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:20.287303 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1273/2538] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:20.330167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1266/2539] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:14:20.344737 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5179b10-2d8f-4abd-bd3a-28d87be54992 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:20.344936 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5179b10-2d8f-4abd-bd3a-28d87be54992 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:20.345195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5179b10-2d8f-4abd-bd3a-28d87be54992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:20.365944 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c5179b10-2d8f-4abd-bd3a-28d87be54992 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:20.367171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c5179b10-2d8f-4abd-bd3a-28d87be54992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:20.378582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1274/2540] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:20.379814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394c499-a773-4cf5-9caf-3f5dcfa48f21 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:20.388410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:20.393548 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394c499-a773-4cf5-9caf-3f5dcfa48f21 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:20.399603 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144490cd-8c6b-448c-9886-0c657fcd6f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:20.402560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144490cd-8c6b-448c-9886-0c657fcd6f37 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:20.402560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144490cd-8c6b-448c-9886-0c657fcd6f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:20.402560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144490cd-8c6b-448c-9886-0c657fcd6f37 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:20.402560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144490cd-8c6b-448c-9886-0c657fcd6f37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:14:20.402560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144490cd-8c6b-448c-9886-0c657fcd6f37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:20.404131 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144490cd-8c6b-448c-9886-0c657fcd6f37 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:20.417901 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1267/2541] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:14:20.422806 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5179b10-2d8f-4abd-bd3a-28d87be54992 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:20.434500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5179b10-2d8f-4abd-bd3a-28d87be54992 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:20.440047 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb960571-05fa-45a5-aa1e-fdd4427c6735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:20.440802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960571-05fa-45a5-aa1e-fdd4427c6735 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:20.441070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960571-05fa-45a5-aa1e-fdd4427c6735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:20.441456 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb960571-05fa-45a5-aa1e-fdd4427c6735 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:20.442425 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb960571-05fa-45a5-aa1e-fdd4427c6735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:20.444364 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb960571-05fa-45a5-aa1e-fdd4427c6735 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:20.525341 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1275/2542] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:14:20 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:14:20.530245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144490cd-8c6b-448c-9886-0c657fcd6f37 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:20.540440 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144490cd-8c6b-448c-9886-0c657fcd6f37 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:20.600027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec3c84-5b19-4dee-bc56-7b88404b666e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:20.600565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec3c84-5b19-4dee-bc56-7b88404b666e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:20.600847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec3c84-5b19-4dee-bc56-7b88404b666e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:20.601705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ec3c84-5b19-4dee-bc56-7b88404b666e admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:20.601851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec3c84-5b19-4dee-bc56-7b88404b666e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:20.603665 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ec3c84-5b19-4dee-bc56-7b88404b666e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:20.696616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1268/2543] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:14:20 2022] POST /identity/v3/users => generated 288 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:14:20.700755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb960571-05fa-45a5-aa1e-fdd4427c6735 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:20.713585 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb960571-05fa-45a5-aa1e-fdd4427c6735 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:20.718712 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dd1c9-d461-4279-8280-8bd47b848145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:20.719432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd1c9-d461-4279-8280-8bd47b848145 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:20.719776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd1c9-d461-4279-8280-8bd47b848145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:20.720152 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dd1c9-d461-4279-8280-8bd47b848145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:20.720909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dd1c9-d461-4279-8280-8bd47b848145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:20.722630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dd1c9-d461-4279-8280-8bd47b848145 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:20.724574 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:20.738854 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1276/2544] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:20.740250 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec3c84-5b19-4dee-bc56-7b88404b666e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:20.754536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ec3c84-5b19-4dee-bc56-7b88404b666e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:20.762769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0c1e3-3fda-42f7-8149-ca50fdd23e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:20.764100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c1e3-3fda-42f7-8149-ca50fdd23e99 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:20.764386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c1e3-3fda-42f7-8149-ca50fdd23e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:20.764663 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c1e3-3fda-42f7-8149-ca50fdd23e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:20.765320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0c1e3-3fda-42f7-8149-ca50fdd23e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:20.766947 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0c1e3-3fda-42f7-8149-ca50fdd23e99 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:20.778264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1269/2545] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:20.782510 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dd1c9-d461-4279-8280-8bd47b848145 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:20.793224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dd1c9-d461-4279-8280-8bd47b848145 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:20.798047 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611125f-522c-483e-a68d-2d904510eea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:20.798697 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611125f-522c-483e-a68d-2d904510eea0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:20.798971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611125f-522c-483e-a68d-2d904510eea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:20.799241 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611125f-522c-483e-a68d-2d904510eea0 admin admin] PATH_INFO: `/v3/projects/b68de03f55074c0eabe5dea371feba6e/users/22bd63c959884bb5838bafe6adc025a9/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:20.815555 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611125f-522c-483e-a68d-2d904510eea0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b68de03f55074c0eabe5dea371feba6e, user_id=22bd63c959884bb5838bafe6adc025a9, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:20.818337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c611125f-522c-483e-a68d-2d904510eea0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:20.901397 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1277/2546] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:14:20 2022] PUT /identity/v3/projects/b68de03f55074c0eabe5dea371feba6e/users/22bd63c959884bb5838bafe6adc025a9/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:20.911688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4239-b3d1-48a2-8a0b-6edb12816886 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:20.912257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4239-b3d1-48a2-8a0b-6edb12816886 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:20.912383 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd4239-b3d1-48a2-8a0b-6edb12816886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:20.942143 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5fcd4239-b3d1-48a2-8a0b-6edb12816886 None None] MFA Rules not processed for user `22bd63c959884bb5838bafe6adc025a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:20.943416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5fcd4239-b3d1-48a2-8a0b-6edb12816886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:21.012951 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1270/2547] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:21.026714 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611125f-522c-483e-a68d-2d904510eea0 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:21.028539 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c611125f-522c-483e-a68d-2d904510eea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:21.090313 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c611125f-522c-483e-a68d-2d904510eea0 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:21.094333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f2f3b1-de3d-4e8c-9f11-aa2f8ed51d40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c83e30a9fd04385b44ee3a3b72e5099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:21.095078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2f3b1-de3d-4e8c-9f11-aa2f8ed51d40 service glance] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:21.095362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2f3b1-de3d-4e8c-9f11-aa2f8ed51d40 service glance] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:21.095650 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f2f3b1-de3d-4e8c-9f11-aa2f8ed51d40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:21.104032 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2f3b1-de3d-4e8c-9f11-aa2f8ed51d40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:21.109609 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f2f3b1-de3d-4e8c-9f11-aa2f8ed51d40 service glance] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:21.114277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1278/2548] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:23.975827 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945435c8-37ce-44da-938d-434f6fdea946 None None] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:23.977265 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945435c8-37ce-44da-938d-434f6fdea946 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:23.977810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945435c8-37ce-44da-938d-434f6fdea946 None None] PATH_INFO: `/` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:23.979565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1271/2549] 10.222.0.62 () {54 vars in 921 bytes} [Wed Aug 24 08:14:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 08:14:23.985200 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f908b-7e0b-4585-934b-eb83a48fcf86 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:23.985789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f908b-7e0b-4585-934b-eb83a48fcf86 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:23.985789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f908b-7e0b-4585-934b-eb83a48fcf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:24.006843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-984f908b-7e0b-4585-934b-eb83a48fcf86 None None] MFA Rules not processed for user `9b99cff7a5f549adadee002f8ab1f5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:24.008459 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-984f908b-7e0b-4585-934b-eb83a48fcf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:24.087891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1279/2550] 10.222.0.62 () {58 vars in 1018 bytes} [Wed Aug 24 08:14:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:24.098898 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945435c8-37ce-44da-938d-434f6fdea946 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:24.111656 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945435c8-37ce-44da-938d-434f6fdea946 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:24.115302 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d76dc7-7eed-48b8-befa-8da3b45d1d23 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c83e30a9fd04385b44ee3a3b72e5099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:24.115960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d76dc7-7eed-48b8-befa-8da3b45d1d23 service glance] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:24.116269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d76dc7-7eed-48b8-befa-8da3b45d1d23 service glance] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:24.116541 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d76dc7-7eed-48b8-befa-8da3b45d1d23 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:24.127672 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d76dc7-7eed-48b8-befa-8da3b45d1d23 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:24.129142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d76dc7-7eed-48b8-befa-8da3b45d1d23 service glance] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:24.139905 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1272/2551] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:27.090682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5805f-5c43-415e-b5fe-6a6c5b16edb5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:27.091230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5805f-5c43-415e-b5fe-6a6c5b16edb5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:27.091230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a5805f-5c43-415e-b5fe-6a6c5b16edb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:27.110895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-47a5805f-5c43-415e-b5fe-6a6c5b16edb5 None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:27.112128 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-47a5805f-5c43-415e-b5fe-6a6c5b16edb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:27.169452 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1280/2552] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:14:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:27.181230 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d76dc7-7eed-48b8-befa-8da3b45d1d23 service glance] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:27.183670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-23d76dc7-7eed-48b8-befa-8da3b45d1d23 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:27.232580 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:27.259132 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d76dc7-7eed-48b8-befa-8da3b45d1d23 service glance] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:27.266787 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58afb021-2799-498a-9763-cc62302115e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:27.267693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb021-2799-498a-9763-cc62302115e6 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:27.268013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb021-2799-498a-9763-cc62302115e6 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:27.272809 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58afb021-2799-498a-9763-cc62302115e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:27.284640 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afb021-2799-498a-9763-cc62302115e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:27.286208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58afb021-2799-498a-9763-cc62302115e6 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:27.297897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1273/2553] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:14:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:14:37.162010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:37.329298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=12 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:39.715093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5805f-5c43-415e-b5fe-6a6c5b16edb5 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:39.781019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a5805f-5c43-415e-b5fe-6a6c5b16edb5 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:39.785931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2b87a-fbfc-4958-9afc-ead16b72ea9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:39.786589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2b87a-fbfc-4958-9afc-ead16b72ea9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:39.786863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2b87a-fbfc-4958-9afc-ead16b72ea9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:39.787130 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d2b87a-fbfc-4958-9afc-ead16b72ea9b admin admin] PATH_INFO: `/v3/users/22bd63c959884bb5838bafe6adc025a9` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:39.788429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2b87a-fbfc-4958-9afc-ead16b72ea9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=22bd63c959884bb5838bafe6adc025a9)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:39.790455 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d2b87a-fbfc-4958-9afc-ead16b72ea9b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:40.013381 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e5d2b87a-fbfc-4958-9afc-ead16b72ea9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22bd63c959884bb5838bafe6adc025a9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:40.031894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e5d2b87a-fbfc-4958-9afc-ead16b72ea9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22bd63c959884bb5838bafe6adc025a9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:40.032646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e5d2b87a-fbfc-4958-9afc-ead16b72ea9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22bd63c959884bb5838bafe6adc025a9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:40.033550 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e5d2b87a-fbfc-4958-9afc-ead16b72ea9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22bd63c959884bb5838bafe6adc025a9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:40.045187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-e5d2b87a-fbfc-4958-9afc-ead16b72ea9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22bd63c959884bb5838bafe6adc025a9'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:40.128124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1281/2554] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:14:39 2022] DELETE /identity/v3/users/22bd63c959884bb5838bafe6adc025a9 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:40.133331 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3111e-6024-4810-81bb-693947e9a09b None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:40.133864 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3111e-6024-4810-81bb-693947e9a09b None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:40.134093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3111e-6024-4810-81bb-693947e9a09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:40.153907 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6df3111e-6024-4810-81bb-693947e9a09b None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:40.155156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6df3111e-6024-4810-81bb-693947e9a09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:40.217493 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1274/2555] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:14:40.227500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2b87a-fbfc-4958-9afc-ead16b72ea9b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:40.229086 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e5d2b87a-fbfc-4958-9afc-ead16b72ea9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:40.291153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d2b87a-fbfc-4958-9afc-ead16b72ea9b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:40.295543 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e5095-f821-4bcc-aa82-18d9b7298882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:40.296195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e5095-f821-4bcc-aa82-18d9b7298882 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:40.296476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e5095-f821-4bcc-aa82-18d9b7298882 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:40.296748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e5095-f821-4bcc-aa82-18d9b7298882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:40.307119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e5095-f821-4bcc-aa82-18d9b7298882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:40.309241 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e5095-f821-4bcc-aa82-18d9b7298882 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:40.320061 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1282/2556] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:40.841736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3111e-6024-4810-81bb-693947e9a09b None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:40.843379 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6df3111e-6024-4810-81bb-693947e9a09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:40.856546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df3111e-6024-4810-81bb-693947e9a09b None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:40.861714 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26090083-ea8c-4421-8f72-f42242aa85d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:40.862423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26090083-ea8c-4421-8f72-f42242aa85d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:40.862803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26090083-ea8c-4421-8f72-f42242aa85d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:40.862989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26090083-ea8c-4421-8f72-f42242aa85d2 admin admin] PATH_INFO: `/v3/projects/b68de03f55074c0eabe5dea371feba6e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:40.864202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26090083-ea8c-4421-8f72-f42242aa85d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b68de03f55074c0eabe5dea371feba6e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:40.866358 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26090083-ea8c-4421-8f72-f42242aa85d2 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:41.005595 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26090083-ea8c-4421-8f72-f42242aa85d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b68de03f55074c0eabe5dea371feba6e', 'request_id': 'req-26090083-ea8c-4421-8f72-f42242aa85d2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:41.012895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26090083-ea8c-4421-8f72-f42242aa85d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b68de03f55074c0eabe5dea371feba6e', 'request_id': 'req-26090083-ea8c-4421-8f72-f42242aa85d2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:41.124181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26090083-ea8c-4421-8f72-f42242aa85d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b68de03f55074c0eabe5dea371feba6e', 'request_id': 'req-26090083-ea8c-4421-8f72-f42242aa85d2'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:41.138337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26090083-ea8c-4421-8f72-f42242aa85d2 admin admin] The token cache is being invalidate because project b68de03f55074c0eabe5dea371feba6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:14:41.139400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26090083-ea8c-4421-8f72-f42242aa85d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:41.140355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-26090083-ea8c-4421-8f72-f42242aa85d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:41.142137 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1275/2557] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:14:40 2022] DELETE /identity/v3/projects/b68de03f55074c0eabe5dea371feba6e => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:41.148101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4bc21-a8a6-4c55-829e-0f424a473c13 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:41.148632 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4bc21-a8a6-4c55-829e-0f424a473c13 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:41.149052 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d4bc21-a8a6-4c55-829e-0f424a473c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:41.181464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-83d4bc21-a8a6-4c55-829e-0f424a473c13 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:41.184303 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-83d4bc21-a8a6-4c55-829e-0f424a473c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:41.202246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:41.248386 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1283/2558] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:41.256580 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab05b3-0c2f-4a9b-a5b9-e2e37b99d5f3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:41.256938 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab05b3-0c2f-4a9b-a5b9-e2e37b99d5f3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:41.257280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbab05b3-0c2f-4a9b-a5b9-e2e37b99d5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:41.280893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bbab05b3-0c2f-4a9b-a5b9-e2e37b99d5f3 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:41.282926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bbab05b3-0c2f-4a9b-a5b9-e2e37b99d5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:41.296896 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1276/2559] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:41.301186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4bc21-a8a6-4c55-829e-0f424a473c13 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:41.312399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d4bc21-a8a6-4c55-829e-0f424a473c13 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:41.317075 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73199290-62cd-4531-8b67-db393f28eea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:41.317680 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73199290-62cd-4531-8b67-db393f28eea6 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:41.317956 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73199290-62cd-4531-8b67-db393f28eea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:41.318222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73199290-62cd-4531-8b67-db393f28eea6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:41.318863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73199290-62cd-4531-8b67-db393f28eea6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:14:41.319162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73199290-62cd-4531-8b67-db393f28eea6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:41.320771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73199290-62cd-4531-8b67-db393f28eea6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:41.332679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1284/2560] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:14:41.336683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab05b3-0c2f-4a9b-a5b9-e2e37b99d5f3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:41.346438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbab05b3-0c2f-4a9b-a5b9-e2e37b99d5f3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:41.351112 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13c92c-b2fa-4d6a-882f-3b8eb1caa93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:41.351703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c92c-b2fa-4d6a-882f-3b8eb1caa93c admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:41.352021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c92c-b2fa-4d6a-882f-3b8eb1caa93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:41.352296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f13c92c-b2fa-4d6a-882f-3b8eb1caa93c admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:41.352925 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13c92c-b2fa-4d6a-882f-3b8eb1caa93c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:41.355443 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f13c92c-b2fa-4d6a-882f-3b8eb1caa93c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:41.440398 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1277/2561] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:14:41 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:14:41.443868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73199290-62cd-4531-8b67-db393f28eea6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:41.454187 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73199290-62cd-4531-8b67-db393f28eea6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:41.518863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cb4b9-b0a7-4dd4-b061-e5ae15bdb3b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:41.519488 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb4b9-b0a7-4dd4-b061-e5ae15bdb3b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:41.519767 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb4b9-b0a7-4dd4-b061-e5ae15bdb3b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:41.520071 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8cb4b9-b0a7-4dd4-b061-e5ae15bdb3b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:41.520704 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cb4b9-b0a7-4dd4-b061-e5ae15bdb3b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:41.522620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8cb4b9-b0a7-4dd4-b061-e5ae15bdb3b6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:41.631143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1285/2562] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:14:41 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:14:41.635215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13c92c-b2fa-4d6a-882f-3b8eb1caa93c admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:41.645932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f13c92c-b2fa-4d6a-882f-3b8eb1caa93c admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:41.650637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a39b16-8201-448c-9ec5-ce7d505e795d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:41.651314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a39b16-8201-448c-9ec5-ce7d505e795d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:41.652361 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a39b16-8201-448c-9ec5-ce7d505e795d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:41.652648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a39b16-8201-448c-9ec5-ce7d505e795d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:41.653292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a39b16-8201-448c-9ec5-ce7d505e795d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:41.654941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a39b16-8201-448c-9ec5-ce7d505e795d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:41.665514 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1278/2563] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:41.670076 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cb4b9-b0a7-4dd4-b061-e5ae15bdb3b6 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:41.680321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8cb4b9-b0a7-4dd4-b061-e5ae15bdb3b6 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:41.685435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ace923-bbc6-4845-887b-615dccd34a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:41.686027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace923-bbc6-4845-887b-615dccd34a33 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:41.686305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace923-bbc6-4845-887b-615dccd34a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:41.686575 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ace923-bbc6-4845-887b-615dccd34a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:41.687206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ace923-bbc6-4845-887b-615dccd34a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:41.688811 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ace923-bbc6-4845-887b-615dccd34a33 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:41.699761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1286/2564] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:41.703707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a39b16-8201-448c-9ec5-ce7d505e795d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:41.713546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a39b16-8201-448c-9ec5-ce7d505e795d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:41.718677 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a5f62-170d-4580-b47a-0565e423bce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:41.719312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a5f62-170d-4580-b47a-0565e423bce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:41.719591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a5f62-170d-4580-b47a-0565e423bce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:41.719881 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3a5f62-170d-4580-b47a-0565e423bce7 admin admin] PATH_INFO: `/v3/projects/9becfc524fa34152af5ed84e105acd76/users/af30f601d5994cee99bf7301ac30f3d2/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:41.734029 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a5f62-170d-4580-b47a-0565e423bce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9becfc524fa34152af5ed84e105acd76, user_id=af30f601d5994cee99bf7301ac30f3d2, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:41.736725 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3a5f62-170d-4580-b47a-0565e423bce7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:41.807793 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1279/2565] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:14:41 2022] PUT /identity/v3/projects/9becfc524fa34152af5ed84e105acd76/users/af30f601d5994cee99bf7301ac30f3d2/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:41.821974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da204459-3f79-437d-864f-fa1a7da848d8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:41.822259 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da204459-3f79-437d-864f-fa1a7da848d8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:41.822581 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da204459-3f79-437d-864f-fa1a7da848d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:41.854062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-da204459-3f79-437d-864f-fa1a7da848d8 None None] MFA Rules not processed for user `af30f601d5994cee99bf7301ac30f3d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:41.855954 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-da204459-3f79-437d-864f-fa1a7da848d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:41.942080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1287/2566] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:41.954740 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a5f62-170d-4580-b47a-0565e423bce7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:41.958817 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ee3a5f62-170d-4580-b47a-0565e423bce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:42.000463 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:42.055174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3a5f62-170d-4580-b47a-0565e423bce7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:42.064377 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17047af2-c9a3-40b4-a97f-148f9be11d4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:42.064849 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17047af2-c9a3-40b4-a97f-148f9be11d4c service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:42.065283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17047af2-c9a3-40b4-a97f-148f9be11d4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:42.065712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17047af2-c9a3-40b4-a97f-148f9be11d4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:42.079405 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17047af2-c9a3-40b4-a97f-148f9be11d4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:42.081414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17047af2-c9a3-40b4-a97f-148f9be11d4c service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:42.093774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1280/2567] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:44.647366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da204459-3f79-437d-864f-fa1a7da848d8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:44.655461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-da204459-3f79-437d-864f-fa1a7da848d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:44.677836 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:44.730932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da204459-3f79-437d-864f-fa1a7da848d8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:44.737156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6aad4d-55f8-4b62-bf56-04306bec5d59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:44.737941 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aad4d-55f8-4b62-bf56-04306bec5d59 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:44.738278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aad4d-55f8-4b62-bf56-04306bec5d59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:44.738554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aad4d-55f8-4b62-bf56-04306bec5d59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:44.741057 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6c6aad4d-55f8-4b62-bf56-04306bec5d59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:44.833230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6aad4d-55f8-4b62-bf56-04306bec5d59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:44.836148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6aad4d-55f8-4b62-bf56-04306bec5d59 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:44.860907 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1288/2568] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:46.100788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d865252-ffe0-4595-8e41-a37bda3c2f16 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:46.101920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d865252-ffe0-4595-8e41-a37bda3c2f16 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:46.102535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d865252-ffe0-4595-8e41-a37bda3c2f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:46.125759 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1d865252-ffe0-4595-8e41-a37bda3c2f16 None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:46.127082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1d865252-ffe0-4595-8e41-a37bda3c2f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:46.189859 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1281/2569] 10.222.0.62 () {58 vars in 967 bytes} [Wed Aug 24 08:14:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:46.216933 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6aad4d-55f8-4b62-bf56-04306bec5d59 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:46.220119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6c6aad4d-55f8-4b62-bf56-04306bec5d59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:46.309956 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6aad4d-55f8-4b62-bf56-04306bec5d59 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:46.315250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a70726-8ffd-485e-b3f3-332fdfa8de06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:46.318369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a70726-8ffd-485e-b3f3-332fdfa8de06 service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:46.318369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a70726-8ffd-485e-b3f3-332fdfa8de06 service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:46.318369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a70726-8ffd-485e-b3f3-332fdfa8de06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:46.325992 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a70726-8ffd-485e-b3f3-332fdfa8de06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:46.327621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a70726-8ffd-485e-b3f3-332fdfa8de06 service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:46.336623 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1289/2570] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:14:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 08:14:47.562579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d865252-ffe0-4595-8e41-a37bda3c2f16 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:47.564317 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1d865252-ffe0-4595-8e41-a37bda3c2f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:47.658144 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d865252-ffe0-4595-8e41-a37bda3c2f16 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:47.664006 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d84384-4d1b-486d-b615-bf85714c6814 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:47.664643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d84384-4d1b-486d-b615-bf85714c6814 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:47.664922 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d84384-4d1b-486d-b615-bf85714c6814 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:47.665194 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d84384-4d1b-486d-b615-bf85714c6814 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:47.668099 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d8d84384-4d1b-486d-b615-bf85714c6814 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:47.686937 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d84384-4d1b-486d-b615-bf85714c6814 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:47.688563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d84384-4d1b-486d-b615-bf85714c6814 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:47.715000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1282/2571] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:50.502746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a70726-8ffd-485e-b3f3-332fdfa8de06 service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:50.566620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:50.571605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a70726-8ffd-485e-b3f3-332fdfa8de06 service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:50.576362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23ae98-fa15-4eae-8d4c-164c1b3398d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:50.576997 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23ae98-fa15-4eae-8d4c-164c1b3398d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:50.577279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23ae98-fa15-4eae-8d4c-164c1b3398d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:50.577538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f23ae98-fa15-4eae-8d4c-164c1b3398d7 admin admin] PATH_INFO: `/v3/users/af30f601d5994cee99bf7301ac30f3d2` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:50.578689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23ae98-fa15-4eae-8d4c-164c1b3398d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af30f601d5994cee99bf7301ac30f3d2)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:50.580640 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f23ae98-fa15-4eae-8d4c-164c1b3398d7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:50.779074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0f23ae98-fa15-4eae-8d4c-164c1b3398d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af30f601d5994cee99bf7301ac30f3d2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:50.792330 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0f23ae98-fa15-4eae-8d4c-164c1b3398d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af30f601d5994cee99bf7301ac30f3d2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:50.793199 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0f23ae98-fa15-4eae-8d4c-164c1b3398d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af30f601d5994cee99bf7301ac30f3d2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:50.793808 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0f23ae98-fa15-4eae-8d4c-164c1b3398d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af30f601d5994cee99bf7301ac30f3d2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:50.801136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0f23ae98-fa15-4eae-8d4c-164c1b3398d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af30f601d5994cee99bf7301ac30f3d2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:50.873325 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1290/2572] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:14:50 2022] DELETE /identity/v3/users/af30f601d5994cee99bf7301ac30f3d2 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:50.877971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb1594-c666-43b5-a8b8-ed59f0eb638e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:50.878460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb1594-c666-43b5-a8b8-ed59f0eb638e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:50.878658 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb1594-c666-43b5-a8b8-ed59f0eb638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:50.901639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-b9fb1594-c666-43b5-a8b8-ed59f0eb638e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:50.901639 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b9fb1594-c666-43b5-a8b8-ed59f0eb638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:50.952679 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:50.976647 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1283/2573] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:50.994702 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23ae98-fa15-4eae-8d4c-164c1b3398d7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:50.997048 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0f23ae98-fa15-4eae-8d4c-164c1b3398d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:51.058563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f23ae98-fa15-4eae-8d4c-164c1b3398d7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:51.063333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e13fe3e-751a-4933-84d4-35cf5d8e20e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:51.064161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13fe3e-751a-4933-84d4-35cf5d8e20e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:51.064542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13fe3e-751a-4933-84d4-35cf5d8e20e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:51.064916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13fe3e-751a-4933-84d4-35cf5d8e20e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:51.074993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13fe3e-751a-4933-84d4-35cf5d8e20e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:51.076462 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e13fe3e-751a-4933-84d4-35cf5d8e20e3 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:51.086779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1291/2574] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:51.879562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb1594-c666-43b5-a8b8-ed59f0eb638e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:51.881951 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b9fb1594-c666-43b5-a8b8-ed59f0eb638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:51.899316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb1594-c666-43b5-a8b8-ed59f0eb638e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:51.906106 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:51.907082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:51.907569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:51.908077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a admin admin] PATH_INFO: `/v3/projects/9becfc524fa34152af5ed84e105acd76` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:51.909491 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9becfc524fa34152af5ed84e105acd76)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:51.912371 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:52.056687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9becfc524fa34152af5ed84e105acd76', 'request_id': 'req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:52.063557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9becfc524fa34152af5ed84e105acd76', 'request_id': 'req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:52.139431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9becfc524fa34152af5ed84e105acd76', 'request_id': 'req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:52.151350 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a admin admin] The token cache is being invalidate because project 9becfc524fa34152af5ed84e105acd76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:14:52.152258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:52.153218 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-351dd33a-6b79-4b5f-911b-b117c8cb2b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:14:52.158467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1284/2575] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:14:51 2022] DELETE /identity/v3/projects/9becfc524fa34152af5ed84e105acd76 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:52.160222 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62738c-316d-4ab3-bc83-f575f24af1db None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:52.160693 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62738c-316d-4ab3-bc83-f575f24af1db None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:52.166260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c62738c-316d-4ab3-bc83-f575f24af1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:52.181721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7c62738c-316d-4ab3-bc83-f575f24af1db None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:52.183479 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7c62738c-316d-4ab3-bc83-f575f24af1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:52.259998 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1292/2576] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:14:52.265959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea8851-571d-4845-b53b-731458742f83 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:52.266235 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea8851-571d-4845-b53b-731458742f83 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:52.266946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea8851-571d-4845-b53b-731458742f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:52.288617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-10ea8851-571d-4845-b53b-731458742f83 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:52.290108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-10ea8851-571d-4845-b53b-731458742f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:52.299525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1285/2577] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:52.303449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62738c-316d-4ab3-bc83-f575f24af1db None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:52.314232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c62738c-316d-4ab3-bc83-f575f24af1db None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:52.321745 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb62b90-91fd-4a14-a1f4-14adab7a9a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:52.322696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb62b90-91fd-4a14-a1f4-14adab7a9a11 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:52.323051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb62b90-91fd-4a14-a1f4-14adab7a9a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:52.323965 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb62b90-91fd-4a14-a1f4-14adab7a9a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:52.325652 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb62b90-91fd-4a14-a1f4-14adab7a9a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:14:52.326169 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb62b90-91fd-4a14-a1f4-14adab7a9a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:52.327658 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb62b90-91fd-4a14-a1f4-14adab7a9a11 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:52.347926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1293/2578] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:14:52.350630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea8851-571d-4845-b53b-731458742f83 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:52.361669 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea8851-571d-4845-b53b-731458742f83 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:52.367467 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60959198-94ea-4352-8bea-b96491a72c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:52.368438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60959198-94ea-4352-8bea-b96491a72c1f admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:52.368722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60959198-94ea-4352-8bea-b96491a72c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:52.368995 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60959198-94ea-4352-8bea-b96491a72c1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:52.369660 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60959198-94ea-4352-8bea-b96491a72c1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:52.372233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60959198-94ea-4352-8bea-b96491a72c1f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:52.494682 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1286/2579] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:14:52 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:14:52.499273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb62b90-91fd-4a14-a1f4-14adab7a9a11 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:52.516118 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb62b90-91fd-4a14-a1f4-14adab7a9a11 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:52.530888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:52.611246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caaf591-f499-4254-b220-ba12d6b15994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:52.611889 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaf591-f499-4254-b220-ba12d6b15994 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:52.612174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaf591-f499-4254-b220-ba12d6b15994 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:52.612679 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caaf591-f499-4254-b220-ba12d6b15994 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:52.613332 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caaf591-f499-4254-b220-ba12d6b15994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:52.615286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caaf591-f499-4254-b220-ba12d6b15994 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:52.698444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1294/2580] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:14:52 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:14:52.700388 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60959198-94ea-4352-8bea-b96491a72c1f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:52.710836 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60959198-94ea-4352-8bea-b96491a72c1f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:52.716705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cede4-288e-4f45-8523-2615bf4ca6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:52.717326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cede4-288e-4f45-8523-2615bf4ca6cb admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:52.717602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cede4-288e-4f45-8523-2615bf4ca6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:52.717872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04cede4-288e-4f45-8523-2615bf4ca6cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:52.718511 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cede4-288e-4f45-8523-2615bf4ca6cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:52.720177 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04cede4-288e-4f45-8523-2615bf4ca6cb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:52.731676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1287/2581] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:52.735664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caaf591-f499-4254-b220-ba12d6b15994 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:52.746427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caaf591-f499-4254-b220-ba12d6b15994 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:52.757820 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5056f-a134-4010-9cf8-021ed083d7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:52.757820 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5056f-a134-4010-9cf8-021ed083d7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:52.757820 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5056f-a134-4010-9cf8-021ed083d7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:52.757820 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5056f-a134-4010-9cf8-021ed083d7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:52.758402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5056f-a134-4010-9cf8-021ed083d7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:52.758402 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5056f-a134-4010-9cf8-021ed083d7b9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:52.768605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1295/2582] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:52.772612 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cede4-288e-4f45-8523-2615bf4ca6cb admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:52.783640 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04cede4-288e-4f45-8523-2615bf4ca6cb admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:52.789493 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f8f7a-288e-432c-b1b5-fac6e0e0346e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:52.790167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f8f7a-288e-432c-b1b5-fac6e0e0346e admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:52.790450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f8f7a-288e-432c-b1b5-fac6e0e0346e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:52.790724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0f8f7a-288e-432c-b1b5-fac6e0e0346e admin admin] PATH_INFO: `/v3/projects/50e508e1f5204134a6c1922c1c33dbcd/users/42ee1a03c5c54f5cad752d0ad0b1024a/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:52.807778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f8f7a-288e-432c-b1b5-fac6e0e0346e admin admin] RBAC: Authorizing `identity:create_grant(project_id=50e508e1f5204134a6c1922c1c33dbcd, user_id=42ee1a03c5c54f5cad752d0ad0b1024a, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:52.810890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0f8f7a-288e-432c-b1b5-fac6e0e0346e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:52.873370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1288/2583] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:14:52 2022] PUT /identity/v3/projects/50e508e1f5204134a6c1922c1c33dbcd/users/42ee1a03c5c54f5cad752d0ad0b1024a/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:52.944221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025e843-5b75-47c7-a50a-b28410f497bf None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:52.944621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025e843-5b75-47c7-a50a-b28410f497bf None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:52.944931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025e843-5b75-47c7-a50a-b28410f497bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:52.983102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a025e843-5b75-47c7-a50a-b28410f497bf None None] MFA Rules not processed for user `42ee1a03c5c54f5cad752d0ad0b1024a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:52.984360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a025e843-5b75-47c7-a50a-b28410f497bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:53.052701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1296/2584] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:53.057688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f8f7a-288e-432c-b1b5-fac6e0e0346e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:53.127293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0f8f7a-288e-432c-b1b5-fac6e0e0346e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:53.132338 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6a42c-b833-42b3-8705-bf75c3537fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:53.132967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a42c-b833-42b3-8705-bf75c3537fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:53.133252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a42c-b833-42b3-8705-bf75c3537fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:53.140675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e6a42c-b833-42b3-8705-bf75c3537fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:53.140675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6a42c-b833-42b3-8705-bf75c3537fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:53.140675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e6a42c-b833-42b3-8705-bf75c3537fe0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:53.233087 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:53.240505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1289/2585] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:14:53 2022] POST /identity/v3/projects => generated 383 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:14:53.244770 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025e843-5b75-47c7-a50a-b28410f497bf None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:53.256019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025e843-5b75-47c7-a50a-b28410f497bf None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:53.315446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961df349-32e0-4568-86bc-a354b1438e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:53.316083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961df349-32e0-4568-86bc-a354b1438e7a admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:53.316367 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961df349-32e0-4568-86bc-a354b1438e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:53.316639 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961df349-32e0-4568-86bc-a354b1438e7a admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:53.317317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961df349-32e0-4568-86bc-a354b1438e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:53.319239 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961df349-32e0-4568-86bc-a354b1438e7a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:53.421314 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1297/2586] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:14:53 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:14:53.425308 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6a42c-b833-42b3-8705-bf75c3537fe0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:53.437224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e6a42c-b833-42b3-8705-bf75c3537fe0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:53.442023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802995fb-f033-485d-ac01-00203f6d7fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:53.442636 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802995fb-f033-485d-ac01-00203f6d7fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:53.442914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802995fb-f033-485d-ac01-00203f6d7fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:53.443186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802995fb-f033-485d-ac01-00203f6d7fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:53.443956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802995fb-f033-485d-ac01-00203f6d7fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:53.445488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802995fb-f033-485d-ac01-00203f6d7fa4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:53.457481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1290/2587] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:53.461752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961df349-32e0-4568-86bc-a354b1438e7a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:53.468131 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:53.472099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961df349-32e0-4568-86bc-a354b1438e7a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:53.477127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0776be-e4d7-4aa2-8251-02488a5f5444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:53.477727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0776be-e4d7-4aa2-8251-02488a5f5444 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:53.478030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0776be-e4d7-4aa2-8251-02488a5f5444 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:53.478300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0776be-e4d7-4aa2-8251-02488a5f5444 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:53.478934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0776be-e4d7-4aa2-8251-02488a5f5444 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:53.480794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0776be-e4d7-4aa2-8251-02488a5f5444 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:53.491020 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1298/2588] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:53.495837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802995fb-f033-485d-ac01-00203f6d7fa4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:53.505884 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802995fb-f033-485d-ac01-00203f6d7fa4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:53.510494 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cc154-fc34-4b78-b7df-5acc1ee646cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:53.511767 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc154-fc34-4b78-b7df-5acc1ee646cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:53.512267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc154-fc34-4b78-b7df-5acc1ee646cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:53.512547 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc154-fc34-4b78-b7df-5acc1ee646cf admin admin] PATH_INFO: `/v3/projects/73d7ffb57ccf458d9af46bb5c3020d9d/users/45bf6a2d9b924414b7fac3efa1e7882d/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:53.527975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cc154-fc34-4b78-b7df-5acc1ee646cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=73d7ffb57ccf458d9af46bb5c3020d9d, user_id=45bf6a2d9b924414b7fac3efa1e7882d, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:53.530623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cc154-fc34-4b78-b7df-5acc1ee646cf admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:53.622130 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1291/2589] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:14:53 2022] PUT /identity/v3/projects/73d7ffb57ccf458d9af46bb5c3020d9d/users/45bf6a2d9b924414b7fac3efa1e7882d/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:53.632102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16c85e-cdb4-4d46-8723-cbe2c9107925 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:53.632392 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16c85e-cdb4-4d46-8723-cbe2c9107925 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:53.632667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16c85e-cdb4-4d46-8723-cbe2c9107925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:53.662495 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-1d16c85e-cdb4-4d46-8723-cbe2c9107925 None None] MFA Rules not processed for user `45bf6a2d9b924414b7fac3efa1e7882d`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:53.663723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1d16c85e-cdb4-4d46-8723-cbe2c9107925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:53.735722 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1299/2590] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:53.740231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cc154-fc34-4b78-b7df-5acc1ee646cf admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:53.807446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cc154-fc34-4b78-b7df-5acc1ee646cf admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:53.813004 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1db36f-1e4b-45f7-ba4c-b9e2d660dbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:53.813616 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1db36f-1e4b-45f7-ba4c-b9e2d660dbd9 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:53.813892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1db36f-1e4b-45f7-ba4c-b9e2d660dbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:53.814163 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1db36f-1e4b-45f7-ba4c-b9e2d660dbd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:53.814787 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1db36f-1e4b-45f7-ba4c-b9e2d660dbd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:53.816712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1db36f-1e4b-45f7-ba4c-b9e2d660dbd9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:53.898887 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1292/2591] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:14:53 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:14:53.900122 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16c85e-cdb4-4d46-8723-cbe2c9107925 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:53.913498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16c85e-cdb4-4d46-8723-cbe2c9107925 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:53.972526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9e117-ea38-4230-a7c8-05e53b73a403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:53.973130 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9e117-ea38-4230-a7c8-05e53b73a403 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:53.973407 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9e117-ea38-4230-a7c8-05e53b73a403 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:53.973671 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9e117-ea38-4230-a7c8-05e53b73a403 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:53.974336 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9e117-ea38-4230-a7c8-05e53b73a403 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:53.976340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9e117-ea38-4230-a7c8-05e53b73a403 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:54.038580 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1300/2592] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:14:53 2022] POST /identity/v3/users => generated 299 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:14:54.043903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1db36f-1e4b-45f7-ba4c-b9e2d660dbd9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:54.056098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1db36f-1e4b-45f7-ba4c-b9e2d660dbd9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:54.062157 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d574c-98a4-4d7c-a1a6-f63d746327cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:54.062764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d574c-98a4-4d7c-a1a6-f63d746327cb admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:54.063041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d574c-98a4-4d7c-a1a6-f63d746327cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:54.063313 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8d574c-98a4-4d7c-a1a6-f63d746327cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:54.063992 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d574c-98a4-4d7c-a1a6-f63d746327cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:54.065627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8d574c-98a4-4d7c-a1a6-f63d746327cb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:54.077238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1293/2593] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:54.081897 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9e117-ea38-4230-a7c8-05e53b73a403 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:54.092674 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9e117-ea38-4230-a7c8-05e53b73a403 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:54.097572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2bc58-7f62-44f1-9e9f-efb9893108d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:54.098210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2bc58-7f62-44f1-9e9f-efb9893108d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:54.098486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2bc58-7f62-44f1-9e9f-efb9893108d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:54.098785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd2bc58-7f62-44f1-9e9f-efb9893108d8 admin admin] PATH_INFO: `/v3/projects/58932aa9ecc445bf9c642553f5a2ab05/users/1901b48b352c47df96dc1f0f632d02d5/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:54.114298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2bc58-7f62-44f1-9e9f-efb9893108d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58932aa9ecc445bf9c642553f5a2ab05, user_id=1901b48b352c47df96dc1f0f632d02d5, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:54.117126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd2bc58-7f62-44f1-9e9f-efb9893108d8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:54.188260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1301/2594] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:14:54 2022] PUT /identity/v3/projects/58932aa9ecc445bf9c642553f5a2ab05/users/1901b48b352c47df96dc1f0f632d02d5/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:54.192267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d574c-98a4-4d7c-a1a6-f63d746327cb admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:54.204383 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8d574c-98a4-4d7c-a1a6-f63d746327cb admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:54.265176 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdd466-541f-4681-a659-f0529d526a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:54.265791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdd466-541f-4681-a659-f0529d526a96 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:54.266073 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdd466-541f-4681-a659-f0529d526a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:54.266346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdd466-541f-4681-a659-f0529d526a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:54.266989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdd466-541f-4681-a659-f0529d526a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:54.268726 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdd466-541f-4681-a659-f0529d526a96 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:54.283263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1294/2595] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:14:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:14:54.284559 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2bc58-7f62-44f1-9e9f-efb9893108d8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:54.296082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd2bc58-7f62-44f1-9e9f-efb9893108d8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:54.302443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e0e00-f639-4126-b6b7-847c86fcdf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:54.303105 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e0e00-f639-4126-b6b7-847c86fcdf9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:54.303381 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e0e00-f639-4126-b6b7-847c86fcdf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:54.303655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e0e00-f639-4126-b6b7-847c86fcdf9c admin admin] PATH_INFO: `/v3/projects/58932aa9ecc445bf9c642553f5a2ab05/users/1901b48b352c47df96dc1f0f632d02d5/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:54.305614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e0e00-f639-4126-b6b7-847c86fcdf9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=58932aa9ecc445bf9c642553f5a2ab05, user_id=1901b48b352c47df96dc1f0f632d02d5, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:54.308734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e0e00-f639-4126-b6b7-847c86fcdf9c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:54.319612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1302/2596] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:14:54 2022] PUT /identity/v3/projects/58932aa9ecc445bf9c642553f5a2ab05/users/1901b48b352c47df96dc1f0f632d02d5/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:14:54.329966 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe109-f781-40aa-8aa6-81531509be88 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:54.330247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe109-f781-40aa-8aa6-81531509be88 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:54.331104 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584fe109-f781-40aa-8aa6-81531509be88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:54.360957 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-584fe109-f781-40aa-8aa6-81531509be88 None None] MFA Rules not processed for user `1901b48b352c47df96dc1f0f632d02d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:14:54.362182 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-584fe109-f781-40aa-8aa6-81531509be88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:54.383816 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:54.436215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1295/2597] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:14:54 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:14:54.447817 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e0e00-f639-4126-b6b7-847c86fcdf9c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:54.450376 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c47e0e00-f639-4126-b6b7-847c86fcdf9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:54.495762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:14:54.514295 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e0e00-f639-4126-b6b7-847c86fcdf9c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:54.518517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69f773-8696-4e03-be7d-7bb6814d8368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:54.519140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69f773-8696-4e03-be7d-7bb6814d8368 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:54.519477 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69f773-8696-4e03-be7d-7bb6814d8368 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:54.519752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69f773-8696-4e03-be7d-7bb6814d8368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:54.582306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69f773-8696-4e03-be7d-7bb6814d8368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:54.583773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69f773-8696-4e03-be7d-7bb6814d8368 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:54.595506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1303/2598] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:56.484709 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fe109-f781-40aa-8aa6-81531509be88 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:56.494811 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584fe109-f781-40aa-8aa6-81531509be88 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:56.499036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8843f6-5d2b-4702-b03f-fba3f7474e9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:56.499642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8843f6-5d2b-4702-b03f-fba3f7474e9e service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:56.499954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8843f6-5d2b-4702-b03f-fba3f7474e9e service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:56.500226 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8843f6-5d2b-4702-b03f-fba3f7474e9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:56.558277 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8843f6-5d2b-4702-b03f-fba3f7474e9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:56.560407 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8843f6-5d2b-4702-b03f-fba3f7474e9e service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:56.570062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1296/2599] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:57.942235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69f773-8696-4e03-be7d-7bb6814d8368 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:57.951529 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69f773-8696-4e03-be7d-7bb6814d8368 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:57.955304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d979e-2a9b-429c-a6e5-6f1f61a1c9d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:57.955962 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d979e-2a9b-429c-a6e5-6f1f61a1c9d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:57.956228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d979e-2a9b-429c-a6e5-6f1f61a1c9d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:57.956633 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d979e-2a9b-429c-a6e5-6f1f61a1c9d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:57.966827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d979e-2a9b-429c-a6e5-6f1f61a1c9d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:57.968338 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d979e-2a9b-429c-a6e5-6f1f61a1c9d6 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:57.978240 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1304/2600] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:14:58.746923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8843f6-5d2b-4702-b03f-fba3f7474e9e service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:14:58.748402 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9a8843f6-5d2b-4702-b03f-fba3f7474e9e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:58.805863 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8843f6-5d2b-4702-b03f-fba3f7474e9e service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:14:58.810284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b7d07-8f60-4e3c-b049-02f306a158d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:14:58.810925 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7d07-8f60-4e3c-b049-02f306a158d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:14:58.811204 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7d07-8f60-4e3c-b049-02f306a158d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:14:58.811478 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b7d07-8f60-4e3c-b049-02f306a158d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:14:58.813259 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-225b7d07-8f60-4e3c-b049-02f306a158d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:14:58.877393 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b7d07-8f60-4e3c-b049-02f306a158d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:14:58.878826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b7d07-8f60-4e3c-b049-02f306a158d3 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:14:58.889280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1297/2601] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:02.507025 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d979e-2a9b-429c-a6e5-6f1f61a1c9d6 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:02.518882 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d979e-2a9b-429c-a6e5-6f1f61a1c9d6 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:02.523500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7053f67d-67cc-43ee-8679-ccf6454d23f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:02.524258 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053f67d-67cc-43ee-8679-ccf6454d23f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:02.524535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053f67d-67cc-43ee-8679-ccf6454d23f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:02.524808 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7053f67d-67cc-43ee-8679-ccf6454d23f0 admin admin] PATH_INFO: `/v3/users/42ee1a03c5c54f5cad752d0ad0b1024a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:02.525960 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053f67d-67cc-43ee-8679-ccf6454d23f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42ee1a03c5c54f5cad752d0ad0b1024a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:02.528592 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7053f67d-67cc-43ee-8679-ccf6454d23f0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:02.696970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b7d07-8f60-4e3c-b049-02f306a158d3 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:02.702497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-225b7d07-8f60-4e3c-b049-02f306a158d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:02.713065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b7d07-8f60-4e3c-b049-02f306a158d3 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:02.721225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed58da9-0082-439e-9106-cb0a961a85ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:02.721921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed58da9-0082-439e-9106-cb0a961a85ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:02.722202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed58da9-0082-439e-9106-cb0a961a85ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:02.727928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed58da9-0082-439e-9106-cb0a961a85ef admin admin] PATH_INFO: `/v3/users/f4b56136da884b79ab26be1bdd99e407` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:02.727928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed58da9-0082-439e-9106-cb0a961a85ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4b56136da884b79ab26be1bdd99e407)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:02.727928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed58da9-0082-439e-9106-cb0a961a85ef admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:02.727928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:02.735947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7053f67d-67cc-43ee-8679-ccf6454d23f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42ee1a03c5c54f5cad752d0ad0b1024a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:02.753179 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7053f67d-67cc-43ee-8679-ccf6454d23f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42ee1a03c5c54f5cad752d0ad0b1024a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:02.753977 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7053f67d-67cc-43ee-8679-ccf6454d23f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42ee1a03c5c54f5cad752d0ad0b1024a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:02.756587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7053f67d-67cc-43ee-8679-ccf6454d23f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42ee1a03c5c54f5cad752d0ad0b1024a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:02.762742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7053f67d-67cc-43ee-8679-ccf6454d23f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42ee1a03c5c54f5cad752d0ad0b1024a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:02.896013 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1305/2602] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:02 2022] DELETE /identity/v3/users/42ee1a03c5c54f5cad752d0ad0b1024a => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:02.900255 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef57fc-42de-48c3-8dbd-cf0d01041b16 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:02.900560 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef57fc-42de-48c3-8dbd-cf0d01041b16 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:02.900830 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef57fc-42de-48c3-8dbd-cf0d01041b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:02.920646 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-43ef57fc-42de-48c3-8dbd-cf0d01041b16 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:02.921758 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-43ef57fc-42de-48c3-8dbd-cf0d01041b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:02.967412 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:02.979156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9ed58da9-0082-439e-9106-cb0a961a85ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4b56136da884b79ab26be1bdd99e407'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:02.979920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9ed58da9-0082-439e-9106-cb0a961a85ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4b56136da884b79ab26be1bdd99e407'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:02.980860 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9ed58da9-0082-439e-9106-cb0a961a85ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4b56136da884b79ab26be1bdd99e407'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:02.982683 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1306/2603] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:02.988483 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9ed58da9-0082-439e-9106-cb0a961a85ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4b56136da884b79ab26be1bdd99e407'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:02.992272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef57fc-42de-48c3-8dbd-cf0d01041b16 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:02.993754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-43ef57fc-42de-48c3-8dbd-cf0d01041b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:03.001021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-9ed58da9-0082-439e-9106-cb0a961a85ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4b56136da884b79ab26be1bdd99e407'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:03.055522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef57fc-42de-48c3-8dbd-cf0d01041b16 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:03.060338 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dfe81-59e2-4176-ab21-222a49be6357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:03.060943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dfe81-59e2-4176-ab21-222a49be6357 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:03.061219 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dfe81-59e2-4176-ab21-222a49be6357 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:03.061484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0dfe81-59e2-4176-ab21-222a49be6357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:03.063227 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ad0dfe81-59e2-4176-ab21-222a49be6357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:03.075567 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dfe81-59e2-4176-ab21-222a49be6357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:03.077085 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0dfe81-59e2-4176-ab21-222a49be6357 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:03.084226 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1298/2604] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:02 2022] DELETE /identity/v3/users/f4b56136da884b79ab26be1bdd99e407 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:03.086875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1307/2605] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:15:03.412123 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed58da9-0082-439e-9106-cb0a961a85ef admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:03.413886 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9ed58da9-0082-439e-9106-cb0a961a85ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:03.487017 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed58da9-0082-439e-9106-cb0a961a85ef admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:03.491624 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c87b80-f747-49fc-bd83-ac3c869c3f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:03.492283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c87b80-f747-49fc-bd83-ac3c869c3f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:03.492561 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c87b80-f747-49fc-bd83-ac3c869c3f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:03.492946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c87b80-f747-49fc-bd83-ac3c869c3f88 admin admin] PATH_INFO: `/v3/projects/d28177cf7acb40519093ff6ace8d2cfa` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:03.494063 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c87b80-f747-49fc-bd83-ac3c869c3f88 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d28177cf7acb40519093ff6ace8d2cfa)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:03.496719 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c87b80-f747-49fc-bd83-ac3c869c3f88 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:03.616563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-83c87b80-f747-49fc-bd83-ac3c869c3f88 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd28177cf7acb40519093ff6ace8d2cfa', 'request_id': 'req-83c87b80-f747-49fc-bd83-ac3c869c3f88'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:03.623327 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-83c87b80-f747-49fc-bd83-ac3c869c3f88 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd28177cf7acb40519093ff6ace8d2cfa', 'request_id': 'req-83c87b80-f747-49fc-bd83-ac3c869c3f88'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:03.650160 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dfe81-59e2-4176-ab21-222a49be6357 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:03.651656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ad0dfe81-59e2-4176-ab21-222a49be6357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:03.664218 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0dfe81-59e2-4176-ab21-222a49be6357 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:03.722297 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:03.722852 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:03.723127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:03.723395 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] PATH_INFO: `/v3/projects/50e508e1f5204134a6c1922c1c33dbcd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:03.724566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] RBAC: Authorizing `identity:delete_project(project_id=50e508e1f5204134a6c1922c1c33dbcd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:03.726447 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:03.745372 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-83c87b80-f747-49fc-bd83-ac3c869c3f88 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd28177cf7acb40519093ff6ace8d2cfa', 'request_id': 'req-83c87b80-f747-49fc-bd83-ac3c869c3f88'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:03.757563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-83c87b80-f747-49fc-bd83-ac3c869c3f88 admin admin] The token cache is being invalidate because project d28177cf7acb40519093ff6ace8d2cfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:03.757846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-83c87b80-f747-49fc-bd83-ac3c869c3f88 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:03.758477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-83c87b80-f747-49fc-bd83-ac3c869c3f88 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:03.760314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1299/2606] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:03 2022] DELETE /identity/v3/projects/d28177cf7acb40519093ff6ace8d2cfa => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:03.765320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57845f-91a7-41a0-8a62-2f090b482737 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:03.765604 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57845f-91a7-41a0-8a62-2f090b482737 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:03.765876 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da57845f-91a7-41a0-8a62-2f090b482737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:03.785558 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-da57845f-91a7-41a0-8a62-2f090b482737 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:03.786798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-da57845f-91a7-41a0-8a62-2f090b482737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:03.795459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1300/2607] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:03.803861 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a10cb-c9b9-49d4-8c73-24cbc49abfb7 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:03.804172 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a10cb-c9b9-49d4-8c73-24cbc49abfb7 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:03.804453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a10cb-c9b9-49d4-8c73-24cbc49abfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:03.812913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:03.824625 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-016a10cb-c9b9-49d4-8c73-24cbc49abfb7 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:03.826575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-016a10cb-c9b9-49d4-8c73-24cbc49abfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:03.834696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1301/2608] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:03.838916 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a10cb-c9b9-49d4-8c73-24cbc49abfb7 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:03.848963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a10cb-c9b9-49d4-8c73-24cbc49abfb7 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:03.852153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50e508e1f5204134a6c1922c1c33dbcd', 'request_id': 'req-d4d6a70c-dd38-46dc-84bd-885833e9f063'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:03.858961 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50e508e1f5204134a6c1922c1c33dbcd', 'request_id': 'req-d4d6a70c-dd38-46dc-84bd-885833e9f063'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:03.864899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50e508e1f5204134a6c1922c1c33dbcd', 'request_id': 'req-d4d6a70c-dd38-46dc-84bd-885833e9f063'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:03.908729 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafd7ae-3734-4881-86cf-0bab0320d4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:03.909344 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafd7ae-3734-4881-86cf-0bab0320d4bf admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:03.909623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafd7ae-3734-4881-86cf-0bab0320d4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:03.909889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fafd7ae-3734-4881-86cf-0bab0320d4bf admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:03.910535 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafd7ae-3734-4881-86cf-0bab0320d4bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:15:03.910838 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafd7ae-3734-4881-86cf-0bab0320d4bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:03.912534 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fafd7ae-3734-4881-86cf-0bab0320d4bf admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:03.924485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1302/2609] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:15:03.929016 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafd7ae-3734-4881-86cf-0bab0320d4bf admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:03.940050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fafd7ae-3734-4881-86cf-0bab0320d4bf admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:03.944770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc41e7-9c54-4f40-9224-62232bcf60ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:03.951110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc41e7-9c54-4f40-9224-62232bcf60ac admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:03.951110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc41e7-9c54-4f40-9224-62232bcf60ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:03.951110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc41e7-9c54-4f40-9224-62232bcf60ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:03.951110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc41e7-9c54-4f40-9224-62232bcf60ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:03.951110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc41e7-9c54-4f40-9224-62232bcf60ac admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:03.981083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] The token cache is being invalidate because project 50e508e1f5204134a6c1922c1c33dbcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:03.981083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:03.981083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:03.981083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1308/2610] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:03 2022] DELETE /identity/v3/projects/50e508e1f5204134a6c1922c1c33dbcd => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:03.982377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:03.983768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:03.996360 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d6a70c-dd38-46dc-84bd-885833e9f063 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:04.002526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b204d3-27b0-4cc8-9cd7-17038ee054f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:04.003159 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b204d3-27b0-4cc8-9cd7-17038ee054f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:04.003444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b204d3-27b0-4cc8-9cd7-17038ee054f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:04.003718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b204d3-27b0-4cc8-9cd7-17038ee054f9 admin admin] PATH_INFO: `/v3/users/45bf6a2d9b924414b7fac3efa1e7882d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:04.004909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b204d3-27b0-4cc8-9cd7-17038ee054f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45bf6a2d9b924414b7fac3efa1e7882d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:04.006826 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b204d3-27b0-4cc8-9cd7-17038ee054f9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:04.025476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:04.031678 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1303/2611] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:03 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:15:04.034646 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc41e7-9c54-4f40-9224-62232bcf60ac admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:04.036597 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c6fc41e7-9c54-4f40-9224-62232bcf60ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:04.101707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc41e7-9c54-4f40-9224-62232bcf60ac admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:04.106604 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51df92-bf3a-4fde-b47c-3239ebc45771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:04.107267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51df92-bf3a-4fde-b47c-3239ebc45771 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:04.107550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51df92-bf3a-4fde-b47c-3239ebc45771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:04.107829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51df92-bf3a-4fde-b47c-3239ebc45771 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:04.108491 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51df92-bf3a-4fde-b47c-3239ebc45771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:04.110431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51df92-bf3a-4fde-b47c-3239ebc45771 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:04.244470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1304/2612] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:04 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:04.249192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51df92-bf3a-4fde-b47c-3239ebc45771 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:04.258855 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51df92-bf3a-4fde-b47c-3239ebc45771 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:04.263795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9fb36-a1d5-4d6c-b58c-cf8f810e482b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:04.271596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9fb36-a1d5-4d6c-b58c-cf8f810e482b admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:04.271596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9fb36-a1d5-4d6c-b58c-cf8f810e482b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:04.271596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa9fb36-a1d5-4d6c-b58c-cf8f810e482b admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:04.271596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9fb36-a1d5-4d6c-b58c-cf8f810e482b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:04.271596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa9fb36-a1d5-4d6c-b58c-cf8f810e482b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:04.276975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1305/2613] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:15:04.280903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9fb36-a1d5-4d6c-b58c-cf8f810e482b admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:04.290559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa9fb36-a1d5-4d6c-b58c-cf8f810e482b admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:04.296185 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d3c12-4cf5-4493-93a8-986c4b07f240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:04.296798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3c12-4cf5-4493-93a8-986c4b07f240 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:04.300320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3c12-4cf5-4493-93a8-986c4b07f240 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:04.300320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d3c12-4cf5-4493-93a8-986c4b07f240 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:04.300320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d3c12-4cf5-4493-93a8-986c4b07f240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:04.300320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d3c12-4cf5-4493-93a8-986c4b07f240 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:04.310278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-45b204d3-27b0-4cc8-9cd7-17038ee054f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45bf6a2d9b924414b7fac3efa1e7882d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:04.311596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1306/2614] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:15:04.315805 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d3c12-4cf5-4493-93a8-986c4b07f240 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:04.323088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-45b204d3-27b0-4cc8-9cd7-17038ee054f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45bf6a2d9b924414b7fac3efa1e7882d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:04.323789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-45b204d3-27b0-4cc8-9cd7-17038ee054f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45bf6a2d9b924414b7fac3efa1e7882d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:04.324427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-45b204d3-27b0-4cc8-9cd7-17038ee054f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45bf6a2d9b924414b7fac3efa1e7882d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:04.327576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d3c12-4cf5-4493-93a8-986c4b07f240 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:04.331944 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-45b204d3-27b0-4cc8-9cd7-17038ee054f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45bf6a2d9b924414b7fac3efa1e7882d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:04.335586 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a98c4a-2dc8-4140-a5de-eab9e9956c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:04.336273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a98c4a-2dc8-4140-a5de-eab9e9956c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:04.336549 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a98c4a-2dc8-4140-a5de-eab9e9956c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:04.336821 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a98c4a-2dc8-4140-a5de-eab9e9956c03 admin admin] PATH_INFO: `/v3/projects/06ccc18672e94e5abc52e496b9c4d347/users/3e0541fcfa9c48229e1db8a45b81bc38/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:04.352169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a98c4a-2dc8-4140-a5de-eab9e9956c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ccc18672e94e5abc52e496b9c4d347, user_id=3e0541fcfa9c48229e1db8a45b81bc38, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:04.354802 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a98c4a-2dc8-4140-a5de-eab9e9956c03 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:04.421246 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1309/2615] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:03 2022] DELETE /identity/v3/users/45bf6a2d9b924414b7fac3efa1e7882d => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:04.456281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1307/2616] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:04 2022] PUT /identity/v3/projects/06ccc18672e94e5abc52e496b9c4d347/users/3e0541fcfa9c48229e1db8a45b81bc38/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:04.469069 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb38a-b369-480f-8066-e7a5b5343015 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:04.469481 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb38a-b369-480f-8066-e7a5b5343015 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:04.469728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb38a-b369-480f-8066-e7a5b5343015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:04.499896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-8f3fb38a-b369-480f-8066-e7a5b5343015 None None] MFA Rules not processed for user `3e0541fcfa9c48229e1db8a45b81bc38`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:04.501068 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8f3fb38a-b369-480f-8066-e7a5b5343015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:04.565504 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1310/2617] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:04.577750 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a98c4a-2dc8-4140-a5de-eab9e9956c03 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:04.579564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-00a98c4a-2dc8-4140-a5de-eab9e9956c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:04.593642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:04.662071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a98c4a-2dc8-4140-a5de-eab9e9956c03 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:04.668025 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5326815-2a98-4abf-aee7-8ccae7eddc4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:04.669192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326815-2a98-4abf-aee7-8ccae7eddc4d service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:04.669476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326815-2a98-4abf-aee7-8ccae7eddc4d service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:04.669742 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5326815-2a98-4abf-aee7-8ccae7eddc4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:04.679196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5326815-2a98-4abf-aee7-8ccae7eddc4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:04.680945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5326815-2a98-4abf-aee7-8ccae7eddc4d service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:04.692887 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1308/2618] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:04.839566 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fb38a-b369-480f-8066-e7a5b5343015 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:04.844545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8f3fb38a-b369-480f-8066-e7a5b5343015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:04.930962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5326815-2a98-4abf-aee7-8ccae7eddc4d service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:04.932656 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f5326815-2a98-4abf-aee7-8ccae7eddc4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:04.941078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fb38a-b369-480f-8066-e7a5b5343015 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:04.945681 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:04.946309 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:04.946583 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:04.946700 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5326815-2a98-4abf-aee7-8ccae7eddc4d service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:04.946842 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] PATH_INFO: `/v3/projects/73d7ffb57ccf458d9af46bb5c3020d9d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:04.947969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=73d7ffb57ccf458d9af46bb5c3020d9d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:04.950522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:04.952035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976b107-2d7e-4d2a-b09f-a3c813f6df02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:04.952662 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976b107-2d7e-4d2a-b09f-a3c813f6df02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:04.952975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976b107-2d7e-4d2a-b09f-a3c813f6df02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:04.953247 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976b107-2d7e-4d2a-b09f-a3c813f6df02 admin admin] PATH_INFO: `/v3/users/3e0541fcfa9c48229e1db8a45b81bc38` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:04.954375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976b107-2d7e-4d2a-b09f-a3c813f6df02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e0541fcfa9c48229e1db8a45b81bc38)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:04.956341 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976b107-2d7e-4d2a-b09f-a3c813f6df02 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:05.074529 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:05.091988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73d7ffb57ccf458d9af46bb5c3020d9d', 'request_id': 'req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.098101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73d7ffb57ccf458d9af46bb5c3020d9d', 'request_id': 'req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.103449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73d7ffb57ccf458d9af46bb5c3020d9d', 'request_id': 'req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.167394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b976b107-2d7e-4d2a-b09f-a3c813f6df02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e0541fcfa9c48229e1db8a45b81bc38'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.168065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b976b107-2d7e-4d2a-b09f-a3c813f6df02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e0541fcfa9c48229e1db8a45b81bc38'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.169416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b976b107-2d7e-4d2a-b09f-a3c813f6df02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e0541fcfa9c48229e1db8a45b81bc38'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.176337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b976b107-2d7e-4d2a-b09f-a3c813f6df02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e0541fcfa9c48229e1db8a45b81bc38'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.187957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] The token cache is being invalidate because project 73d7ffb57ccf458d9af46bb5c3020d9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:05.191810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.191810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.192145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b976b107-2d7e-4d2a-b09f-a3c813f6df02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e0541fcfa9c48229e1db8a45b81bc38'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.192248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1311/2619] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:04 2022] DELETE /identity/v3/projects/73d7ffb57ccf458d9af46bb5c3020d9d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:05.194512 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:05.195866 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:05.264223 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9919f-8bc5-49ab-8cea-20ee1c925e6d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:05.269081 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876be608-041a-4382-ade5-610217bc01bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:05.269750 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876be608-041a-4382-ade5-610217bc01bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:05.270022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876be608-041a-4382-ade5-610217bc01bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:05.270313 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876be608-041a-4382-ade5-610217bc01bc admin admin] PATH_INFO: `/v3/users/1901b48b352c47df96dc1f0f632d02d5` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:05.271496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876be608-041a-4382-ade5-610217bc01bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1901b48b352c47df96dc1f0f632d02d5)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:05.273497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876be608-041a-4382-ade5-610217bc01bc admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:05.282934 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1309/2620] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:04 2022] DELETE /identity/v3/users/3e0541fcfa9c48229e1db8a45b81bc38 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:05.287458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198db9-7931-45d3-9bd0-df070a0242cd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:05.287739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198db9-7931-45d3-9bd0-df070a0242cd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:05.288664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8198db9-7931-45d3-9bd0-df070a0242cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:05.308883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f8198db9-7931-45d3-9bd0-df070a0242cd None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:05.311082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f8198db9-7931-45d3-9bd0-df070a0242cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:05.370506 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1310/2621] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:05.380970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8198db9-7931-45d3-9bd0-df070a0242cd None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:05.382369 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f8198db9-7931-45d3-9bd0-df070a0242cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:05.393550 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:05.441719 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8198db9-7931-45d3-9bd0-df070a0242cd None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:05.445570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2b9e0-6147-4462-b957-5a2b4b7dff33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:05.446175 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2b9e0-6147-4462-b957-5a2b4b7dff33 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:05.446452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2b9e0-6147-4462-b957-5a2b4b7dff33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:05.446724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f2b9e0-6147-4462-b957-5a2b4b7dff33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:05.457416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2b9e0-6147-4462-b957-5a2b4b7dff33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:05.458972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f2b9e0-6147-4462-b957-5a2b4b7dff33 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:05.469380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1311/2622] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:15:05.493805 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-876be608-041a-4382-ade5-610217bc01bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1901b48b352c47df96dc1f0f632d02d5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.509309 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-876be608-041a-4382-ade5-610217bc01bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1901b48b352c47df96dc1f0f632d02d5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.510033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-876be608-041a-4382-ade5-610217bc01bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1901b48b352c47df96dc1f0f632d02d5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.510671 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-876be608-041a-4382-ade5-610217bc01bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1901b48b352c47df96dc1f0f632d02d5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.518771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-876be608-041a-4382-ade5-610217bc01bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1901b48b352c47df96dc1f0f632d02d5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:05.603718 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1312/2623] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:05 2022] DELETE /identity/v3/users/1901b48b352c47df96dc1f0f632d02d5 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:05.975634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2b9e0-6147-4462-b957-5a2b4b7dff33 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:05.977170 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e0f2b9e0-6147-4462-b957-5a2b4b7dff33 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:05.991189 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f2b9e0-6147-4462-b957-5a2b4b7dff33 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:06.060790 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:06.060790 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:06.060790 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:06.060790 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee admin admin] PATH_INFO: `/v3/projects/06ccc18672e94e5abc52e496b9c4d347` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:06.061790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876be608-041a-4382-ade5-610217bc01bc admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:06.063996 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-876be608-041a-4382-ade5-610217bc01bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:06.066572 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ccc18672e94e5abc52e496b9c4d347)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:06.071711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:06.082647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876be608-041a-4382-ade5-610217bc01bc admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:06.088494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30880ac0-a21b-404d-9311-ff9e4ee635a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:06.089511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30880ac0-a21b-404d-9311-ff9e4ee635a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:06.089992 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30880ac0-a21b-404d-9311-ff9e4ee635a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:06.091150 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30880ac0-a21b-404d-9311-ff9e4ee635a2 admin admin] PATH_INFO: `/v3/projects/58932aa9ecc445bf9c642553f5a2ab05` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:06.092605 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30880ac0-a21b-404d-9311-ff9e4ee635a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58932aa9ecc445bf9c642553f5a2ab05)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:06.099290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30880ac0-a21b-404d-9311-ff9e4ee635a2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:06.206830 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ccc18672e94e5abc52e496b9c4d347', 'request_id': 'req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:06.214808 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ccc18672e94e5abc52e496b9c4d347', 'request_id': 'req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:06.224091 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:06.240787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-30880ac0-a21b-404d-9311-ff9e4ee635a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58932aa9ecc445bf9c642553f5a2ab05', 'request_id': 'req-30880ac0-a21b-404d-9311-ff9e4ee635a2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:06.248037 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-30880ac0-a21b-404d-9311-ff9e4ee635a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58932aa9ecc445bf9c642553f5a2ab05', 'request_id': 'req-30880ac0-a21b-404d-9311-ff9e4ee635a2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:06.253966 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-30880ac0-a21b-404d-9311-ff9e4ee635a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58932aa9ecc445bf9c642553f5a2ab05', 'request_id': 'req-30880ac0-a21b-404d-9311-ff9e4ee635a2'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:06.348249 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ccc18672e94e5abc52e496b9c4d347', 'request_id': 'req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:06.362615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee admin admin] The token cache is being invalidate because project 06ccc18672e94e5abc52e496b9c4d347 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:06.362981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:06.363668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-698f23a7-e86d-4c26-a3a0-37f61f13b8ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:06.365197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1312/2624] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:05 2022] DELETE /identity/v3/projects/06ccc18672e94e5abc52e496b9c4d347 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:06.370046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add841f2-5179-44b1-8f37-03f1129c1bbd None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:06.370347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add841f2-5179-44b1-8f37-03f1129c1bbd None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:06.370606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add841f2-5179-44b1-8f37-03f1129c1bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:06.392894 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-add841f2-5179-44b1-8f37-03f1129c1bbd None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:06.394110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-add841f2-5179-44b1-8f37-03f1129c1bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:06.436260 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:06.443612 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-30880ac0-a21b-404d-9311-ff9e4ee635a2 admin admin] The token cache is being invalidate because project 58932aa9ecc445bf9c642553f5a2ab05 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:06.443939 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-30880ac0-a21b-404d-9311-ff9e4ee635a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:06.444678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-30880ac0-a21b-404d-9311-ff9e4ee635a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:06.446899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1313/2625] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:06 2022] DELETE /identity/v3/projects/58932aa9ecc445bf9c642553f5a2ab05 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:06.453417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96493f5-9b49-41cb-91ba-8ba6134d8e17 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:06.453594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96493f5-9b49-41cb-91ba-8ba6134d8e17 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:06.453751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96493f5-9b49-41cb-91ba-8ba6134d8e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:06.459432 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1313/2626] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:06.467447 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec242f23-1eb0-45ad-9263-6f041554119c None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:06.467737 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec242f23-1eb0-45ad-9263-6f041554119c None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:06.468051 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec242f23-1eb0-45ad-9263-6f041554119c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:06.475002 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-d96493f5-9b49-41cb-91ba-8ba6134d8e17 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:06.476773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-d96493f5-9b49-41cb-91ba-8ba6134d8e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:06.486150 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1314/2627] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:06.488481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ec242f23-1eb0-45ad-9263-6f041554119c None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:06.489706 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ec242f23-1eb0-45ad-9263-6f041554119c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:06.493488 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f43c0-ad99-41d9-adac-3f8ef925a730 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:06.493901 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f43c0-ad99-41d9-adac-3f8ef925a730 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:06.494544 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f43c0-ad99-41d9-adac-3f8ef925a730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:06.502436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1314/2628] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:06.508326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec242f23-1eb0-45ad-9263-6f041554119c None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:06.515611 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7f8f43c0-ad99-41d9-adac-3f8ef925a730 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:06.516910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7f8f43c0-ad99-41d9-adac-3f8ef925a730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:06.517591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec242f23-1eb0-45ad-9263-6f041554119c None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:06.523836 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c1209-10ea-438c-9355-504f94a0b447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:06.525240 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c1209-10ea-438c-9355-504f94a0b447 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:06.525795 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c1209-10ea-438c-9355-504f94a0b447 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:06.528406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c1209-10ea-438c-9355-504f94a0b447 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:06.528541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1315/2629] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:06.528644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c1209-10ea-438c-9355-504f94a0b447 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:15:06.536161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c1209-10ea-438c-9355-504f94a0b447 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:06.536161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c1209-10ea-438c-9355-504f94a0b447 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:06.537092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f43c0-ad99-41d9-adac-3f8ef925a730 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:06.546840 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f43c0-ad99-41d9-adac-3f8ef925a730 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:06.551749 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ac1de-e929-4ad1-ba53-3520c7e89f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:06.552385 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ac1de-e929-4ad1-ba53-3520c7e89f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:06.552665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ac1de-e929-4ad1-ba53-3520c7e89f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:06.552933 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482ac1de-e929-4ad1-ba53-3520c7e89f03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:06.553580 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ac1de-e929-4ad1-ba53-3520c7e89f03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:15:06.553881 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ac1de-e929-4ad1-ba53-3520c7e89f03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:06.554711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1315/2630] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:15:06.557352 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482ac1de-e929-4ad1-ba53-3520c7e89f03 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:06.561354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c1209-10ea-438c-9355-504f94a0b447 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:06.571975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1316/2631] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:15:06.575496 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ac1de-e929-4ad1-ba53-3520c7e89f03 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:06.578866 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c1209-10ea-438c-9355-504f94a0b447 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:06.584396 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af0e11-33d6-4b3c-a5b1-95d5a5b98049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:06.585291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af0e11-33d6-4b3c-a5b1-95d5a5b98049 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:06.585714 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af0e11-33d6-4b3c-a5b1-95d5a5b98049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:06.586003 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482ac1de-e929-4ad1-ba53-3520c7e89f03 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:06.586178 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af0e11-33d6-4b3c-a5b1-95d5a5b98049 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:06.587142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af0e11-33d6-4b3c-a5b1-95d5a5b98049 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:06.590017 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af0e11-33d6-4b3c-a5b1-95d5a5b98049 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:06.591315 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92126c-bd93-4f9a-946d-87761a4f368b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:06.592010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92126c-bd93-4f9a-946d-87761a4f368b admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:06.592352 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92126c-bd93-4f9a-946d-87761a4f368b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:06.592630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92126c-bd93-4f9a-946d-87761a4f368b admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:06.593253 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92126c-bd93-4f9a-946d-87761a4f368b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:06.595145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92126c-bd93-4f9a-946d-87761a4f368b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:06.685925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1317/2632] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:06 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:15:06.690245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92126c-bd93-4f9a-946d-87761a4f368b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:06.726586 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1316/2633] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:06 2022] POST /identity/v3/projects => generated 403 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:06.732605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af0e11-33d6-4b3c-a5b1-95d5a5b98049 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:06.763911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92126c-bd93-4f9a-946d-87761a4f368b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:06.807540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af0e11-33d6-4b3c-a5b1-95d5a5b98049 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:06.813104 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65878f-a4d4-4535-9d23-0061238e2bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:06.813747 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65878f-a4d4-4535-9d23-0061238e2bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:06.814026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65878f-a4d4-4535-9d23-0061238e2bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:06.814294 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf65878f-a4d4-4535-9d23-0061238e2bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:06.814926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65878f-a4d4-4535-9d23-0061238e2bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:06.817049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf65878f-a4d4-4535-9d23-0061238e2bf5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:06.825931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312ed55-03a4-47ec-a4b8-98e5669f808f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:06.826656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312ed55-03a4-47ec-a4b8-98e5669f808f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:06.826937 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312ed55-03a4-47ec-a4b8-98e5669f808f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:06.827205 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8312ed55-03a4-47ec-a4b8-98e5669f808f admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:06.827867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312ed55-03a4-47ec-a4b8-98e5669f808f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:06.829790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8312ed55-03a4-47ec-a4b8-98e5669f808f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:06.959525 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1317/2634] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:06 2022] POST /identity/v3/users => generated 302 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:15:06.959792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1318/2635] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:06 2022] POST /identity/v3/users => generated 286 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:15:06.961933 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65878f-a4d4-4535-9d23-0061238e2bf5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:06.963106 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312ed55-03a4-47ec-a4b8-98e5669f808f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:06.971549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:06.974770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf65878f-a4d4-4535-9d23-0061238e2bf5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:06.975447 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8312ed55-03a4-47ec-a4b8-98e5669f808f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:06.979989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0258736-4f77-44b0-b80a-831c358b42c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:06.980504 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e3954-53cc-48a0-9038-5bb83fb27eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:06.980633 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258736-4f77-44b0-b80a-831c358b42c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:06.980800 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258736-4f77-44b0-b80a-831c358b42c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:06.980944 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3954-53cc-48a0-9038-5bb83fb27eb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:06.981090 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0258736-4f77-44b0-b80a-831c358b42c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:06.981317 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3954-53cc-48a0-9038-5bb83fb27eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:06.981599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1e3954-53cc-48a0-9038-5bb83fb27eb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:06.981741 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0258736-4f77-44b0-b80a-831c358b42c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:06.982250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e3954-53cc-48a0-9038-5bb83fb27eb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:06.983495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0258736-4f77-44b0-b80a-831c358b42c5 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:06.983882 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1e3954-53cc-48a0-9038-5bb83fb27eb3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:06.994865 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1318/2636] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:15:06.995107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1319/2637] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:15:06.999453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0258736-4f77-44b0-b80a-831c358b42c5 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:06.999611 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e3954-53cc-48a0-9038-5bb83fb27eb3 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:07.009501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0258736-4f77-44b0-b80a-831c358b42c5 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:07.009731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1e3954-53cc-48a0-9038-5bb83fb27eb3 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:07.015049 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fec51-5035-4f5e-832f-7634fae331ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:07.015334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b85c4-ebd7-4cac-b59c-64238cf35761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:07.015675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fec51-5035-4f5e-832f-7634fae331ee admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:07.015986 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b85c4-ebd7-4cac-b59c-64238cf35761 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:07.016099 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fec51-5035-4f5e-832f-7634fae331ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:07.016259 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882fec51-5035-4f5e-832f-7634fae331ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:07.016626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b85c4-ebd7-4cac-b59c-64238cf35761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:07.016909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fec51-5035-4f5e-832f-7634fae331ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:07.017035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b85c4-ebd7-4cac-b59c-64238cf35761 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:07.017550 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b85c4-ebd7-4cac-b59c-64238cf35761 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:07.018502 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882fec51-5035-4f5e-832f-7634fae331ee admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:07.019300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b85c4-ebd7-4cac-b59c-64238cf35761 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:07.034526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1320/2638] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:07.036789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b85c4-ebd7-4cac-b59c-64238cf35761 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:07.040157 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1319/2639] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:07.041058 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fec51-5035-4f5e-832f-7634fae331ee admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:07.048121 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b85c4-ebd7-4cac-b59c-64238cf35761 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:07.052633 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882fec51-5035-4f5e-832f-7634fae331ee admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:07.054207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b650b2de-847a-4929-b157-6540f424596b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:07.054818 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b2de-847a-4929-b157-6540f424596b admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:07.055210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b2de-847a-4929-b157-6540f424596b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:07.055391 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b650b2de-847a-4929-b157-6540f424596b admin admin] PATH_INFO: `/v3/projects/481b599ddb1848bf9964abc9dd93cb9a/users/38b6162c32f7439ba552044a54f19e52/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:07.058529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd351a1-269a-4912-9f77-5fa985fea0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:07.065964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd351a1-269a-4912-9f77-5fa985fea0da admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:07.065964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd351a1-269a-4912-9f77-5fa985fea0da admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:07.065964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd351a1-269a-4912-9f77-5fa985fea0da admin admin] PATH_INFO: `/v3/projects/e2379f8ec3304ea3a226891498d0263c/users/f8551bbc736a479593785a2772ba10bd/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:07.072982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650b2de-847a-4929-b157-6540f424596b admin admin] RBAC: Authorizing `identity:create_grant(project_id=481b599ddb1848bf9964abc9dd93cb9a, user_id=38b6162c32f7439ba552044a54f19e52, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:07.076440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b650b2de-847a-4929-b157-6540f424596b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:07.077166 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd351a1-269a-4912-9f77-5fa985fea0da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2379f8ec3304ea3a226891498d0263c, user_id=f8551bbc736a479593785a2772ba10bd, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:07.079892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd351a1-269a-4912-9f77-5fa985fea0da admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:07.149018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1321/2640] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:07 2022] PUT /identity/v3/projects/481b599ddb1848bf9964abc9dd93cb9a/users/38b6162c32f7439ba552044a54f19e52/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:07.161454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24877ea-bb4e-41ab-8528-aeacee19372f None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:07.161789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24877ea-bb4e-41ab-8528-aeacee19372f None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:07.162163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24877ea-bb4e-41ab-8528-aeacee19372f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:07.165367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1320/2641] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:07 2022] PUT /identity/v3/projects/e2379f8ec3304ea3a226891498d0263c/users/f8551bbc736a479593785a2772ba10bd/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:07.171142 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ccbad-4706-47e9-849f-de096c3e60b4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:07.171432 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ccbad-4706-47e9-849f-de096c3e60b4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:07.171705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92ccbad-4706-47e9-849f-de096c3e60b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:07.192300 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e92ccbad-4706-47e9-849f-de096c3e60b4 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:07.193698 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e92ccbad-4706-47e9-849f-de096c3e60b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:07.193972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-c24877ea-bb4e-41ab-8528-aeacee19372f None None] MFA Rules not processed for user `38b6162c32f7439ba552044a54f19e52`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:07.195158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c24877ea-bb4e-41ab-8528-aeacee19372f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:07.237629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:07.262520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1321/2642] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:07.271789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ccbad-4706-47e9-849f-de096c3e60b4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:07.274124 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e92ccbad-4706-47e9-849f-de096c3e60b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:07.279535 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1322/2643] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:07 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:07.284487 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24877ea-bb4e-41ab-8528-aeacee19372f None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:07.296600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24877ea-bb4e-41ab-8528-aeacee19372f None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:07.307324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2214c-731b-4f0c-8730-fbe8cbdc1c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:07.308342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2214c-731b-4f0c-8730-fbe8cbdc1c11 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:07.308624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2214c-731b-4f0c-8730-fbe8cbdc1c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:07.308899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2214c-731b-4f0c-8730-fbe8cbdc1c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:07.310380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2214c-731b-4f0c-8730-fbe8cbdc1c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:07.312668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2214c-731b-4f0c-8730-fbe8cbdc1c11 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:07.347500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92ccbad-4706-47e9-849f-de096c3e60b4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:07.351861 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7d82f-1131-4a93-b742-88a39a7811d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:07.352501 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7d82f-1131-4a93-b742-88a39a7811d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:07.352783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7d82f-1131-4a93-b742-88a39a7811d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:07.353063 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7d82f-1131-4a93-b742-88a39a7811d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:07.363678 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7d82f-1131-4a93-b742-88a39a7811d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:07.365181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7d82f-1131-4a93-b742-88a39a7811d0 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:07.377169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1322/2644] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:07.412449 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1323/2645] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:07 2022] POST /identity/v3/projects => generated 405 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:15:07.416671 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7d82f-1131-4a93-b742-88a39a7811d0 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:07.428161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7d82f-1131-4a93-b742-88a39a7811d0 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:07.486962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecb377-ffe6-4da0-ae7a-63350ba32c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:07.487651 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecb377-ffe6-4da0-ae7a-63350ba32c4e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:07.487885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecb377-ffe6-4da0-ae7a-63350ba32c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:07.488162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecb377-ffe6-4da0-ae7a-63350ba32c4e admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:07.493664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecb377-ffe6-4da0-ae7a-63350ba32c4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:07.493664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ecb377-ffe6-4da0-ae7a-63350ba32c4e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:07.576711 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1323/2646] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:07 2022] POST /identity/v3/users => generated 309 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:15:07.581098 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2214c-731b-4f0c-8730-fbe8cbdc1c11 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:07.592779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2214c-731b-4f0c-8730-fbe8cbdc1c11 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:07.597463 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3e2d5-517d-439b-9110-15c740b3774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:07.598078 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3e2d5-517d-439b-9110-15c740b3774d admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:07.598354 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3e2d5-517d-439b-9110-15c740b3774d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:07.598622 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3e2d5-517d-439b-9110-15c740b3774d admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:07.599255 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3e2d5-517d-439b-9110-15c740b3774d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:07.600860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3e2d5-517d-439b-9110-15c740b3774d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:07.611299 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1324/2647] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:07.615753 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecb377-ffe6-4da0-ae7a-63350ba32c4e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:07.626363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ecb377-ffe6-4da0-ae7a-63350ba32c4e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:07.631050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75005920-7a89-4972-97e5-f9bd263939f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:07.631690 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75005920-7a89-4972-97e5-f9bd263939f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:07.636044 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75005920-7a89-4972-97e5-f9bd263939f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:07.636044 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75005920-7a89-4972-97e5-f9bd263939f6 admin admin] PATH_INFO: `/v3/projects/c3c00a1d8c5d4057a9d694a6b87ab67d/users/f03ecf220a6a4dd1b1564ef46d018919/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:07.648605 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75005920-7a89-4972-97e5-f9bd263939f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c00a1d8c5d4057a9d694a6b87ab67d, user_id=f03ecf220a6a4dd1b1564ef46d018919, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:07.651245 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75005920-7a89-4972-97e5-f9bd263939f6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:07.755237 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1324/2648] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:07 2022] PUT /identity/v3/projects/c3c00a1d8c5d4057a9d694a6b87ab67d/users/f03ecf220a6a4dd1b1564ef46d018919/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:07.759300 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3e2d5-517d-439b-9110-15c740b3774d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:07.770026 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3e2d5-517d-439b-9110-15c740b3774d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:07.827279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754367d-4af5-4d57-8c1c-b003d5350ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:07.827907 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754367d-4af5-4d57-8c1c-b003d5350ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:07.828188 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754367d-4af5-4d57-8c1c-b003d5350ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:07.828458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754367d-4af5-4d57-8c1c-b003d5350ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:07.829092 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754367d-4af5-4d57-8c1c-b003d5350ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:07.830669 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754367d-4af5-4d57-8c1c-b003d5350ea0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:07.841362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1325/2649] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:07.845851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75005920-7a89-4972-97e5-f9bd263939f6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:07.857248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75005920-7a89-4972-97e5-f9bd263939f6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:07.861999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f4290-182e-4745-a46e-9e05fc936fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:07.862650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f4290-182e-4745-a46e-9e05fc936fa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:07.862932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f4290-182e-4745-a46e-9e05fc936fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:07.863207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78f4290-182e-4745-a46e-9e05fc936fa3 admin admin] PATH_INFO: `/v3/projects/c3c00a1d8c5d4057a9d694a6b87ab67d/users/f03ecf220a6a4dd1b1564ef46d018919/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:07.865192 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f4290-182e-4745-a46e-9e05fc936fa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c00a1d8c5d4057a9d694a6b87ab67d, user_id=f03ecf220a6a4dd1b1564ef46d018919, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:07.867905 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78f4290-182e-4745-a46e-9e05fc936fa3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:07.879723 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1325/2650] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:07 2022] PUT /identity/v3/projects/c3c00a1d8c5d4057a9d694a6b87ab67d/users/f03ecf220a6a4dd1b1564ef46d018919/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:07.894278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059fb03-c2d3-4cd3-b6fa-265379e25826 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:07.894609 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059fb03-c2d3-4cd3-b6fa-265379e25826 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:07.894912 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059fb03-c2d3-4cd3-b6fa-265379e25826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:07.916174 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:07.925335 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3059fb03-c2d3-4cd3-b6fa-265379e25826 None None] MFA Rules not processed for user `f03ecf220a6a4dd1b1564ef46d018919`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:07.926588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3059fb03-c2d3-4cd3-b6fa-265379e25826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:08.007373 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1326/2651] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:07 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:08.017492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f4290-182e-4745-a46e-9e05fc936fa3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:08.019412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f78f4290-182e-4745-a46e-9e05fc936fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:08.066296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:08.080573 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78f4290-182e-4745-a46e-9e05fc936fa3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:08.084899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398b6017-2461-4af6-a6b9-336de8b4a4bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:08.085558 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b6017-2461-4af6-a6b9-336de8b4a4bf service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:08.085880 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b6017-2461-4af6-a6b9-336de8b4a4bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:08.086115 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398b6017-2461-4af6-a6b9-336de8b4a4bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:08.096944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b6017-2461-4af6-a6b9-336de8b4a4bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:08.098409 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398b6017-2461-4af6-a6b9-336de8b4a4bf service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:08.109321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1326/2652] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:08 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:08.273213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059fb03-c2d3-4cd3-b6fa-265379e25826 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:08.337748 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059fb03-c2d3-4cd3-b6fa-265379e25826 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:08.343208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cff61a8-8ee4-46ed-8bf6-25381e5d4df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:08.343943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff61a8-8ee4-46ed-8bf6-25381e5d4df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:08.346369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff61a8-8ee4-46ed-8bf6-25381e5d4df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:08.346369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cff61a8-8ee4-46ed-8bf6-25381e5d4df9 admin admin] PATH_INFO: `/v3/users/38b6162c32f7439ba552044a54f19e52` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:08.346369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff61a8-8ee4-46ed-8bf6-25381e5d4df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38b6162c32f7439ba552044a54f19e52)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:08.347783 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cff61a8-8ee4-46ed-8bf6-25381e5d4df9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:08.529041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8cff61a8-8ee4-46ed-8bf6-25381e5d4df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38b6162c32f7439ba552044a54f19e52'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:08.543828 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8cff61a8-8ee4-46ed-8bf6-25381e5d4df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38b6162c32f7439ba552044a54f19e52'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:08.544552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8cff61a8-8ee4-46ed-8bf6-25381e5d4df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38b6162c32f7439ba552044a54f19e52'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:08.545751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8cff61a8-8ee4-46ed-8bf6-25381e5d4df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38b6162c32f7439ba552044a54f19e52'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:08.552845 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8cff61a8-8ee4-46ed-8bf6-25381e5d4df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38b6162c32f7439ba552044a54f19e52'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:08.646006 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1327/2653] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:08 2022] DELETE /identity/v3/users/38b6162c32f7439ba552044a54f19e52 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:08.650728 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771b5d4-1fa6-45e7-960d-935fc0129e48 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:08.650728 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771b5d4-1fa6-45e7-960d-935fc0129e48 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:08.651034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4771b5d4-1fa6-45e7-960d-935fc0129e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:08.673036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-4771b5d4-1fa6-45e7-960d-935fc0129e48 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:08.674264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4771b5d4-1fa6-45e7-960d-935fc0129e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:08.738613 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b0387-f04b-4dc9-ae20-e612438e9da2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:08.739408 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b0387-f04b-4dc9-ae20-e612438e9da2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:08.739774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b0387-f04b-4dc9-ae20-e612438e9da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:08.748296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1327/2654] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:08.758476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771b5d4-1fa6-45e7-960d-935fc0129e48 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:08.759923 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-4771b5d4-1fa6-45e7-960d-935fc0129e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:08.775011 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-612b0387-f04b-4dc9-ae20-e612438e9da2 None None] MFA Rules not processed for user `f8551bbc736a479593785a2772ba10bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:08.776379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-612b0387-f04b-4dc9-ae20-e612438e9da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:08.785129 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:08.830462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4771b5d4-1fa6-45e7-960d-935fc0129e48 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:08.834547 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61e1dc-3fe0-4532-8be7-30d596bc6e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:08.836898 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e1dc-3fe0-4532-8be7-30d596bc6e90 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:08.836898 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e1dc-3fe0-4532-8be7-30d596bc6e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:08.836898 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61e1dc-3fe0-4532-8be7-30d596bc6e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:08.846457 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61e1dc-3fe0-4532-8be7-30d596bc6e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:08.848718 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61e1dc-3fe0-4532-8be7-30d596bc6e90 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:08.864345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1328/2655] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:15:08.865694 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1328/2656] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:08.875391 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61e1dc-3fe0-4532-8be7-30d596bc6e90 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:08.876999 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-0a61e1dc-3fe0-4532-8be7-30d596bc6e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:08.939540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61e1dc-3fe0-4532-8be7-30d596bc6e90 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:08.943363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a22ee-f8eb-44d7-a872-24b1efa8d03e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:08.944008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a22ee-f8eb-44d7-a872-24b1efa8d03e service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:08.944288 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a22ee-f8eb-44d7-a872-24b1efa8d03e service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:08.944561 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a22ee-f8eb-44d7-a872-24b1efa8d03e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:08.956102 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a22ee-f8eb-44d7-a872-24b1efa8d03e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:08.957643 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a22ee-f8eb-44d7-a872-24b1efa8d03e service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:08.968296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1329/2657] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:08 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:09.441729 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b0387-f04b-4dc9-ae20-e612438e9da2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:09.447820 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-612b0387-f04b-4dc9-ae20-e612438e9da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:09.460100 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b0387-f04b-4dc9-ae20-e612438e9da2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:09.464903 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:09.466800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:09.467105 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:09.467382 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] PATH_INFO: `/v3/projects/481b599ddb1848bf9964abc9dd93cb9a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:09.468601 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] RBAC: Authorizing `identity:delete_project(project_id=481b599ddb1848bf9964abc9dd93cb9a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:09.470542 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:09.612731 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481b599ddb1848bf9964abc9dd93cb9a', 'request_id': 'req-1350649b-7e1d-4310-a331-656e77f4549f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:09.619746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481b599ddb1848bf9964abc9dd93cb9a', 'request_id': 'req-1350649b-7e1d-4310-a331-656e77f4549f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:09.628090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481b599ddb1848bf9964abc9dd93cb9a', 'request_id': 'req-1350649b-7e1d-4310-a331-656e77f4549f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:09.708709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] The token cache is being invalidate because project 481b599ddb1848bf9964abc9dd93cb9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:09.711499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:09.711499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:09.712322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1329/2658] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:09 2022] DELETE /identity/v3/projects/481b599ddb1848bf9964abc9dd93cb9a => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:09.716595 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a22ee-f8eb-44d7-a872-24b1efa8d03e service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:09.729697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a22ee-f8eb-44d7-a872-24b1efa8d03e service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:09.768273 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:09.823666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af079420-6100-48b0-bb79-fd145c8db6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:09.824457 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af079420-6100-48b0-bb79-fd145c8db6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:09.824720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af079420-6100-48b0-bb79-fd145c8db6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:09.824930 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af079420-6100-48b0-bb79-fd145c8db6f1 admin admin] PATH_INFO: `/v3/users/f03ecf220a6a4dd1b1564ef46d018919` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:09.826397 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af079420-6100-48b0-bb79-fd145c8db6f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f03ecf220a6a4dd1b1564ef46d018919)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:09.828369 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af079420-6100-48b0-bb79-fd145c8db6f1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:10.102384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-af079420-6100-48b0-bb79-fd145c8db6f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f03ecf220a6a4dd1b1564ef46d018919'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:10.103050 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-af079420-6100-48b0-bb79-fd145c8db6f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f03ecf220a6a4dd1b1564ef46d018919'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:10.103657 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-af079420-6100-48b0-bb79-fd145c8db6f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f03ecf220a6a4dd1b1564ef46d018919'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:10.110941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-af079420-6100-48b0-bb79-fd145c8db6f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f03ecf220a6a4dd1b1564ef46d018919'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:10.123792 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-af079420-6100-48b0-bb79-fd145c8db6f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f03ecf220a6a4dd1b1564ef46d018919'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:10.209348 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1330/2659] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:09 2022] DELETE /identity/v3/users/f03ecf220a6a4dd1b1564ef46d018919 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:10.659084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:10.660762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:10.683165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350649b-7e1d-4310-a331-656e77f4549f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:10.755720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ffb55b-4692-4a76-8815-40bc1b5471b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:10.756309 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffb55b-4692-4a76-8815-40bc1b5471b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:10.756588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffb55b-4692-4a76-8815-40bc1b5471b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:10.756860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ffb55b-4692-4a76-8815-40bc1b5471b4 admin admin] PATH_INFO: `/v3/projects/c3c00a1d8c5d4057a9d694a6b87ab67d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:10.757982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffb55b-4692-4a76-8815-40bc1b5471b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c00a1d8c5d4057a9d694a6b87ab67d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:10.759998 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ffb55b-4692-4a76-8815-40bc1b5471b4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:10.931212 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:10.935345 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101472db-7362-4dc5-91b1-09f4313aaba4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:10.937476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101472db-7362-4dc5-91b1-09f4313aaba4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:10.937476 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101472db-7362-4dc5-91b1-09f4313aaba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:10.943664 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72ffb55b-4692-4a76-8815-40bc1b5471b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c00a1d8c5d4057a9d694a6b87ab67d', 'request_id': 'req-72ffb55b-4692-4a76-8815-40bc1b5471b4'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:10.952275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72ffb55b-4692-4a76-8815-40bc1b5471b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c00a1d8c5d4057a9d694a6b87ab67d', 'request_id': 'req-72ffb55b-4692-4a76-8815-40bc1b5471b4'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:10.958065 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-101472db-7362-4dc5-91b1-09f4313aaba4 None None] MFA Rules not processed for user `f8551bbc736a479593785a2772ba10bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:10.959346 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-101472db-7362-4dc5-91b1-09f4313aaba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:10.959689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72ffb55b-4692-4a76-8815-40bc1b5471b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c00a1d8c5d4057a9d694a6b87ab67d', 'request_id': 'req-72ffb55b-4692-4a76-8815-40bc1b5471b4'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:11.025671 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1331/2660] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:11.075410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72ffb55b-4692-4a76-8815-40bc1b5471b4 admin admin] The token cache is being invalidate because project c3c00a1d8c5d4057a9d694a6b87ab67d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:11.076182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72ffb55b-4692-4a76-8815-40bc1b5471b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:11.077415 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72ffb55b-4692-4a76-8815-40bc1b5471b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:11.079563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1330/2661] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:10 2022] DELETE /identity/v3/projects/c3c00a1d8c5d4057a9d694a6b87ab67d => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:11.085023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f921bce-6c44-427d-9237-a9ed8a27cbd5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:11.085317 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f921bce-6c44-427d-9237-a9ed8a27cbd5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:11.085597 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f921bce-6c44-427d-9237-a9ed8a27cbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:11.110696 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-2f921bce-6c44-427d-9237-a9ed8a27cbd5 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:11.112249 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-2f921bce-6c44-427d-9237-a9ed8a27cbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:11.164703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:11.177514 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1332/2662] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:11.187547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971985ca-06dc-4c83-af03-474436ab53c6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:11.187831 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971985ca-06dc-4c83-af03-474436ab53c6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:11.188140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971985ca-06dc-4c83-af03-474436ab53c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:11.209431 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-971985ca-06dc-4c83-af03-474436ab53c6 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:11.210656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-971985ca-06dc-4c83-af03-474436ab53c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:11.219582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1331/2663] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:11.224319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f921bce-6c44-427d-9237-a9ed8a27cbd5 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:11.234721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f921bce-6c44-427d-9237-a9ed8a27cbd5 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:11.240241 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9f845-fb65-4714-b91f-81bef890103f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:11.240378 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9f845-fb65-4714-b91f-81bef890103f admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:11.240657 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9f845-fb65-4714-b91f-81bef890103f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:11.240931 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac9f845-fb65-4714-b91f-81bef890103f admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:11.241620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9f845-fb65-4714-b91f-81bef890103f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:15:11.241987 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9f845-fb65-4714-b91f-81bef890103f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:11.243810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac9f845-fb65-4714-b91f-81bef890103f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:11.260814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1333/2664] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:15:11.262830 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971985ca-06dc-4c83-af03-474436ab53c6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:11.273157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971985ca-06dc-4c83-af03-474436ab53c6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:11.279547 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b759c-4170-46dc-a133-7ecadc389991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:11.280242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b759c-4170-46dc-a133-7ecadc389991 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:11.280595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b759c-4170-46dc-a133-7ecadc389991 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:11.280940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b759c-4170-46dc-a133-7ecadc389991 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:11.281689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b759c-4170-46dc-a133-7ecadc389991 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:11.283753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62b759c-4170-46dc-a133-7ecadc389991 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:11.377459 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1332/2665] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:11 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:11.382021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9f845-fb65-4714-b91f-81bef890103f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:11.393722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac9f845-fb65-4714-b91f-81bef890103f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:11.463546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d4e25-6c20-46ba-a405-4af78ae1a0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:11.464196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d4e25-6c20-46ba-a405-4af78ae1a0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:11.464477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d4e25-6c20-46ba-a405-4af78ae1a0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:11.464751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d4e25-6c20-46ba-a405-4af78ae1a0c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:11.465400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d4e25-6c20-46ba-a405-4af78ae1a0c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:11.467739 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d4e25-6c20-46ba-a405-4af78ae1a0c4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:11.557545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1334/2666] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:11 2022] POST /identity/v3/users => generated 293 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:11.562304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b759c-4170-46dc-a133-7ecadc389991 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:11.574545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62b759c-4170-46dc-a133-7ecadc389991 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:11.582093 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa4043-912f-4440-9c1c-7cabb297f4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:11.582709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa4043-912f-4440-9c1c-7cabb297f4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:11.582979 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa4043-912f-4440-9c1c-7cabb297f4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:11.583247 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fa4043-912f-4440-9c1c-7cabb297f4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:11.583922 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa4043-912f-4440-9c1c-7cabb297f4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:11.585551 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fa4043-912f-4440-9c1c-7cabb297f4c3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:11.596245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1333/2667] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:11.600541 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d4e25-6c20-46ba-a405-4af78ae1a0c4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:11.611348 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d4e25-6c20-46ba-a405-4af78ae1a0c4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:11.616108 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3556d79e-7046-4ab2-8e07-2b2123b8a485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:11.616710 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556d79e-7046-4ab2-8e07-2b2123b8a485 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:11.616990 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556d79e-7046-4ab2-8e07-2b2123b8a485 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:11.617263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3556d79e-7046-4ab2-8e07-2b2123b8a485 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:11.617900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556d79e-7046-4ab2-8e07-2b2123b8a485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:11.619485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3556d79e-7046-4ab2-8e07-2b2123b8a485 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:11.632598 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1335/2668] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:11.636900 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa4043-912f-4440-9c1c-7cabb297f4c3 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:11.648577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fa4043-912f-4440-9c1c-7cabb297f4c3 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:11.653776 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f222d-331f-40aa-b053-4a7b9cbaba78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:11.654233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f222d-331f-40aa-b053-4a7b9cbaba78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:11.654444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f222d-331f-40aa-b053-4a7b9cbaba78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:11.654709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f222d-331f-40aa-b053-4a7b9cbaba78 admin admin] PATH_INFO: `/v3/projects/72752fa021494ddc898b9f5169dcd53d/users/2fbe1fea3d204ccfa2205e7909829385/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:11.670677 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f222d-331f-40aa-b053-4a7b9cbaba78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72752fa021494ddc898b9f5169dcd53d, user_id=2fbe1fea3d204ccfa2205e7909829385, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:11.673350 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24f222d-331f-40aa-b053-4a7b9cbaba78 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:11.781268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1334/2669] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:11 2022] PUT /identity/v3/projects/72752fa021494ddc898b9f5169dcd53d/users/2fbe1fea3d204ccfa2205e7909829385/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:11.794954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bb14d-2fee-459a-8925-a3c0617508bf None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:11.794954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bb14d-2fee-459a-8925-a3c0617508bf None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:11.794954 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869bb14d-2fee-459a-8925-a3c0617508bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:11.825814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-869bb14d-2fee-459a-8925-a3c0617508bf None None] MFA Rules not processed for user `2fbe1fea3d204ccfa2205e7909829385`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:11.827348 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-869bb14d-2fee-459a-8925-a3c0617508bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:11.895837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1336/2670] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:11 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:11.900310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f222d-331f-40aa-b053-4a7b9cbaba78 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:11.962090 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f222d-331f-40aa-b053-4a7b9cbaba78 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:11.967135 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d378b-94d7-4731-924d-c52ea8623342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:11.967760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d378b-94d7-4731-924d-c52ea8623342 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:11.968124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d378b-94d7-4731-924d-c52ea8623342 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:11.968398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d378b-94d7-4731-924d-c52ea8623342 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:11.969035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d378b-94d7-4731-924d-c52ea8623342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:11.970912 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d378b-94d7-4731-924d-c52ea8623342 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:12.074398 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1335/2671] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:11 2022] POST /identity/v3/projects => generated 387 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:12.078964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bb14d-2fee-459a-8925-a3c0617508bf None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:12.089860 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869bb14d-2fee-459a-8925-a3c0617508bf None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:12.137012 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:12.149847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b852a-abdd-4e43-bc5a-29551412a579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:12.150466 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b852a-abdd-4e43-bc5a-29551412a579 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:12.150746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b852a-abdd-4e43-bc5a-29551412a579 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:12.151005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b852a-abdd-4e43-bc5a-29551412a579 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:12.151623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b852a-abdd-4e43-bc5a-29551412a579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:12.154195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590b852a-abdd-4e43-bc5a-29551412a579 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:12.275208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1337/2672] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:12 2022] POST /identity/v3/users => generated 300 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:12.280152 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d378b-94d7-4731-924d-c52ea8623342 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:12.291758 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d378b-94d7-4731-924d-c52ea8623342 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:12.298339 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b1a76-6d5a-4718-aa8d-c197e109b47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:12.298954 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b1a76-6d5a-4718-aa8d-c197e109b47f admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:12.299347 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b1a76-6d5a-4718-aa8d-c197e109b47f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:12.299624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621b1a76-6d5a-4718-aa8d-c197e109b47f admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:12.300314 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b1a76-6d5a-4718-aa8d-c197e109b47f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:12.301895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621b1a76-6d5a-4718-aa8d-c197e109b47f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:12.314499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1336/2673] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:15:12.318730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b852a-abdd-4e43-bc5a-29551412a579 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:12.329482 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b852a-abdd-4e43-bc5a-29551412a579 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:12.334676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8de535-6c0c-4576-82d0-e9522b5472dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:12.335384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8de535-6c0c-4576-82d0-e9522b5472dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:12.335661 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8de535-6c0c-4576-82d0-e9522b5472dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:12.335966 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8de535-6c0c-4576-82d0-e9522b5472dd admin admin] PATH_INFO: `/v3/projects/435e17de93c34893a321bb60f6d6fa1a/users/74e4072d9293458fa0ee43be7d51d63e/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:12.352431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8de535-6c0c-4576-82d0-e9522b5472dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=435e17de93c34893a321bb60f6d6fa1a, user_id=74e4072d9293458fa0ee43be7d51d63e, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:12.355160 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8de535-6c0c-4576-82d0-e9522b5472dd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:12.468910 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1338/2674] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:12 2022] PUT /identity/v3/projects/435e17de93c34893a321bb60f6d6fa1a/users/74e4072d9293458fa0ee43be7d51d63e/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:12.472875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b1a76-6d5a-4718-aa8d-c197e109b47f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:12.484276 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621b1a76-6d5a-4718-aa8d-c197e109b47f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:12.511823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:12.544883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a37cf46-88a1-48d5-aef1-aae76fe4183d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:12.550133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37cf46-88a1-48d5-aef1-aae76fe4183d admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:12.550133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37cf46-88a1-48d5-aef1-aae76fe4183d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:12.550133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a37cf46-88a1-48d5-aef1-aae76fe4183d admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:12.550133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37cf46-88a1-48d5-aef1-aae76fe4183d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:12.550133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a37cf46-88a1-48d5-aef1-aae76fe4183d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:12.559374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1337/2675] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:12.563632 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8de535-6c0c-4576-82d0-e9522b5472dd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:12.574208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8de535-6c0c-4576-82d0-e9522b5472dd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:12.579601 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35940f6-2ea7-49d8-86a1-564371a141e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:12.580217 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35940f6-2ea7-49d8-86a1-564371a141e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:12.580495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35940f6-2ea7-49d8-86a1-564371a141e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:12.580766 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35940f6-2ea7-49d8-86a1-564371a141e7 admin admin] PATH_INFO: `/v3/projects/435e17de93c34893a321bb60f6d6fa1a/users/74e4072d9293458fa0ee43be7d51d63e/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:12.582692 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35940f6-2ea7-49d8-86a1-564371a141e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=435e17de93c34893a321bb60f6d6fa1a, user_id=74e4072d9293458fa0ee43be7d51d63e, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:12.585405 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35940f6-2ea7-49d8-86a1-564371a141e7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:12.596666 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1339/2676] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:12 2022] PUT /identity/v3/projects/435e17de93c34893a321bb60f6d6fa1a/users/74e4072d9293458fa0ee43be7d51d63e/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:12.607077 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7842acc-75fb-4446-8d41-8bfda7a80aa1 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:12.607358 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7842acc-75fb-4446-8d41-8bfda7a80aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:12.607632 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7842acc-75fb-4446-8d41-8bfda7a80aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:12.635238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-a7842acc-75fb-4446-8d41-8bfda7a80aa1 None None] MFA Rules not processed for user `74e4072d9293458fa0ee43be7d51d63e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:12.636689 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-a7842acc-75fb-4446-8d41-8bfda7a80aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:12.705388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1338/2677] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:12.717256 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35940f6-2ea7-49d8-86a1-564371a141e7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:12.718980 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a35940f6-2ea7-49d8-86a1-564371a141e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:12.780810 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35940f6-2ea7-49d8-86a1-564371a141e7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:12.785021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ceca7-3632-453d-86c4-c53d514873bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:12.785669 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ceca7-3632-453d-86c4-c53d514873bb service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:12.785978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ceca7-3632-453d-86c4-c53d514873bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:12.786223 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ceca7-3632-453d-86c4-c53d514873bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:12.796578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ceca7-3632-453d-86c4-c53d514873bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:12.798101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ceca7-3632-453d-86c4-c53d514873bb service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:12.808551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1340/2678] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:12.837126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7842acc-75fb-4446-8d41-8bfda7a80aa1 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:12.907528 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7842acc-75fb-4446-8d41-8bfda7a80aa1 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:12.912224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511c9c8-d48e-4a53-9b14-040b5c13f6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:12.912859 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511c9c8-d48e-4a53-9b14-040b5c13f6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:12.913140 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511c9c8-d48e-4a53-9b14-040b5c13f6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:12.913411 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5511c9c8-d48e-4a53-9b14-040b5c13f6a9 admin admin] PATH_INFO: `/v3/users/2fbe1fea3d204ccfa2205e7909829385` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:12.914589 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511c9c8-d48e-4a53-9b14-040b5c13f6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fbe1fea3d204ccfa2205e7909829385)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:12.916578 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5511c9c8-d48e-4a53-9b14-040b5c13f6a9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:13.076540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5511c9c8-d48e-4a53-9b14-040b5c13f6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fbe1fea3d204ccfa2205e7909829385'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:13.081533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:13.089608 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5511c9c8-d48e-4a53-9b14-040b5c13f6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fbe1fea3d204ccfa2205e7909829385'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:13.090275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5511c9c8-d48e-4a53-9b14-040b5c13f6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fbe1fea3d204ccfa2205e7909829385'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:13.091250 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5511c9c8-d48e-4a53-9b14-040b5c13f6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fbe1fea3d204ccfa2205e7909829385'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:13.104993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-5511c9c8-d48e-4a53-9b14-040b5c13f6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fbe1fea3d204ccfa2205e7909829385'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:13.189252 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1339/2679] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:12 2022] DELETE /identity/v3/users/2fbe1fea3d204ccfa2205e7909829385 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:13.194669 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9007d2-36e7-4ccb-8295-5d9bc7c60b2e None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:13.194669 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9007d2-36e7-4ccb-8295-5d9bc7c60b2e None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:13.195259 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9007d2-36e7-4ccb-8295-5d9bc7c60b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:13.214609 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-fb9007d2-36e7-4ccb-8295-5d9bc7c60b2e None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:13.216521 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fb9007d2-36e7-4ccb-8295-5d9bc7c60b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:13.281903 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1341/2680] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:13.291760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511c9c8-d48e-4a53-9b14-040b5c13f6a9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:13.293437 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5511c9c8-d48e-4a53-9b14-040b5c13f6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:13.354355 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5511c9c8-d48e-4a53-9b14-040b5c13f6a9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:13.358287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdb599-c2de-4aea-af8d-b0f229fbc25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:13.358893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdb599-c2de-4aea-af8d-b0f229fbc25d service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:13.359168 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdb599-c2de-4aea-af8d-b0f229fbc25d service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:13.359433 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdb599-c2de-4aea-af8d-b0f229fbc25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:13.369501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdb599-c2de-4aea-af8d-b0f229fbc25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:13.371337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdb599-c2de-4aea-af8d-b0f229fbc25d service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:13.384121 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1340/2681] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:15:13.892693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9007d2-36e7-4ccb-8295-5d9bc7c60b2e None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:13.894233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fb9007d2-36e7-4ccb-8295-5d9bc7c60b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:13.919431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9007d2-36e7-4ccb-8295-5d9bc7c60b2e None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:13.922956 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:13.923544 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:13.923822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:13.924166 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] PATH_INFO: `/v3/projects/72752fa021494ddc898b9f5169dcd53d` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:13.925312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] RBAC: Authorizing `identity:delete_project(project_id=72752fa021494ddc898b9f5169dcd53d)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:13.927254 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:14.081117 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:14.088551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72752fa021494ddc898b9f5169dcd53d', 'request_id': 'req-116ce1aa-05da-4bc8-925f-b4eb625ed46f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:14.095769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72752fa021494ddc898b9f5169dcd53d', 'request_id': 'req-116ce1aa-05da-4bc8-925f-b4eb625ed46f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:14.193426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72752fa021494ddc898b9f5169dcd53d', 'request_id': 'req-116ce1aa-05da-4bc8-925f-b4eb625ed46f'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:14.205716 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] The token cache is being invalidate because project 72752fa021494ddc898b9f5169dcd53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:14.206405 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:14.207125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:14.208459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1342/2682] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:13 2022] DELETE /identity/v3/projects/72752fa021494ddc898b9f5169dcd53d => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:14.212760 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdb599-c2de-4aea-af8d-b0f229fbc25d service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:14.223291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdb599-c2de-4aea-af8d-b0f229fbc25d service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:14.290600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18dd89-69c3-4e24-a208-c7ccdd19788d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:14.290600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18dd89-69c3-4e24-a208-c7ccdd19788d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:14.291114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18dd89-69c3-4e24-a208-c7ccdd19788d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:14.291114 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18dd89-69c3-4e24-a208-c7ccdd19788d admin admin] PATH_INFO: `/v3/users/74e4072d9293458fa0ee43be7d51d63e` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:14.292454 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18dd89-69c3-4e24-a208-c7ccdd19788d admin admin] RBAC: Authorizing `identity:delete_user(user_id=74e4072d9293458fa0ee43be7d51d63e)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:14.295030 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18dd89-69c3-4e24-a208-c7ccdd19788d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:14.504344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7f18dd89-69c3-4e24-a208-c7ccdd19788d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74e4072d9293458fa0ee43be7d51d63e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:14.517177 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7f18dd89-69c3-4e24-a208-c7ccdd19788d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74e4072d9293458fa0ee43be7d51d63e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:14.517890 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7f18dd89-69c3-4e24-a208-c7ccdd19788d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74e4072d9293458fa0ee43be7d51d63e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:14.518501 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7f18dd89-69c3-4e24-a208-c7ccdd19788d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74e4072d9293458fa0ee43be7d51d63e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:14.527229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-7f18dd89-69c3-4e24-a208-c7ccdd19788d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74e4072d9293458fa0ee43be7d51d63e'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:14.530504 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:14.633363 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1341/2683] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:14 2022] DELETE /identity/v3/users/74e4072d9293458fa0ee43be7d51d63e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:15.219140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:15.220782 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:15.236120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116ce1aa-05da-4bc8-925f-b4eb625ed46f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:15.298211 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361725d0-883c-4e93-9ab5-9774cc9ce63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:15.298861 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361725d0-883c-4e93-9ab5-9774cc9ce63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:15.299153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361725d0-883c-4e93-9ab5-9774cc9ce63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:15.299418 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361725d0-883c-4e93-9ab5-9774cc9ce63c admin admin] PATH_INFO: `/v3/projects/435e17de93c34893a321bb60f6d6fa1a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:15.300738 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361725d0-883c-4e93-9ab5-9774cc9ce63c admin admin] RBAC: Authorizing `identity:delete_project(project_id=435e17de93c34893a321bb60f6d6fa1a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:15.302634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361725d0-883c-4e93-9ab5-9774cc9ce63c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:15.435532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-361725d0-883c-4e93-9ab5-9774cc9ce63c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '435e17de93c34893a321bb60f6d6fa1a', 'request_id': 'req-361725d0-883c-4e93-9ab5-9774cc9ce63c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:15.442056 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-361725d0-883c-4e93-9ab5-9774cc9ce63c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '435e17de93c34893a321bb60f6d6fa1a', 'request_id': 'req-361725d0-883c-4e93-9ab5-9774cc9ce63c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:15.518339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-361725d0-883c-4e93-9ab5-9774cc9ce63c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '435e17de93c34893a321bb60f6d6fa1a', 'request_id': 'req-361725d0-883c-4e93-9ab5-9774cc9ce63c'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:15.530957 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-361725d0-883c-4e93-9ab5-9774cc9ce63c admin admin] The token cache is being invalidate because project 435e17de93c34893a321bb60f6d6fa1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:15.531169 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-361725d0-883c-4e93-9ab5-9774cc9ce63c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:15.531818 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-361725d0-883c-4e93-9ab5-9774cc9ce63c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:15.533384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1343/2684] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:15 2022] DELETE /identity/v3/projects/435e17de93c34893a321bb60f6d6fa1a => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:15.538374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb3bc2-225c-4c58-8ab3-7d0a3deba5cc None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:15.538894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb3bc2-225c-4c58-8ab3-7d0a3deba5cc None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:15.538894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb3bc2-225c-4c58-8ab3-7d0a3deba5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:15.560685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-97eb3bc2-225c-4c58-8ab3-7d0a3deba5cc None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:15.561973 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-97eb3bc2-225c-4c58-8ab3-7d0a3deba5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:15.625797 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1342/2685] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:15.634636 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f291-1c09-4b86-8d49-3d39cf1deb1f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:15.634852 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f291-1c09-4b86-8d49-3d39cf1deb1f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:15.635127 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c8f291-1c09-4b86-8d49-3d39cf1deb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:15.656720 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c4c8f291-1c09-4b86-8d49-3d39cf1deb1f None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:15.657928 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c4c8f291-1c09-4b86-8d49-3d39cf1deb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:15.666227 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1344/2686] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:15.671080 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb3bc2-225c-4c58-8ab3-7d0a3deba5cc None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:15.680993 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb3bc2-225c-4c58-8ab3-7d0a3deba5cc None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:15.686763 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6ceb1-64dd-47ba-b72e-cf5e4f56f94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:15.687416 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6ceb1-64dd-47ba-b72e-cf5e4f56f94d admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:15.687694 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6ceb1-64dd-47ba-b72e-cf5e4f56f94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:15.688082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6ceb1-64dd-47ba-b72e-cf5e4f56f94d admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:15.688721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6ceb1-64dd-47ba-b72e-cf5e4f56f94d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:15:15.693634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6ceb1-64dd-47ba-b72e-cf5e4f56f94d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:15.693634 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d6ceb1-64dd-47ba-b72e-cf5e4f56f94d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:15.704157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1343/2687] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 08:15:15.708694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8f291-1c09-4b86-8d49-3d39cf1deb1f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:15.718363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c8f291-1c09-4b86-8d49-3d39cf1deb1f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:15.723000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a6987-c3be-40f1-b426-472947c14c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:15.723607 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6987-c3be-40f1-b426-472947c14c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:15.723927 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6987-c3be-40f1-b426-472947c14c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:15.724209 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6987-c3be-40f1-b426-472947c14c52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:15.724925 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a6987-c3be-40f1-b426-472947c14c52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:15.726814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a6987-c3be-40f1-b426-472947c14c52 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:15.852322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1345/2688] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:15 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:15:15.857160 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6ceb1-64dd-47ba-b72e-cf5e4f56f94d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:15.867795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d6ceb1-64dd-47ba-b72e-cf5e4f56f94d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:15.930163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e917111-edd5-4ff5-92ca-80e26f907f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:15.930808 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e917111-edd5-4ff5-92ca-80e26f907f20 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:15.931086 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e917111-edd5-4ff5-92ca-80e26f907f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:15.931356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e917111-edd5-4ff5-92ca-80e26f907f20 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:15.932058 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e917111-edd5-4ff5-92ca-80e26f907f20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:15.934834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e917111-edd5-4ff5-92ca-80e26f907f20 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:16.009417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1344/2689] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:15 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:16.010887 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a6987-c3be-40f1-b426-472947c14c52 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:16.024115 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a6987-c3be-40f1-b426-472947c14c52 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:16.030805 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ed67e-f668-453d-80b2-6f2d08f5fd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:16.031690 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ed67e-f668-453d-80b2-6f2d08f5fd52 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:16.032166 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ed67e-f668-453d-80b2-6f2d08f5fd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:16.032449 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ed67e-f668-453d-80b2-6f2d08f5fd52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:16.033367 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ed67e-f668-453d-80b2-6f2d08f5fd52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:16.034702 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ed67e-f668-453d-80b2-6f2d08f5fd52 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:16.047424 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1346/2690] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:16.051155 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e917111-edd5-4ff5-92ca-80e26f907f20 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:16.070638 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e917111-edd5-4ff5-92ca-80e26f907f20 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:16.077824 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6e055c-911e-4ffc-aa0e-8ded7726e830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:16.078446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e055c-911e-4ffc-aa0e-8ded7726e830 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:16.078721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e055c-911e-4ffc-aa0e-8ded7726e830 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:16.079044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6e055c-911e-4ffc-aa0e-8ded7726e830 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:16.079690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e055c-911e-4ffc-aa0e-8ded7726e830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:16.081327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6e055c-911e-4ffc-aa0e-8ded7726e830 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:16.094777 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1345/2691] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:16.099101 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ed67e-f668-453d-80b2-6f2d08f5fd52 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:16.111320 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ed67e-f668-453d-80b2-6f2d08f5fd52 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:16.117011 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88102e98-fd5a-42c3-9c98-de469747d452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:16.117909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88102e98-fd5a-42c3-9c98-de469747d452 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:16.118191 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88102e98-fd5a-42c3-9c98-de469747d452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:16.118462 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88102e98-fd5a-42c3-9c98-de469747d452 admin admin] PATH_INFO: `/v3/projects/7a8573b231a74b7bb13d0de61eddbdb3/users/446512c54036480c900f45536f69615f/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:16.135278 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88102e98-fd5a-42c3-9c98-de469747d452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a8573b231a74b7bb13d0de61eddbdb3, user_id=446512c54036480c900f45536f69615f, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:16.138651 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88102e98-fd5a-42c3-9c98-de469747d452 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:16.141003 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:16.240027 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1347/2692] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:16 2022] PUT /identity/v3/projects/7a8573b231a74b7bb13d0de61eddbdb3/users/446512c54036480c900f45536f69615f/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:16.251176 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cd9a8-299e-4296-a414-c11f7f5354fa None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:16.251494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cd9a8-299e-4296-a414-c11f7f5354fa None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:16.251734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cd9a8-299e-4296-a414-c11f7f5354fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:16.284151 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f44cd9a8-299e-4296-a414-c11f7f5354fa None None] MFA Rules not processed for user `446512c54036480c900f45536f69615f`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:16.285388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f44cd9a8-299e-4296-a414-c11f7f5354fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:16.350320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:16.373032 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1346/2693] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:16 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:16.377455 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88102e98-fd5a-42c3-9c98-de469747d452 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:16.446003 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88102e98-fd5a-42c3-9c98-de469747d452 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:16.453028 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bcb6c-47b0-4ac8-88e6-a9cb67e7f2d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:16.453730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bcb6c-47b0-4ac8-88e6-a9cb67e7f2d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:16.454086 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bcb6c-47b0-4ac8-88e6-a9cb67e7f2d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:16.454258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512bcb6c-47b0-4ac8-88e6-a9cb67e7f2d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:16.454892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bcb6c-47b0-4ac8-88e6-a9cb67e7f2d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:16.456918 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512bcb6c-47b0-4ac8-88e6-a9cb67e7f2d3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:16.568969 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1348/2694] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:16 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:16.570180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cd9a8-299e-4296-a414-c11f7f5354fa None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:16.583473 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cd9a8-299e-4296-a414-c11f7f5354fa None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:16.644350 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2794f8-bfe0-4110-b73f-d64a78802e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:16.644957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2794f8-bfe0-4110-b73f-d64a78802e08 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:16.645243 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2794f8-bfe0-4110-b73f-d64a78802e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:16.645517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2794f8-bfe0-4110-b73f-d64a78802e08 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:16.646139 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2794f8-bfe0-4110-b73f-d64a78802e08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:16.648067 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2794f8-bfe0-4110-b73f-d64a78802e08 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:16.740154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1347/2695] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:16 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:16.741547 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bcb6c-47b0-4ac8-88e6-a9cb67e7f2d3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:16.751994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512bcb6c-47b0-4ac8-88e6-a9cb67e7f2d3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:16.756771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5f18b-d73e-4fdc-8bea-6a96815ae83d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:16.757500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f18b-d73e-4fdc-8bea-6a96815ae83d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:16.758061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f18b-d73e-4fdc-8bea-6a96815ae83d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:16.758336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5f18b-d73e-4fdc-8bea-6a96815ae83d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:16.758984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5f18b-d73e-4fdc-8bea-6a96815ae83d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:16.760624 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5f18b-d73e-4fdc-8bea-6a96815ae83d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:16.772183 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1349/2696] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:16.776544 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2794f8-bfe0-4110-b73f-d64a78802e08 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:16.787410 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2794f8-bfe0-4110-b73f-d64a78802e08 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:16.793003 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849afdc-649f-4966-a620-11b7a36ad1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:16.793227 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849afdc-649f-4966-a620-11b7a36ad1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:16.793429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849afdc-649f-4966-a620-11b7a36ad1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:16.794365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8849afdc-649f-4966-a620-11b7a36ad1a9 admin admin] PATH_INFO: `/v3/projects/f3717de09b154c0bada603e5fd6092c2/users/5da834670fc546319e7b3c10cf0d3bdd/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:16.810872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849afdc-649f-4966-a620-11b7a36ad1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3717de09b154c0bada603e5fd6092c2, user_id=5da834670fc546319e7b3c10cf0d3bdd, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:16.814533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8849afdc-649f-4966-a620-11b7a36ad1a9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:16.921016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1348/2697] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:16 2022] PUT /identity/v3/projects/f3717de09b154c0bada603e5fd6092c2/users/5da834670fc546319e7b3c10cf0d3bdd/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:16.924997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5f18b-d73e-4fdc-8bea-6a96815ae83d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:16.935532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5f18b-d73e-4fdc-8bea-6a96815ae83d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:16.993422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be77058c-2bd9-4526-ada6-dc873adf2deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:16.993949 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77058c-2bd9-4526-ada6-dc873adf2deb admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:16.994231 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77058c-2bd9-4526-ada6-dc873adf2deb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:16.994503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be77058c-2bd9-4526-ada6-dc873adf2deb admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:16.995140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77058c-2bd9-4526-ada6-dc873adf2deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:16.996789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be77058c-2bd9-4526-ada6-dc873adf2deb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:17.006967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1350/2698] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:17.016549 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849afdc-649f-4966-a620-11b7a36ad1a9 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:17.026896 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8849afdc-649f-4966-a620-11b7a36ad1a9 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:17.032203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88a94a-9dd0-40d6-9c95-b5804d5068e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:17.032844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a94a-9dd0-40d6-9c95-b5804d5068e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:17.033119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a94a-9dd0-40d6-9c95-b5804d5068e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:17.033386 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c88a94a-9dd0-40d6-9c95-b5804d5068e1 admin admin] PATH_INFO: `/v3/projects/f3717de09b154c0bada603e5fd6092c2/users/5da834670fc546319e7b3c10cf0d3bdd/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:17.035289 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88a94a-9dd0-40d6-9c95-b5804d5068e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3717de09b154c0bada603e5fd6092c2, user_id=5da834670fc546319e7b3c10cf0d3bdd, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:17.037927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c88a94a-9dd0-40d6-9c95-b5804d5068e1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:17.048057 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1349/2699] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:17 2022] PUT /identity/v3/projects/f3717de09b154c0bada603e5fd6092c2/users/5da834670fc546319e7b3c10cf0d3bdd/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:17.058466 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052c1a5-38fa-4445-bd6b-c58b34393477 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:17.058757 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052c1a5-38fa-4445-bd6b-c58b34393477 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:17.059055 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e052c1a5-38fa-4445-bd6b-c58b34393477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:17.087575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e052c1a5-38fa-4445-bd6b-c58b34393477 None None] MFA Rules not processed for user `5da834670fc546319e7b3c10cf0d3bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:17.088832 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e052c1a5-38fa-4445-bd6b-c58b34393477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:17.144492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:17.163077 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1351/2700] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:17.185706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88a94a-9dd0-40d6-9c95-b5804d5068e1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:17.187541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6c88a94a-9dd0-40d6-9c95-b5804d5068e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:17.249588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c88a94a-9dd0-40d6-9c95-b5804d5068e1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:17.253371 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4d1dc-798c-4a71-ae71-5af76405231e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:17.253982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4d1dc-798c-4a71-ae71-5af76405231e service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:17.254261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4d1dc-798c-4a71-ae71-5af76405231e service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:17.254530 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4d1dc-798c-4a71-ae71-5af76405231e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:17.264248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4d1dc-798c-4a71-ae71-5af76405231e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:17.265683 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4d1dc-798c-4a71-ae71-5af76405231e service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:17.275162 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1350/2701] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:18.059604 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052c1a5-38fa-4445-bd6b-c58b34393477 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:18.059604 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e052c1a5-38fa-4445-bd6b-c58b34393477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:18.125623 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e052c1a5-38fa-4445-bd6b-c58b34393477 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:18.129544 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed69e7-6973-48a9-a824-61e3d392292b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:18.130337 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed69e7-6973-48a9-a824-61e3d392292b service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:18.130727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed69e7-6973-48a9-a824-61e3d392292b service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:18.131013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed69e7-6973-48a9-a824-61e3d392292b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:18.132985 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-45ed69e7-6973-48a9-a824-61e3d392292b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:18.201373 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed69e7-6973-48a9-a824-61e3d392292b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:18.202822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed69e7-6973-48a9-a824-61e3d392292b service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:18.213264 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1352/2702] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:18.255833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4d1dc-798c-4a71-ae71-5af76405231e service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:18.267592 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4d1dc-798c-4a71-ae71-5af76405231e service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:18.279526 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09683974-ef13-45c2-827c-0499250b5b76 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5da834670fc546319e7b3c10cf0d3bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3717de09b154c0bada603e5fd6092c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:18.280631 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09683974-ef13-45c2-827c-0499250b5b76 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:18.281227 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09683974-ef13-45c2-827c-0499250b5b76 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:18.281599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09683974-ef13-45c2-827c-0499250b5b76 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:18.283420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09683974-ef13-45c2-827c-0499250b5b76 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:15:18.283823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09683974-ef13-45c2-827c-0499250b5b76 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:18.285719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09683974-ef13-45c2-827c-0499250b5b76 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:18.301763 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1351/2703] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:15:18.306134 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed69e7-6973-48a9-a824-61e3d392292b service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:18.318556 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed69e7-6973-48a9-a824-61e3d392292b service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:18.323436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b912cfa-0470-4ff9-a8d6-ad83f2682241 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5da834670fc546319e7b3c10cf0d3bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3717de09b154c0bada603e5fd6092c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:18.324318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b912cfa-0470-4ff9-a8d6-ad83f2682241 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:18.324756 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b912cfa-0470-4ff9-a8d6-ad83f2682241 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:18.325218 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b912cfa-0470-4ff9-a8d6-ad83f2682241 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:18.325868 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b912cfa-0470-4ff9-a8d6-ad83f2682241 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:18.327861 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b912cfa-0470-4ff9-a8d6-ad83f2682241 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:18.502018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1353/2704] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:18 2022] POST /identity/v3/projects => generated 353 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:18.506366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09683974-ef13-45c2-827c-0499250b5b76 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:18.517389 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09683974-ef13-45c2-827c-0499250b5b76 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:18.545021 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:18.594761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aff6fd-2447-457f-85ef-cc0c5d3e3ee3 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5da834670fc546319e7b3c10cf0d3bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3717de09b154c0bada603e5fd6092c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:18.605432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aff6fd-2447-457f-85ef-cc0c5d3e3ee3 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:18.605432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aff6fd-2447-457f-85ef-cc0c5d3e3ee3 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:18.605432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aff6fd-2447-457f-85ef-cc0c5d3e3ee3 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:18.605432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aff6fd-2447-457f-85ef-cc0c5d3e3ee3 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:15:18.605432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aff6fd-2447-457f-85ef-cc0c5d3e3ee3 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:18.605906 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aff6fd-2447-457f-85ef-cc0c5d3e3ee3 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:18.615446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1352/2705] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:15:18.656918 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b912cfa-0470-4ff9-a8d6-ad83f2682241 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:18.670370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b912cfa-0470-4ff9-a8d6-ad83f2682241 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:18.675552 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5da834670fc546319e7b3c10cf0d3bdd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f3717de09b154c0bada603e5fd6092c2', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:18.676668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:18.677056 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:18.677429 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] PATH_INFO: `/v3/projects/ea68c9943e23436eb4d409c426295e2e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:18.678755 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ea68c9943e23436eb4d409c426295e2e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:18.680858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:18.793208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea68c9943e23436eb4d409c426295e2e', 'request_id': 'req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:18.806120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea68c9943e23436eb4d409c426295e2e', 'request_id': 'req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:18.866978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea68c9943e23436eb4d409c426295e2e', 'request_id': 'req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:18.881655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] The token cache is being invalidate because project ea68c9943e23436eb4d409c426295e2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:18.882281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:18.883452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-34ee4f14-cb3f-4d6a-99fb-55c27b4fb02a tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:18.885283 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1354/2706] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:18 2022] DELETE /identity/v3/projects/ea68c9943e23436eb4d409c426295e2e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:19.730668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aff6fd-2447-457f-85ef-cc0c5d3e3ee3 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:19.733503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e8aff6fd-2447-457f-85ef-cc0c5d3e3ee3 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:19.889518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aff6fd-2447-457f-85ef-cc0c5d3e3ee3 tempest-VolumeQuotaClassesTest-1384654886 tempest-VolumeQuotaClassesTest-1384654886-project-admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:19.983225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610178f-8b39-4939-9206-427f1e60958d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:19.984446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610178f-8b39-4939-9206-427f1e60958d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:19.984906 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610178f-8b39-4939-9206-427f1e60958d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:19.989743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4610178f-8b39-4939-9206-427f1e60958d admin admin] PATH_INFO: `/v3/users/446512c54036480c900f45536f69615f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:19.989743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610178f-8b39-4939-9206-427f1e60958d admin admin] RBAC: Authorizing `identity:delete_user(user_id=446512c54036480c900f45536f69615f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:19.989743 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4610178f-8b39-4939-9206-427f1e60958d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:20.254749 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4610178f-8b39-4939-9206-427f1e60958d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '446512c54036480c900f45536f69615f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:20.271164 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4610178f-8b39-4939-9206-427f1e60958d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '446512c54036480c900f45536f69615f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:20.272348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4610178f-8b39-4939-9206-427f1e60958d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '446512c54036480c900f45536f69615f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:20.273327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4610178f-8b39-4939-9206-427f1e60958d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '446512c54036480c900f45536f69615f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:20.279690 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:20.282550 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-4610178f-8b39-4939-9206-427f1e60958d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '446512c54036480c900f45536f69615f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:20.451562 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1353/2707] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:19 2022] DELETE /identity/v3/users/446512c54036480c900f45536f69615f => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:20.456524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575a77b-4986-4376-b627-a8c60a8e4a42 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:20.457387 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575a77b-4986-4376-b627-a8c60a8e4a42 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:20.457670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575a77b-4986-4376-b627-a8c60a8e4a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:20.466881 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:20.482380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c575a77b-4986-4376-b627-a8c60a8e4a42 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:20.483659 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c575a77b-4986-4376-b627-a8c60a8e4a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:20.558653 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1355/2708] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:20.569375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610178f-8b39-4939-9206-427f1e60958d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:20.574895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4610178f-8b39-4939-9206-427f1e60958d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:20.659431 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4610178f-8b39-4939-9206-427f1e60958d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:20.664400 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9349d0-57e4-49b3-82a6-a5dead7a5617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:20.665032 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9349d0-57e4-49b3-82a6-a5dead7a5617 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:20.665311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9349d0-57e4-49b3-82a6-a5dead7a5617 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:20.665810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9349d0-57e4-49b3-82a6-a5dead7a5617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:20.681210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9349d0-57e4-49b3-82a6-a5dead7a5617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:20.681210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9349d0-57e4-49b3-82a6-a5dead7a5617 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:20.692753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1354/2709] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:21.274024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575a77b-4986-4376-b627-a8c60a8e4a42 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:21.276063 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c575a77b-4986-4376-b627-a8c60a8e4a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:21.291788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575a77b-4986-4376-b627-a8c60a8e4a42 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:21.303200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:21.311791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:21.311791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:21.311791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] PATH_INFO: `/v3/projects/7a8573b231a74b7bb13d0de61eddbdb3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:21.311791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a8573b231a74b7bb13d0de61eddbdb3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:21.311791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:21.504715 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a8573b231a74b7bb13d0de61eddbdb3', 'request_id': 'req-fdd3e0f9-bd6e-4486-85db-486edadd2294'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:21.512870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a8573b231a74b7bb13d0de61eddbdb3', 'request_id': 'req-fdd3e0f9-bd6e-4486-85db-486edadd2294'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:21.610496 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a8573b231a74b7bb13d0de61eddbdb3', 'request_id': 'req-fdd3e0f9-bd6e-4486-85db-486edadd2294'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:21.623493 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] The token cache is being invalidate because project 7a8573b231a74b7bb13d0de61eddbdb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:21.623909 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:21.624727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:21.626434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1356/2710] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:21 2022] DELETE /identity/v3/projects/7a8573b231a74b7bb13d0de61eddbdb3 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:21.630569 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9349d0-57e4-49b3-82a6-a5dead7a5617 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:21.641019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9349d0-57e4-49b3-82a6-a5dead7a5617 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:21.713194 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6cb3e0-884c-4692-8752-f3944ad4f43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:21.713863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cb3e0-884c-4692-8752-f3944ad4f43e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:21.714144 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cb3e0-884c-4692-8752-f3944ad4f43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:21.714413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6cb3e0-884c-4692-8752-f3944ad4f43e admin admin] PATH_INFO: `/v3/users/5da834670fc546319e7b3c10cf0d3bdd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:21.715665 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cb3e0-884c-4692-8752-f3944ad4f43e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5da834670fc546319e7b3c10cf0d3bdd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:21.717882 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6cb3e0-884c-4692-8752-f3944ad4f43e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:21.978349 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb6cb3e0-884c-4692-8752-f3944ad4f43e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5da834670fc546319e7b3c10cf0d3bdd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:21.992020 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb6cb3e0-884c-4692-8752-f3944ad4f43e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5da834670fc546319e7b3c10cf0d3bdd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:21.992770 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb6cb3e0-884c-4692-8752-f3944ad4f43e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5da834670fc546319e7b3c10cf0d3bdd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:21.993370 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb6cb3e0-884c-4692-8752-f3944ad4f43e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5da834670fc546319e7b3c10cf0d3bdd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:22.001417 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cb6cb3e0-884c-4692-8752-f3944ad4f43e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5da834670fc546319e7b3c10cf0d3bdd'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:22.147110 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1355/2711] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:21 2022] DELETE /identity/v3/users/5da834670fc546319e7b3c10cf0d3bdd => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:22.704198 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:22.706450 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:22.727591 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3e0f9-bd6e-4486-85db-486edadd2294 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:22.824384 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878bbdc5-5db0-4785-acf1-7fd583889b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:22.825444 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bbdc5-5db0-4785-acf1-7fd583889b35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:22.826186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bbdc5-5db0-4785-acf1-7fd583889b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:22.826186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878bbdc5-5db0-4785-acf1-7fd583889b35 admin admin] PATH_INFO: `/v3/projects/f3717de09b154c0bada603e5fd6092c2` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:22.827295 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bbdc5-5db0-4785-acf1-7fd583889b35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3717de09b154c0bada603e5fd6092c2)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:22.829303 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878bbdc5-5db0-4785-acf1-7fd583889b35 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:22.982983 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:22.995568 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-878bbdc5-5db0-4785-acf1-7fd583889b35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3717de09b154c0bada603e5fd6092c2', 'request_id': 'req-878bbdc5-5db0-4785-acf1-7fd583889b35'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:23.004758 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-878bbdc5-5db0-4785-acf1-7fd583889b35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3717de09b154c0bada603e5fd6092c2', 'request_id': 'req-878bbdc5-5db0-4785-acf1-7fd583889b35'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:23.124432 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-878bbdc5-5db0-4785-acf1-7fd583889b35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3717de09b154c0bada603e5fd6092c2', 'request_id': 'req-878bbdc5-5db0-4785-acf1-7fd583889b35'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:23.137919 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-878bbdc5-5db0-4785-acf1-7fd583889b35 admin admin] The token cache is being invalidate because project f3717de09b154c0bada603e5fd6092c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:23.138319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-878bbdc5-5db0-4785-acf1-7fd583889b35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:23.139091 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-878bbdc5-5db0-4785-acf1-7fd583889b35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:23.140646 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1357/2712] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:22 2022] DELETE /identity/v3/projects/f3717de09b154c0bada603e5fd6092c2 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:23.145552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3028e-57ab-4f97-a7da-634a486a31da None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:23.146029 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3028e-57ab-4f97-a7da-634a486a31da None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:23.146127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b3028e-57ab-4f97-a7da-634a486a31da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:23.166278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-40b3028e-57ab-4f97-a7da-634a486a31da None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:23.167482 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-40b3028e-57ab-4f97-a7da-634a486a31da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:23.174498 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:23.232475 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1356/2713] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:23.240436 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c2920-58ba-4f1b-bee4-a1c59c03ef0f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:23.240762 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c2920-58ba-4f1b-bee4-a1c59c03ef0f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:23.241098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c2920-58ba-4f1b-bee4-a1c59c03ef0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:23.262939 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f18c2920-58ba-4f1b-bee4-a1c59c03ef0f None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:23.264399 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f18c2920-58ba-4f1b-bee4-a1c59c03ef0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:23.273651 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1358/2714] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:23.278801 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3028e-57ab-4f97-a7da-634a486a31da None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:23.289087 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b3028e-57ab-4f97-a7da-634a486a31da None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:23.294003 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900750c-7c0e-4787-8582-3b475a302cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:23.294643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900750c-7c0e-4787-8582-3b475a302cde admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:23.294919 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900750c-7c0e-4787-8582-3b475a302cde admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:23.295206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3900750c-7c0e-4787-8582-3b475a302cde admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:23.295864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900750c-7c0e-4787-8582-3b475a302cde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:15:23.296180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900750c-7c0e-4787-8582-3b475a302cde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:23.297769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3900750c-7c0e-4787-8582-3b475a302cde admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:23.309917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1357/2715] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:15:23.314942 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c2920-58ba-4f1b-bee4-a1c59c03ef0f None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:23.325801 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c2920-58ba-4f1b-bee4-a1c59c03ef0f None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:23.330677 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44730870-e1ec-4a9e-a0a5-66ff751d5b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:23.333379 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44730870-e1ec-4a9e-a0a5-66ff751d5b1f admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:23.333379 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44730870-e1ec-4a9e-a0a5-66ff751d5b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:23.333379 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44730870-e1ec-4a9e-a0a5-66ff751d5b1f admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:23.333379 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44730870-e1ec-4a9e-a0a5-66ff751d5b1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:23.334455 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44730870-e1ec-4a9e-a0a5-66ff751d5b1f admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:23.447086 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1359/2716] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:23 2022] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:23.457116 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900750c-7c0e-4787-8582-3b475a302cde admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:23.468171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3900750c-7c0e-4787-8582-3b475a302cde admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:23.532206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e6765-aba8-4f85-8cfc-89aedeb95aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:23.532894 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e6765-aba8-4f85-8cfc-89aedeb95aab admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:23.533173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e6765-aba8-4f85-8cfc-89aedeb95aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:23.533444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e6765-aba8-4f85-8cfc-89aedeb95aab admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:23.534084 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e6765-aba8-4f85-8cfc-89aedeb95aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:23.536087 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e6765-aba8-4f85-8cfc-89aedeb95aab admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:23.674677 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1358/2717] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:23 2022] POST /identity/v3/users => generated 282 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:23.678870 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44730870-e1ec-4a9e-a0a5-66ff751d5b1f admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:23.692288 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44730870-e1ec-4a9e-a0a5-66ff751d5b1f admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:23.698584 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9b747-305a-45ba-b61a-54fa5e56e424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:23.699165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9b747-305a-45ba-b61a-54fa5e56e424 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:23.699445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9b747-305a-45ba-b61a-54fa5e56e424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:23.700252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa9b747-305a-45ba-b61a-54fa5e56e424 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:23.701034 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9b747-305a-45ba-b61a-54fa5e56e424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:23.702862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa9b747-305a-45ba-b61a-54fa5e56e424 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:23.726790 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1360/2718] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:23.728653 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e6765-aba8-4f85-8cfc-89aedeb95aab admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:23.748770 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e6765-aba8-4f85-8cfc-89aedeb95aab admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:23.756137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469f2090-4411-44bd-8308-b1865c0e6a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:23.757180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f2090-4411-44bd-8308-b1865c0e6a22 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:23.757598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f2090-4411-44bd-8308-b1865c0e6a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:23.758015 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469f2090-4411-44bd-8308-b1865c0e6a22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:23.758970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f2090-4411-44bd-8308-b1865c0e6a22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:23.761778 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469f2090-4411-44bd-8308-b1865c0e6a22 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:23.775374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1359/2719] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:23.780979 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9b747-305a-45ba-b61a-54fa5e56e424 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:23.792410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa9b747-305a-45ba-b61a-54fa5e56e424 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:23.798408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeac70-474c-48fe-b0d2-782532637912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:23.799153 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeac70-474c-48fe-b0d2-782532637912 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:23.799441 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeac70-474c-48fe-b0d2-782532637912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:23.799721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beeac70-474c-48fe-b0d2-782532637912 admin admin] PATH_INFO: `/v3/projects/818f07449ed44bf2be66f272e8dd9a91/users/3b8fad5510df42aca7d84845456a6aee/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:23.824071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beeac70-474c-48fe-b0d2-782532637912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=818f07449ed44bf2be66f272e8dd9a91, user_id=3b8fad5510df42aca7d84845456a6aee, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:23.824071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beeac70-474c-48fe-b0d2-782532637912 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:23.919308 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1361/2720] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:23 2022] PUT /identity/v3/projects/818f07449ed44bf2be66f272e8dd9a91/users/3b8fad5510df42aca7d84845456a6aee/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:23.930970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c8f73-f483-4fe4-935b-06a44f30c920 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:23.930970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c8f73-f483-4fe4-935b-06a44f30c920 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:23.931318 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c8f73-f483-4fe4-935b-06a44f30c920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:23.963191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-3b0c8f73-f483-4fe4-935b-06a44f30c920 None None] MFA Rules not processed for user `3b8fad5510df42aca7d84845456a6aee`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:23.964406 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3b0c8f73-f483-4fe4-935b-06a44f30c920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:24.034568 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1360/2721] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:24.039803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeac70-474c-48fe-b0d2-782532637912 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:24.110502 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beeac70-474c-48fe-b0d2-782532637912 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:24.115566 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44122aed-fa53-4d95-a276-91c9325862e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:24.116253 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44122aed-fa53-4d95-a276-91c9325862e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:24.116532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44122aed-fa53-4d95-a276-91c9325862e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:24.116841 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44122aed-fa53-4d95-a276-91c9325862e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:24.117536 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44122aed-fa53-4d95-a276-91c9325862e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:24.119562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44122aed-fa53-4d95-a276-91c9325862e4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:24.237173 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1362/2722] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:24 2022] POST /identity/v3/projects => generated 367 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:24.240720 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c8f73-f483-4fe4-935b-06a44f30c920 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:24.252181 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0c8f73-f483-4fe4-935b-06a44f30c920 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:24.314598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d4797-a717-4a2d-b564-933ac87ff9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:24.315221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4797-a717-4a2d-b564-933ac87ff9b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:24.315503 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4797-a717-4a2d-b564-933ac87ff9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:24.315775 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d4797-a717-4a2d-b564-933ac87ff9b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:24.316500 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d4797-a717-4a2d-b564-933ac87ff9b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:24.318443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d4797-a717-4a2d-b564-933ac87ff9b5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:24.479327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1361/2723] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:24 2022] POST /identity/v3/users => generated 290 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:24.484620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44122aed-fa53-4d95-a276-91c9325862e4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:24.495280 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44122aed-fa53-4d95-a276-91c9325862e4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:24.500635 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c06c61-f42e-4ed6-b788-42bbe7326e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:24.504554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c06c61-f42e-4ed6-b788-42bbe7326e9a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:24.504554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c06c61-f42e-4ed6-b788-42bbe7326e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:24.504554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c06c61-f42e-4ed6-b788-42bbe7326e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:24.504554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c06c61-f42e-4ed6-b788-42bbe7326e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:24.504554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c06c61-f42e-4ed6-b788-42bbe7326e9a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:24.517818 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1363/2724] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:24.522274 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d4797-a717-4a2d-b564-933ac87ff9b5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:24.534044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d4797-a717-4a2d-b564-933ac87ff9b5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:24.539002 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc4830-079b-4fb4-8ced-09844dc6eee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:24.550459 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc4830-079b-4fb4-8ced-09844dc6eee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:24.550459 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc4830-079b-4fb4-8ced-09844dc6eee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:24.550459 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc4830-079b-4fb4-8ced-09844dc6eee5 admin admin] PATH_INFO: `/v3/projects/d668bf27c05b45a387555fc7158af29d/users/16b26a1851b049dc915fb49f005489b1/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:24.557181 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc4830-079b-4fb4-8ced-09844dc6eee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d668bf27c05b45a387555fc7158af29d, user_id=16b26a1851b049dc915fb49f005489b1, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:24.560823 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc4830-079b-4fb4-8ced-09844dc6eee5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:24.674115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1362/2725] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:24 2022] PUT /identity/v3/projects/d668bf27c05b45a387555fc7158af29d/users/16b26a1851b049dc915fb49f005489b1/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:24.682644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c06c61-f42e-4ed6-b788-42bbe7326e9a admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:24.691539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c06c61-f42e-4ed6-b788-42bbe7326e9a admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:24.754669 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce84531-323f-4cf4-8e83-f3ee35888b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:24.755330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce84531-323f-4cf4-8e83-f3ee35888b7a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:24.755485 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce84531-323f-4cf4-8e83-f3ee35888b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:24.755732 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce84531-323f-4cf4-8e83-f3ee35888b7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:24.756422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce84531-323f-4cf4-8e83-f3ee35888b7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:24.758043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce84531-323f-4cf4-8e83-f3ee35888b7a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:24.773005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1364/2726] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:24 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:24.774237 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc4830-079b-4fb4-8ced-09844dc6eee5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:24.785835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc4830-079b-4fb4-8ced-09844dc6eee5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:24.795284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa34ecc-8c3c-4196-8cac-8417227915d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:24.796184 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa34ecc-8c3c-4196-8cac-8417227915d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:24.796470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa34ecc-8c3c-4196-8cac-8417227915d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:24.796746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa34ecc-8c3c-4196-8cac-8417227915d5 admin admin] PATH_INFO: `/v3/projects/d668bf27c05b45a387555fc7158af29d/users/16b26a1851b049dc915fb49f005489b1/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:24.798898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa34ecc-8c3c-4196-8cac-8417227915d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d668bf27c05b45a387555fc7158af29d, user_id=16b26a1851b049dc915fb49f005489b1, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:24.815474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa34ecc-8c3c-4196-8cac-8417227915d5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:24.815474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1363/2727] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:24 2022] PUT /identity/v3/projects/d668bf27c05b45a387555fc7158af29d/users/16b26a1851b049dc915fb49f005489b1/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:24.827930 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e02aa9-b439-4b68-bc18-15f26c699a9a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:24.828152 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e02aa9-b439-4b68-bc18-15f26c699a9a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:24.828414 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e02aa9-b439-4b68-bc18-15f26c699a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:24.862851 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f2e02aa9-b439-4b68-bc18-15f26c699a9a None None] MFA Rules not processed for user `16b26a1851b049dc915fb49f005489b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:24.864061 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f2e02aa9-b439-4b68-bc18-15f26c699a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:24.952703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1365/2728] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:24.966818 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa34ecc-8c3c-4196-8cac-8417227915d5 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:24.968709 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ffa34ecc-8c3c-4196-8cac-8417227915d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:25.052990 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa34ecc-8c3c-4196-8cac-8417227915d5 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:25.056879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c035083-f6c5-41ff-aedf-96ee6ce2fcf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:25.057851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c035083-f6c5-41ff-aedf-96ee6ce2fcf9 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:25.058180 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c035083-f6c5-41ff-aedf-96ee6ce2fcf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:25.058453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c035083-f6c5-41ff-aedf-96ee6ce2fcf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:25.069891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c035083-f6c5-41ff-aedf-96ee6ce2fcf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:25.071429 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c035083-f6c5-41ff-aedf-96ee6ce2fcf9 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:25.083561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1364/2729] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:25.226453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:25.335698 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e02aa9-b439-4b68-bc18-15f26c699a9a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:25.346435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e02aa9-b439-4b68-bc18-15f26c699a9a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:25.350140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f375f-4470-4cc7-a563-d653a818c4d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:25.350751 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f375f-4470-4cc7-a563-d653a818c4d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:25.351031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f375f-4470-4cc7-a563-d653a818c4d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:25.351390 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f375f-4470-4cc7-a563-d653a818c4d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:25.414679 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f375f-4470-4cc7-a563-d653a818c4d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:25.416251 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2f375f-4470-4cc7-a563-d653a818c4d6 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:25.422026 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:25.427096 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1366/2730] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:26.469282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c035083-f6c5-41ff-aedf-96ee6ce2fcf9 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:26.471059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-5c035083-f6c5-41ff-aedf-96ee6ce2fcf9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:26.538762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c035083-f6c5-41ff-aedf-96ee6ce2fcf9 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:26.542704 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36097532-e6a3-4ecb-8b1e-6b14a65f9530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:26.543385 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097532-e6a3-4ecb-8b1e-6b14a65f9530 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:26.544277 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097532-e6a3-4ecb-8b1e-6b14a65f9530 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:26.544557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36097532-e6a3-4ecb-8b1e-6b14a65f9530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:26.546586 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-36097532-e6a3-4ecb-8b1e-6b14a65f9530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:26.562259 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:26.617415 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36097532-e6a3-4ecb-8b1e-6b14a65f9530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:26.618858 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36097532-e6a3-4ecb-8b1e-6b14a65f9530 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:26.640421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1365/2731] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:31.208043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f375f-4470-4cc7-a563-d653a818c4d6 service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:31.209900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-9c2f375f-4470-4cc7-a563-d653a818c4d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:31.300495 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:31.321946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f375f-4470-4cc7-a563-d653a818c4d6 service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:31.329890 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dda2d-9f53-4160-bbfd-c0b6abd91af1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213e29685f3402b804d4d8fbc88ba96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:31.330524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dda2d-9f53-4160-bbfd-c0b6abd91af1 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:31.330802 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dda2d-9f53-4160-bbfd-c0b6abd91af1 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:31.331071 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619dda2d-9f53-4160-bbfd-c0b6abd91af1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:31.332897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-619dda2d-9f53-4160-bbfd-c0b6abd91af1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:31.346310 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619dda2d-9f53-4160-bbfd-c0b6abd91af1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:31.347988 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619dda2d-9f53-4160-bbfd-c0b6abd91af1 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:31.364317 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1367/2732] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:32.860179 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2440cf-dfdf-40af-a14d-091e13edccb5 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:32.860642 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2440cf-dfdf-40af-a14d-091e13edccb5 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:32.860726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2440cf-dfdf-40af-a14d-091e13edccb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:32.883306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2f2440cf-dfdf-40af-a14d-091e13edccb5 None None] MFA Rules not processed for user `f8551bbc736a479593785a2772ba10bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:32.884486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2f2440cf-dfdf-40af-a14d-091e13edccb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:32.956808 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1366/2733] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:32 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:33.257679 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dda2d-9f53-4160-bbfd-c0b6abd91af1 service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:33.271650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619dda2d-9f53-4160-bbfd-c0b6abd91af1 service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:33.278760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee5b48-6c84-4ed7-9a29-c1253e6b5cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:33.280097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee5b48-6c84-4ed7-9a29-c1253e6b5cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:33.280452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee5b48-6c84-4ed7-9a29-c1253e6b5cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:33.280884 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee5b48-6c84-4ed7-9a29-c1253e6b5cc0 admin admin] PATH_INFO: `/v3/users/3b8fad5510df42aca7d84845456a6aee` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:33.282083 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee5b48-6c84-4ed7-9a29-c1253e6b5cc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b8fad5510df42aca7d84845456a6aee)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:33.284161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee5b48-6c84-4ed7-9a29-c1253e6b5cc0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:33.693877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7aee5b48-6c84-4ed7-9a29-c1253e6b5cc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b8fad5510df42aca7d84845456a6aee'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:33.696196 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7aee5b48-6c84-4ed7-9a29-c1253e6b5cc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b8fad5510df42aca7d84845456a6aee'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:33.698554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7aee5b48-6c84-4ed7-9a29-c1253e6b5cc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b8fad5510df42aca7d84845456a6aee'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:33.713533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7aee5b48-6c84-4ed7-9a29-c1253e6b5cc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b8fad5510df42aca7d84845456a6aee'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:33.749161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7aee5b48-6c84-4ed7-9a29-c1253e6b5cc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b8fad5510df42aca7d84845456a6aee'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:33.834099 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1368/2734] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:33 2022] DELETE /identity/v3/users/3b8fad5510df42aca7d84845456a6aee => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:33.839088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecec68-8578-4e32-a719-d95b7ecc31d8 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:33.839622 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecec68-8578-4e32-a719-d95b7ecc31d8 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:33.839927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecec68-8578-4e32-a719-d95b7ecc31d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:33.864004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f4ecec68-8578-4e32-a719-d95b7ecc31d8 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:33.865362 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f4ecec68-8578-4e32-a719-d95b7ecc31d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:33.973737 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1367/2735] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:33.986000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee5b48-6c84-4ed7-9a29-c1253e6b5cc0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:33.987926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7aee5b48-6c84-4ed7-9a29-c1253e6b5cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:34.078645 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee5b48-6c84-4ed7-9a29-c1253e6b5cc0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:34.082764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26671c-91e4-4652-92b3-473c36d3d33c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:34.083469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26671c-91e4-4652-92b3-473c36d3d33c service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:34.083873 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26671c-91e4-4652-92b3-473c36d3d33c service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:34.084872 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26671c-91e4-4652-92b3-473c36d3d33c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:34.098175 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26671c-91e4-4652-92b3-473c36d3d33c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:34.099787 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26671c-91e4-4652-92b3-473c36d3d33c service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:34.112657 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1369/2736] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:34.764935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecec68-8578-4e32-a719-d95b7ecc31d8 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:34.767021 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f4ecec68-8578-4e32-a719-d95b7ecc31d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:34.783877 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecec68-8578-4e32-a719-d95b7ecc31d8 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:34.790057 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:34.791167 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:34.800584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:34.800584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] PATH_INFO: `/v3/projects/818f07449ed44bf2be66f272e8dd9a91` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:34.800584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=818f07449ed44bf2be66f272e8dd9a91)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:34.800584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:34.996807 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '818f07449ed44bf2be66f272e8dd9a91', 'request_id': 'req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:34.998813 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:35.003387 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '818f07449ed44bf2be66f272e8dd9a91', 'request_id': 'req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:35.009053 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '818f07449ed44bf2be66f272e8dd9a91', 'request_id': 'req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:35.113970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] The token cache is being invalidate because project 818f07449ed44bf2be66f272e8dd9a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:35.114261 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:35.115255 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:35.117386 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1368/2737] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:34 2022] DELETE /identity/v3/projects/818f07449ed44bf2be66f272e8dd9a91 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:35.125921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26671c-91e4-4652-92b3-473c36d3d33c service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:35.136599 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26671c-91e4-4652-92b3-473c36d3d33c service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:35.190829 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:35.200889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444886a-54e1-4704-9b12-4cd87d862d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:35.201507 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444886a-54e1-4704-9b12-4cd87d862d60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:35.201862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444886a-54e1-4704-9b12-4cd87d862d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:35.202044 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5444886a-54e1-4704-9b12-4cd87d862d60 admin admin] PATH_INFO: `/v3/users/16b26a1851b049dc915fb49f005489b1` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:35.203215 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444886a-54e1-4704-9b12-4cd87d862d60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16b26a1851b049dc915fb49f005489b1)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:35.205193 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5444886a-54e1-4704-9b12-4cd87d862d60 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:35.536708 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5444886a-54e1-4704-9b12-4cd87d862d60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16b26a1851b049dc915fb49f005489b1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:35.537540 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5444886a-54e1-4704-9b12-4cd87d862d60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16b26a1851b049dc915fb49f005489b1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:35.538200 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5444886a-54e1-4704-9b12-4cd87d862d60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16b26a1851b049dc915fb49f005489b1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:35.546883 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5444886a-54e1-4704-9b12-4cd87d862d60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16b26a1851b049dc915fb49f005489b1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:35.561076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-5444886a-54e1-4704-9b12-4cd87d862d60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16b26a1851b049dc915fb49f005489b1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:35.675468 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1370/2738] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:35 2022] DELETE /identity/v3/users/16b26a1851b049dc915fb49f005489b1 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:36.303630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:36.305275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:36.320150 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0bdaeb-20e5-48fb-aa1d-538cdb679f25 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:36.406537 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bc2927-2e30-4799-acee-b17eedb02138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:36.407333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc2927-2e30-4799-acee-b17eedb02138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:36.407683 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc2927-2e30-4799-acee-b17eedb02138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:36.408058 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc2927-2e30-4799-acee-b17eedb02138 admin admin] PATH_INFO: `/v3/projects/d668bf27c05b45a387555fc7158af29d` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:36.409419 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc2927-2e30-4799-acee-b17eedb02138 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d668bf27c05b45a387555fc7158af29d)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:36.411363 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bc2927-2e30-4799-acee-b17eedb02138 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:36.529997 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444886a-54e1-4704-9b12-4cd87d862d60 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:36.532225 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5444886a-54e1-4704-9b12-4cd87d862d60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:36.550110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5444886a-54e1-4704-9b12-4cd87d862d60 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:36.550876 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72bc2927-2e30-4799-acee-b17eedb02138 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd668bf27c05b45a387555fc7158af29d', 'request_id': 'req-72bc2927-2e30-4799-acee-b17eedb02138'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:36.557353 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72bc2927-2e30-4799-acee-b17eedb02138 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd668bf27c05b45a387555fc7158af29d', 'request_id': 'req-72bc2927-2e30-4799-acee-b17eedb02138'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:36.571988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72bc2927-2e30-4799-acee-b17eedb02138 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd668bf27c05b45a387555fc7158af29d', 'request_id': 'req-72bc2927-2e30-4799-acee-b17eedb02138'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:36.612233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff6f16-2e43-4469-aa69-43e09980b7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:36.612886 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff6f16-2e43-4469-aa69-43e09980b7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:36.613167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff6f16-2e43-4469-aa69-43e09980b7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:36.613442 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ff6f16-2e43-4469-aa69-43e09980b7bc admin admin] PATH_INFO: `/v3/users/fa8e5c4f16184f8fbfce978037029582` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:36.614673 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff6f16-2e43-4469-aa69-43e09980b7bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa8e5c4f16184f8fbfce978037029582)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:36.616704 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ff6f16-2e43-4469-aa69-43e09980b7bc admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:36.680752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72bc2927-2e30-4799-acee-b17eedb02138 admin admin] The token cache is being invalidate because project d668bf27c05b45a387555fc7158af29d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:36.681052 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72bc2927-2e30-4799-acee-b17eedb02138 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:36.681781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-72bc2927-2e30-4799-acee-b17eedb02138 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:36.683988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1369/2739] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:36 2022] DELETE /identity/v3/projects/d668bf27c05b45a387555fc7158af29d => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:36.689173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0631-dca7-41bc-804d-6994cba11f86 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:36.689462 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0631-dca7-41bc-804d-6994cba11f86 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:36.689734 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b0631-dca7-41bc-804d-6994cba11f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:36.714072 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-cb3b0631-dca7-41bc-804d-6994cba11f86 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:36.715468 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-cb3b0631-dca7-41bc-804d-6994cba11f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:36.724142 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1370/2740] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:36.732810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498d732-76bc-43a7-b6b3-f96b0072e136 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:36.733059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498d732-76bc-43a7-b6b3-f96b0072e136 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:36.733382 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f498d732-76bc-43a7-b6b3-f96b0072e136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:36.755435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-f498d732-76bc-43a7-b6b3-f96b0072e136 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:36.756413 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f498d732-76bc-43a7-b6b3-f96b0072e136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:36.765198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1371/2741] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:36.769562 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498d732-76bc-43a7-b6b3-f96b0072e136 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:36.779443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f498d732-76bc-43a7-b6b3-f96b0072e136 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:36.784471 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057a7d1-abc1-4727-9e64-d49c041aa902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:36.785086 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a7d1-abc1-4727-9e64-d49c041aa902 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:36.785357 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a7d1-abc1-4727-9e64-d49c041aa902 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:36.785627 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057a7d1-abc1-4727-9e64-d49c041aa902 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:36.786326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057a7d1-abc1-4727-9e64-d49c041aa902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:15:36.786620 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057a7d1-abc1-4727-9e64-d49c041aa902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:36.788352 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3057a7d1-abc1-4727-9e64-d49c041aa902 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:36.803883 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1372/2742] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:15:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:15:36.815999 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057a7d1-abc1-4727-9e64-d49c041aa902 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:36.830228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3057a7d1-abc1-4727-9e64-d49c041aa902 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:36.836021 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082ce54-9602-4f04-8a72-97384c99602f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:36.836730 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ce54-9602-4f04-8a72-97384c99602f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:36.837034 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ce54-9602-4f04-8a72-97384c99602f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:36.837308 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ce54-9602-4f04-8a72-97384c99602f admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:36.837942 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082ce54-9602-4f04-8a72-97384c99602f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:36.839892 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0082ce54-9602-4f04-8a72-97384c99602f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:36.895505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a1ff6f16-2e43-4469-aa69-43e09980b7bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa8e5c4f16184f8fbfce978037029582'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:36.896302 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a1ff6f16-2e43-4469-aa69-43e09980b7bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa8e5c4f16184f8fbfce978037029582'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:36.897374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a1ff6f16-2e43-4469-aa69-43e09980b7bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa8e5c4f16184f8fbfce978037029582'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:36.908331 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a1ff6f16-2e43-4469-aa69-43e09980b7bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa8e5c4f16184f8fbfce978037029582'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:36.931081 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a1ff6f16-2e43-4469-aa69-43e09980b7bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa8e5c4f16184f8fbfce978037029582'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:36.933199 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:36.961995 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1373/2743] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:36 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:15:36.961995 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082ce54-9602-4f04-8a72-97384c99602f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:36.963558 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0082ce54-9602-4f04-8a72-97384c99602f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:36.994693 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:37.029040 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082ce54-9602-4f04-8a72-97384c99602f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:37.033915 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef74a49-8f2c-40e0-83f3-9df987c99721 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:37.034733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef74a49-8f2c-40e0-83f3-9df987c99721 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:37.035014 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef74a49-8f2c-40e0-83f3-9df987c99721 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:37.035282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef74a49-8f2c-40e0-83f3-9df987c99721 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:37.037054 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0ef74a49-8f2c-40e0-83f3-9df987c99721 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:37.102281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1371/2744] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:36 2022] DELETE /identity/v3/users/fa8e5c4f16184f8fbfce978037029582 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:37.103389 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff6f16-2e43-4469-aa69-43e09980b7bc admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:37.107546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a1ff6f16-2e43-4469-aa69-43e09980b7bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:37.108888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef74a49-8f2c-40e0-83f3-9df987c99721 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:37.110505 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef74a49-8f2c-40e0-83f3-9df987c99721 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:37.122587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1374/2745] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:37.187312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ff6f16-2e43-4469-aa69-43e09980b7bc admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:37.192084 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3be13-cb7c-4d8e-980f-d6302a2a470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:37.192712 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3be13-cb7c-4d8e-980f-d6302a2a470d admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:37.193157 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3be13-cb7c-4d8e-980f-d6302a2a470d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:37.193430 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3be13-cb7c-4d8e-980f-d6302a2a470d admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:37.194136 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3be13-cb7c-4d8e-980f-d6302a2a470d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:37.196184 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3be13-cb7c-4d8e-980f-d6302a2a470d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:37.320547 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1372/2746] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:37 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:37.324853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef74a49-8f2c-40e0-83f3-9df987c99721 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:37.335970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef74a49-8f2c-40e0-83f3-9df987c99721 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:37.344910 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4c03d-516b-4677-970c-9d77d3f03667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:37.345555 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4c03d-516b-4677-970c-9d77d3f03667 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:37.345833 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4c03d-516b-4677-970c-9d77d3f03667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:37.346109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4c03d-516b-4677-970c-9d77d3f03667 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:37.346949 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4c03d-516b-4677-970c-9d77d3f03667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:37.348618 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4c03d-516b-4677-970c-9d77d3f03667 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:37.360888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1375/2747] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:37.365617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3be13-cb7c-4d8e-980f-d6302a2a470d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:37.380325 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3be13-cb7c-4d8e-980f-d6302a2a470d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:37.393246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e61f0-ea48-4746-be4e-f7336fca12eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:37.394680 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e61f0-ea48-4746-be4e-f7336fca12eb admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:37.395134 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e61f0-ea48-4746-be4e-f7336fca12eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:37.395575 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e61f0-ea48-4746-be4e-f7336fca12eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:37.397252 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e61f0-ea48-4746-be4e-f7336fca12eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:37.399167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e61f0-ea48-4746-be4e-f7336fca12eb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:37.419502 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1373/2748] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:37.420885 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4c03d-516b-4677-970c-9d77d3f03667 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:37.436127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4c03d-516b-4677-970c-9d77d3f03667 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:37.442374 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e190d-feca-49a0-bf85-2f04de7e8839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:37.443154 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e190d-feca-49a0-bf85-2f04de7e8839 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:37.443509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e190d-feca-49a0-bf85-2f04de7e8839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:37.443954 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e190d-feca-49a0-bf85-2f04de7e8839 admin admin] PATH_INFO: `/v3/projects/f8b84709af704b62a2ff54712420b22b/users/66f4d95c183d4fa0ba92560695761428/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:37.467165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e190d-feca-49a0-bf85-2f04de7e8839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8b84709af704b62a2ff54712420b22b, user_id=66f4d95c183d4fa0ba92560695761428, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:37.471036 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e190d-feca-49a0-bf85-2f04de7e8839 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:37.588018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1376/2749] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:37 2022] PUT /identity/v3/projects/f8b84709af704b62a2ff54712420b22b/users/66f4d95c183d4fa0ba92560695761428/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:37.596952 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab1623-983b-4c1b-ab8c-d1eab7c562d3 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:37.596952 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab1623-983b-4c1b-ab8c-d1eab7c562d3 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:37.596952 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab1623-983b-4c1b-ab8c-d1eab7c562d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:37.637502 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-e8ab1623-983b-4c1b-ab8c-d1eab7c562d3 None None] MFA Rules not processed for user `66f4d95c183d4fa0ba92560695761428`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:37.638736 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e8ab1623-983b-4c1b-ab8c-d1eab7c562d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:37.717774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1374/2750] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:37.724988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e190d-feca-49a0-bf85-2f04de7e8839 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:37.822267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab1623-983b-4c1b-ab8c-d1eab7c562d3 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:37.824797 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-e8ab1623-983b-4c1b-ab8c-d1eab7c562d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:37.824953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e190d-feca-49a0-bf85-2f04de7e8839 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:37.829348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ed4af-6517-4b15-b56a-f6ce3a1dec03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:37.830008 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ed4af-6517-4b15-b56a-f6ce3a1dec03 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:37.830403 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ed4af-6517-4b15-b56a-f6ce3a1dec03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:37.830808 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90ed4af-6517-4b15-b56a-f6ce3a1dec03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:37.831474 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ed4af-6517-4b15-b56a-f6ce3a1dec03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:37.833872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90ed4af-6517-4b15-b56a-f6ce3a1dec03 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:37.839457 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab1623-983b-4c1b-ab8c-d1eab7c562d3 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:37.845160 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:37.849828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:37.849828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:37.849828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] PATH_INFO: `/v3/projects/863f81350f5f41ae9da94bcf285833d6` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:37.849828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=863f81350f5f41ae9da94bcf285833d6)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:37.849828 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:37.939724 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1377/2751] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:37 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:37.944902 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ed4af-6517-4b15-b56a-f6ce3a1dec03 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:38.024772 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '863f81350f5f41ae9da94bcf285833d6', 'request_id': 'req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:38.028940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90ed4af-6517-4b15-b56a-f6ce3a1dec03 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:38.032960 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '863f81350f5f41ae9da94bcf285833d6', 'request_id': 'req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:38.094554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e6ed7-a9b3-4fa7-b31c-5c7342976896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:38.095086 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e6ed7-a9b3-4fa7-b31c-5c7342976896 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:38.095369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e6ed7-a9b3-4fa7-b31c-5c7342976896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:38.095644 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e6ed7-a9b3-4fa7-b31c-5c7342976896 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:38.096310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e6ed7-a9b3-4fa7-b31c-5c7342976896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:38.098507 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e6ed7-a9b3-4fa7-b31c-5c7342976896 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:38.154291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '863f81350f5f41ae9da94bcf285833d6', 'request_id': 'req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:38.166989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] The token cache is being invalidate because project 863f81350f5f41ae9da94bcf285833d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:38.168031 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:38.170758 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:38.172628 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1375/2752] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:37 2022] DELETE /identity/v3/projects/863f81350f5f41ae9da94bcf285833d6 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:38.177321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:38.179504 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:38.203788 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1232cc98-6cd3-43ed-aa68-eff7dc1f2fc1 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:38.210648 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eb3fb-6500-4b43-9987-687cd67d6939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:38.211299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eb3fb-6500-4b43-9987-687cd67d6939 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:38.211636 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eb3fb-6500-4b43-9987-687cd67d6939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:38.211941 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20eb3fb-6500-4b43-9987-687cd67d6939 admin admin] PATH_INFO: `/v3/users/38d60ba32bd9479496672d28925631d7` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:38.213193 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eb3fb-6500-4b43-9987-687cd67d6939 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38d60ba32bd9479496672d28925631d7)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:38.215347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20eb3fb-6500-4b43-9987-687cd67d6939 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:38.222196 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1378/2753] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:37 2022] POST /identity/v3/users => generated 298 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:15:38.227054 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e6ed7-a9b3-4fa7-b31c-5c7342976896 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:38.228860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-da4e6ed7-a9b3-4fa7-b31c-5c7342976896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:38.241970 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e6ed7-a9b3-4fa7-b31c-5c7342976896 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:38.246996 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf36790-26ad-4add-85df-1b8e5bb23bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:38.247799 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf36790-26ad-4add-85df-1b8e5bb23bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:38.248276 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf36790-26ad-4add-85df-1b8e5bb23bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:38.248557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf36790-26ad-4add-85df-1b8e5bb23bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:38.249211 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf36790-26ad-4add-85df-1b8e5bb23bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:38.250825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf36790-26ad-4add-85df-1b8e5bb23bcd admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:38.261850 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1379/2754] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:15:38.266839 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf36790-26ad-4add-85df-1b8e5bb23bcd admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:38.277424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf36790-26ad-4add-85df-1b8e5bb23bcd admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:38.283363 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45df270-c9ae-4c89-9e85-caac77d2b52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:38.284342 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45df270-c9ae-4c89-9e85-caac77d2b52a admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:38.284650 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45df270-c9ae-4c89-9e85-caac77d2b52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:38.284926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45df270-c9ae-4c89-9e85-caac77d2b52a admin admin] PATH_INFO: `/v3/projects/7b0aec7c4ba242288666305d00da628c/users/a6efa3b8e99c44ad89e3f3457d52f9c7/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:38.303868 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45df270-c9ae-4c89-9e85-caac77d2b52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0aec7c4ba242288666305d00da628c, user_id=a6efa3b8e99c44ad89e3f3457d52f9c7, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:38.306885 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45df270-c9ae-4c89-9e85-caac77d2b52a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:38.420431 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1380/2755] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:38 2022] PUT /identity/v3/projects/7b0aec7c4ba242288666305d00da628c/users/a6efa3b8e99c44ad89e3f3457d52f9c7/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:38.422872 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45df270-c9ae-4c89-9e85-caac77d2b52a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:38.464615 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a20eb3fb-6500-4b43-9987-687cd67d6939 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38d60ba32bd9479496672d28925631d7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:38.465263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a20eb3fb-6500-4b43-9987-687cd67d6939 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38d60ba32bd9479496672d28925631d7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:38.466007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a20eb3fb-6500-4b43-9987-687cd67d6939 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38d60ba32bd9479496672d28925631d7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:38.476012 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a20eb3fb-6500-4b43-9987-687cd67d6939 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38d60ba32bd9479496672d28925631d7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:38.488545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-a20eb3fb-6500-4b43-9987-687cd67d6939 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38d60ba32bd9479496672d28925631d7'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:38.496579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45df270-c9ae-4c89-9e85-caac77d2b52a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:38.502703 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a514054-629c-434b-a2ba-9e71ac2da4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:38.503481 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514054-629c-434b-a2ba-9e71ac2da4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:38.503764 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514054-629c-434b-a2ba-9e71ac2da4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:38.504098 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a514054-629c-434b-a2ba-9e71ac2da4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:38.504825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a514054-629c-434b-a2ba-9e71ac2da4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:38.506677 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a514054-629c-434b-a2ba-9e71ac2da4d4 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:38.517971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1381/2756] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:38 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:38.522422 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a514054-629c-434b-a2ba-9e71ac2da4d4 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:38.524126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0a514054-629c-434b-a2ba-9e71ac2da4d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:38.537245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a514054-629c-434b-a2ba-9e71ac2da4d4 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:38.542598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfdfcd-6654-47b1-9bf6-c2bdfe6775a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:38.543260 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfdfcd-6654-47b1-9bf6-c2bdfe6775a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:38.543541 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfdfcd-6654-47b1-9bf6-c2bdfe6775a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:38.543876 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfdfcd-6654-47b1-9bf6-c2bdfe6775a0 admin admin] PATH_INFO: `/v3/projects/7b0aec7c4ba242288666305d00da628c/users/a6efa3b8e99c44ad89e3f3457d52f9c7/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:38.545840 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfdfcd-6654-47b1-9bf6-c2bdfe6775a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0aec7c4ba242288666305d00da628c, user_id=a6efa3b8e99c44ad89e3f3457d52f9c7, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:38.548545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfdfcd-6654-47b1-9bf6-c2bdfe6775a0 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:38.551606 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=4,keystone:DELETE=5,keystone:SELECT=91 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:38.561035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1382/2757] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:38 2022] PUT /identity/v3/projects/7b0aec7c4ba242288666305d00da628c/users/a6efa3b8e99c44ad89e3f3457d52f9c7/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:38.607437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1376/2758] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:38 2022] DELETE /identity/v3/users/38d60ba32bd9479496672d28925631d7 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:38.631305 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ac56-83f5-4774-aa39-99aca22feaaf None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:38.631696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ac56-83f5-4774-aa39-99aca22feaaf None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:38.632131 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ac56-83f5-4774-aa39-99aca22feaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:38.687486 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4df2ac56-83f5-4774-aa39-99aca22feaaf None None] MFA Rules not processed for user `a6efa3b8e99c44ad89e3f3457d52f9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:38.688929 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4df2ac56-83f5-4774-aa39-99aca22feaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:38.773588 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:38.829577 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1383/2759] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:38 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:38.838051 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eb3fb-6500-4b43-9987-687cd67d6939 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:38.840008 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a20eb3fb-6500-4b43-9987-687cd67d6939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:38.931078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20eb3fb-6500-4b43-9987-687cd67d6939 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:38.935314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa3867-dd7a-40f9-a06a-0e429ae9748d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:38.935968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa3867-dd7a-40f9-a06a-0e429ae9748d service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:38.936248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa3867-dd7a-40f9-a06a-0e429ae9748d service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:38.936546 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa3867-dd7a-40f9-a06a-0e429ae9748d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:38.953765 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa3867-dd7a-40f9-a06a-0e429ae9748d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:38.957141 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa3867-dd7a-40f9-a06a-0e429ae9748d service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:38.978724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1377/2760] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:38 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:39.158809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2ac56-83f5-4774-aa39-99aca22feaaf None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:39.171598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2ac56-83f5-4774-aa39-99aca22feaaf None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:39.175837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729d039-9ae3-4e08-89da-3edefbc8b82f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:39.185457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729d039-9ae3-4e08-89da-3edefbc8b82f service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:39.185457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729d039-9ae3-4e08-89da-3edefbc8b82f service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:39.185457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2729d039-9ae3-4e08-89da-3edefbc8b82f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:39.185457 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2729d039-9ae3-4e08-89da-3edefbc8b82f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:39.264272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729d039-9ae3-4e08-89da-3edefbc8b82f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:39.264843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2729d039-9ae3-4e08-89da-3edefbc8b82f service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:39.276245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1384/2761] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:39.713333 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:39.803395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa3867-dd7a-40f9-a06a-0e429ae9748d service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:39.805098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-05aa3867-dd7a-40f9-a06a-0e429ae9748d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:39.905826 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa3867-dd7a-40f9-a06a-0e429ae9748d service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:39.918814 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34864c5-40c9-4384-851b-dcf562be2833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:39.919784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34864c5-40c9-4384-851b-dcf562be2833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:39.920267 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34864c5-40c9-4384-851b-dcf562be2833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:39.920584 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34864c5-40c9-4384-851b-dcf562be2833 admin admin] PATH_INFO: `/v3/projects/915ac5a7ebe8451c942e84ef6f90951e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:39.923764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34864c5-40c9-4384-851b-dcf562be2833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=915ac5a7ebe8451c942e84ef6f90951e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:39.928526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34864c5-40c9-4384-851b-dcf562be2833 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:40.226019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729d039-9ae3-4e08-89da-3edefbc8b82f service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:40.243473 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2729d039-9ae3-4e08-89da-3edefbc8b82f service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:40.264281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c34864c5-40c9-4384-851b-dcf562be2833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '915ac5a7ebe8451c942e84ef6f90951e', 'request_id': 'req-c34864c5-40c9-4384-851b-dcf562be2833'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:40.271607 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c34864c5-40c9-4384-851b-dcf562be2833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '915ac5a7ebe8451c942e84ef6f90951e', 'request_id': 'req-c34864c5-40c9-4384-851b-dcf562be2833'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:40.332762 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea09ea-e00b-4e66-be05-254675f560c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:40.333435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea09ea-e00b-4e66-be05-254675f560c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:40.333715 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea09ea-e00b-4e66-be05-254675f560c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:40.334033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fea09ea-e00b-4e66-be05-254675f560c8 admin admin] PATH_INFO: `/v3/users/66f4d95c183d4fa0ba92560695761428` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:40.335234 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea09ea-e00b-4e66-be05-254675f560c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66f4d95c183d4fa0ba92560695761428)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:40.337170 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fea09ea-e00b-4e66-be05-254675f560c8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:40.347370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c34864c5-40c9-4384-851b-dcf562be2833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '915ac5a7ebe8451c942e84ef6f90951e', 'request_id': 'req-c34864c5-40c9-4384-851b-dcf562be2833'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:40.362846 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c34864c5-40c9-4384-851b-dcf562be2833 admin admin] The token cache is being invalidate because project 915ac5a7ebe8451c942e84ef6f90951e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:40.363470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c34864c5-40c9-4384-851b-dcf562be2833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:40.364517 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c34864c5-40c9-4384-851b-dcf562be2833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:40.368242 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1378/2762] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:39 2022] DELETE /identity/v3/projects/915ac5a7ebe8451c942e84ef6f90951e => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:40.490943 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:40.609326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2fea09ea-e00b-4e66-be05-254675f560c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66f4d95c183d4fa0ba92560695761428'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:40.630850 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2fea09ea-e00b-4e66-be05-254675f560c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66f4d95c183d4fa0ba92560695761428'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:40.632173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2fea09ea-e00b-4e66-be05-254675f560c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66f4d95c183d4fa0ba92560695761428'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:40.633079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2fea09ea-e00b-4e66-be05-254675f560c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66f4d95c183d4fa0ba92560695761428'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:40.644083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-2fea09ea-e00b-4e66-be05-254675f560c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66f4d95c183d4fa0ba92560695761428'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:40.787725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1385/2763] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:40 2022] DELETE /identity/v3/users/66f4d95c183d4fa0ba92560695761428 => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:40.792857 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5ee37-4b2e-4123-b7ad-a9b7174cca5d None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:40.793166 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5ee37-4b2e-4123-b7ad-a9b7174cca5d None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:40.793447 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5ee37-4b2e-4123-b7ad-a9b7174cca5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:40.826202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-f4d5ee37-4b2e-4123-b7ad-a9b7174cca5d None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:40.827498 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f4d5ee37-4b2e-4123-b7ad-a9b7174cca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:40.899560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1379/2764] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:40.910245 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea09ea-e00b-4e66-be05-254675f560c8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:40.911746 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2fea09ea-e00b-4e66-be05-254675f560c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:40.990789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fea09ea-e00b-4e66-be05-254675f560c8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:40.995173 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2949c-2219-4ed4-a2ff-239bdd53c581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:40.995812 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2949c-2219-4ed4-a2ff-239bdd53c581 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:40.996127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2949c-2219-4ed4-a2ff-239bdd53c581 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:40.996424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2949c-2219-4ed4-a2ff-239bdd53c581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:41.008651 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2949c-2219-4ed4-a2ff-239bdd53c581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:41.008774 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2949c-2219-4ed4-a2ff-239bdd53c581 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:41.021003 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1386/2765] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:41.283052 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:41.866304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5ee37-4b2e-4123-b7ad-a9b7174cca5d None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:41.868610 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f4d5ee37-4b2e-4123-b7ad-a9b7174cca5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:41.881756 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5ee37-4b2e-4123-b7ad-a9b7174cca5d None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:41.886494 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:41.905004 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:41.905004 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:41.905004 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] PATH_INFO: `/v3/projects/f8b84709af704b62a2ff54712420b22b` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:41.905004 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8b84709af704b62a2ff54712420b22b)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:41.905004 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:42.025400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8b84709af704b62a2ff54712420b22b', 'request_id': 'req-f8367ca6-9db4-44e3-b9d1-321775d10b66'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.033214 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8b84709af704b62a2ff54712420b22b', 'request_id': 'req-f8367ca6-9db4-44e3-b9d1-321775d10b66'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.170310 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8b84709af704b62a2ff54712420b22b', 'request_id': 'req-f8367ca6-9db4-44e3-b9d1-321775d10b66'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.183798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] The token cache is being invalidate because project f8b84709af704b62a2ff54712420b22b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:42.185043 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.185991 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.187959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1380/2766] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:41 2022] DELETE /identity/v3/projects/f8b84709af704b62a2ff54712420b22b => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:42.192183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2949c-2219-4ed4-a2ff-239bdd53c581 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:42.204495 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2949c-2219-4ed4-a2ff-239bdd53c581 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:42.273183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13954d6-315e-46db-8160-d1c9c5432c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:42.273183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13954d6-315e-46db-8160-d1c9c5432c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:42.273183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13954d6-315e-46db-8160-d1c9c5432c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:42.273183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13954d6-315e-46db-8160-d1c9c5432c74 admin admin] PATH_INFO: `/v3/users/a6efa3b8e99c44ad89e3f3457d52f9c7` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:42.273598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13954d6-315e-46db-8160-d1c9c5432c74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6efa3b8e99c44ad89e3f3457d52f9c7)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:42.273598 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13954d6-315e-46db-8160-d1c9c5432c74 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:42.337394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:42.339074 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:42.358140 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8367ca6-9db4-44e3-b9d1-321775d10b66 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:42.363994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710fdc9-66ba-490c-836a-34495e6b07da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:42.364771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710fdc9-66ba-490c-836a-34495e6b07da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:42.365125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710fdc9-66ba-490c-836a-34495e6b07da admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:42.365470 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710fdc9-66ba-490c-836a-34495e6b07da admin admin] PATH_INFO: `/v3/users/8e9558f071244924926df0fe80d3259a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:42.366703 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710fdc9-66ba-490c-836a-34495e6b07da admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e9558f071244924926df0fe80d3259a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:42.368925 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710fdc9-66ba-490c-836a-34495e6b07da admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:42.532005 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f13954d6-315e-46db-8160-d1c9c5432c74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6efa3b8e99c44ad89e3f3457d52f9c7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.547095 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f13954d6-315e-46db-8160-d1c9c5432c74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6efa3b8e99c44ad89e3f3457d52f9c7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.547813 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f13954d6-315e-46db-8160-d1c9c5432c74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6efa3b8e99c44ad89e3f3457d52f9c7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.548446 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f13954d6-315e-46db-8160-d1c9c5432c74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6efa3b8e99c44ad89e3f3457d52f9c7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.555502 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f13954d6-315e-46db-8160-d1c9c5432c74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6efa3b8e99c44ad89e3f3457d52f9c7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.644939 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1387/2767] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:42 2022] DELETE /identity/v3/users/a6efa3b8e99c44ad89e3f3457d52f9c7 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:42.649195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:42.654604 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7710fdc9-66ba-490c-836a-34495e6b07da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e9558f071244924926df0fe80d3259a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.655277 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7710fdc9-66ba-490c-836a-34495e6b07da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e9558f071244924926df0fe80d3259a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.655906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7710fdc9-66ba-490c-836a-34495e6b07da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e9558f071244924926df0fe80d3259a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.663354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7710fdc9-66ba-490c-836a-34495e6b07da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e9558f071244924926df0fe80d3259a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.677357 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7710fdc9-66ba-490c-836a-34495e6b07da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e9558f071244924926df0fe80d3259a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:42.781772 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1381/2768] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:42 2022] DELETE /identity/v3/users/8e9558f071244924926df0fe80d3259a => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:42.904361 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:43.136282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13954d6-315e-46db-8160-d1c9c5432c74 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:43.148134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f13954d6-315e-46db-8160-d1c9c5432c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:43.178472 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710fdc9-66ba-490c-836a-34495e6b07da admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:43.180674 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-7710fdc9-66ba-490c-836a-34495e6b07da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:43.225985 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13954d6-315e-46db-8160-d1c9c5432c74 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:43.260445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710fdc9-66ba-490c-836a-34495e6b07da admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:43.265377 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b025a3-8959-4bfa-944e-ddda7156d0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:43.266024 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b025a3-8959-4bfa-944e-ddda7156d0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:43.266422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b025a3-8959-4bfa-944e-ddda7156d0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:43.266569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b025a3-8959-4bfa-944e-ddda7156d0e8 admin admin] PATH_INFO: `/v3/projects/7b0aec7c4ba242288666305d00da628c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:43.267763 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b025a3-8959-4bfa-944e-ddda7156d0e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0aec7c4ba242288666305d00da628c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:43.269920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b025a3-8959-4bfa-944e-ddda7156d0e8 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:43.286230 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52fa71-367d-48e2-b0f9-00602525a1a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:43.286988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52fa71-367d-48e2-b0f9-00602525a1a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:43.287272 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52fa71-367d-48e2-b0f9-00602525a1a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:43.287544 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52fa71-367d-48e2-b0f9-00602525a1a5 admin admin] PATH_INFO: `/v3/projects/1d2a92ad79204e2c83a8d9ae030a9287` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:43.288916 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52fa71-367d-48e2-b0f9-00602525a1a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d2a92ad79204e2c83a8d9ae030a9287)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:43.290927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52fa71-367d-48e2-b0f9-00602525a1a5 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:43.397162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c4b025a3-8959-4bfa-944e-ddda7156d0e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0aec7c4ba242288666305d00da628c', 'request_id': 'req-c4b025a3-8959-4bfa-944e-ddda7156d0e8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:43.405321 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c4b025a3-8959-4bfa-944e-ddda7156d0e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0aec7c4ba242288666305d00da628c', 'request_id': 'req-c4b025a3-8959-4bfa-944e-ddda7156d0e8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:43.427599 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9a52fa71-367d-48e2-b0f9-00602525a1a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d2a92ad79204e2c83a8d9ae030a9287', 'request_id': 'req-9a52fa71-367d-48e2-b0f9-00602525a1a5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:43.435427 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9a52fa71-367d-48e2-b0f9-00602525a1a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d2a92ad79204e2c83a8d9ae030a9287', 'request_id': 'req-9a52fa71-367d-48e2-b0f9-00602525a1a5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:43.442210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9a52fa71-367d-48e2-b0f9-00602525a1a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d2a92ad79204e2c83a8d9ae030a9287', 'request_id': 'req-9a52fa71-367d-48e2-b0f9-00602525a1a5'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:43.467211 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c4b025a3-8959-4bfa-944e-ddda7156d0e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0aec7c4ba242288666305d00da628c', 'request_id': 'req-c4b025a3-8959-4bfa-944e-ddda7156d0e8'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:43.478968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c4b025a3-8959-4bfa-944e-ddda7156d0e8 admin admin] The token cache is being invalidate because project 7b0aec7c4ba242288666305d00da628c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:43.479258 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c4b025a3-8959-4bfa-944e-ddda7156d0e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:43.479948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-c4b025a3-8959-4bfa-944e-ddda7156d0e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:43.481542 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1382/2769] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:43 2022] DELETE /identity/v3/projects/7b0aec7c4ba242288666305d00da628c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:43.486975 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e041453-0cf5-453a-8201-98dded11c68f None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:43.487259 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e041453-0cf5-453a-8201-98dded11c68f None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:43.487537 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e041453-0cf5-453a-8201-98dded11c68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:43.508489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-3e041453-0cf5-453a-8201-98dded11c68f None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:43.509750 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-3e041453-0cf5-453a-8201-98dded11c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:43.513316 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9a52fa71-367d-48e2-b0f9-00602525a1a5 admin admin] The token cache is being invalidate because project 1d2a92ad79204e2c83a8d9ae030a9287 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:43.513932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9a52fa71-367d-48e2-b0f9-00602525a1a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:43.514548 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-9a52fa71-367d-48e2-b0f9-00602525a1a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:43.516191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1388/2770] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:43 2022] DELETE /identity/v3/projects/1d2a92ad79204e2c83a8d9ae030a9287 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:43.521356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f8bae-1495-417b-a9b1-63e269109cc2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:43.521668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f8bae-1495-417b-a9b1-63e269109cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:43.521943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f8bae-1495-417b-a9b1-63e269109cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:43.542523 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-4d0f8bae-1495-417b-a9b1-63e269109cc2 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:43.543795 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-4d0f8bae-1495-417b-a9b1-63e269109cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:43.573746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1383/2771] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:43.582582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40752e-fce4-467d-bb15-034974084d51 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:43.582867 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40752e-fce4-467d-bb15-034974084d51 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:43.583175 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40752e-fce4-467d-bb15-034974084d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:43.602842 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-6e40752e-fce4-467d-bb15-034974084d51 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:43.604119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-6e40752e-fce4-467d-bb15-034974084d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:43.605262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1389/2772] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:43.613060 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1384/2773] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:43.613439 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454e3b1-0da0-41c6-a53f-e5cc64086b60 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:43.613738 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454e3b1-0da0-41c6-a53f-e5cc64086b60 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:43.614079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9454e3b1-0da0-41c6-a53f-e5cc64086b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:43.617171 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40752e-fce4-467d-bb15-034974084d51 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:43.627309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40752e-fce4-467d-bb15-034974084d51 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:43.632374 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af69a5-e2ee-401c-bdb8-11c6b07c1d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:43.632971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af69a5-e2ee-401c-bdb8-11c6b07c1d58 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:43.633248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af69a5-e2ee-401c-bdb8-11c6b07c1d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:43.633521 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af69a5-e2ee-401c-bdb8-11c6b07c1d58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:43.633884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-9454e3b1-0da0-41c6-a53f-e5cc64086b60 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:43.634167 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af69a5-e2ee-401c-bdb8-11c6b07c1d58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:15:43.634469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af69a5-e2ee-401c-bdb8-11c6b07c1d58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:43.635397 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9454e3b1-0da0-41c6-a53f-e5cc64086b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:43.636072 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af69a5-e2ee-401c-bdb8-11c6b07c1d58 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:43.644278 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1390/2774] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:43.649165 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454e3b1-0da0-41c6-a53f-e5cc64086b60 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:43.649451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1385/2775] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:15:43.653435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af69a5-e2ee-401c-bdb8-11c6b07c1d58 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:43.658533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9454e3b1-0da0-41c6-a53f-e5cc64086b60 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:43.663322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af69a5-e2ee-401c-bdb8-11c6b07c1d58 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:43.663465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4666a-1b89-4015-9aa7-28e5a3aa1fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:43.664057 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4666a-1b89-4015-9aa7-28e5a3aa1fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:43.664334 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4666a-1b89-4015-9aa7-28e5a3aa1fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:43.664600 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4666a-1b89-4015-9aa7-28e5a3aa1fb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:43.665238 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4666a-1b89-4015-9aa7-28e5a3aa1fb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:15:43.665538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4666a-1b89-4015-9aa7-28e5a3aa1fb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:43.667384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4666a-1b89-4015-9aa7-28e5a3aa1fb2 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:43.668017 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949d37a-4601-4659-b258-87d617f02bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:43.669132 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949d37a-4601-4659-b258-87d617f02bf7 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:43.669423 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949d37a-4601-4659-b258-87d617f02bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:43.669692 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f949d37a-4601-4659-b258-87d617f02bf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:43.670314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949d37a-4601-4659-b258-87d617f02bf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:43.672238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f949d37a-4601-4659-b258-87d617f02bf7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:43.682955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1391/2776] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:15:43.686682 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4666a-1b89-4015-9aa7-28e5a3aa1fb2 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:43.696850 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4666a-1b89-4015-9aa7-28e5a3aa1fb2 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:43.701678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31dadc-882c-4cc6-af82-302861b6d116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:43.702275 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31dadc-882c-4cc6-af82-302861b6d116 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:43.702575 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31dadc-882c-4cc6-af82-302861b6d116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:43.702843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31dadc-882c-4cc6-af82-302861b6d116 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:43.703461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31dadc-882c-4cc6-af82-302861b6d116 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:43.705425 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31dadc-882c-4cc6-af82-302861b6d116 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:43.849078 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1386/2777] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:43 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:15:43.850204 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949d37a-4601-4659-b258-87d617f02bf7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:43.879706 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1392/2778] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:43 2022] POST /identity/v3/projects => generated 377 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:15:43.887316 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31dadc-882c-4cc6-af82-302861b6d116 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:43.915854 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f949d37a-4601-4659-b258-87d617f02bf7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:43.956038 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31dadc-882c-4cc6-af82-302861b6d116 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:43.961430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06f11c-285b-41b4-8c86-777629b0b21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:43.974287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06f11c-285b-41b4-8c86-777629b0b21c admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:43.974287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06f11c-285b-41b4-8c86-777629b0b21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:43.974287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b06f11c-285b-41b4-8c86-777629b0b21c admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:43.974287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06f11c-285b-41b4-8c86-777629b0b21c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:43.974287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b06f11c-285b-41b4-8c86-777629b0b21c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:43.987966 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a14a50-1281-4777-a766-d3bf5175560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:43.988670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a14a50-1281-4777-a766-d3bf5175560d admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:43.989041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a14a50-1281-4777-a766-d3bf5175560d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:43.989748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a14a50-1281-4777-a766-d3bf5175560d admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:43.990312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a14a50-1281-4777-a766-d3bf5175560d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:43.992305 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a14a50-1281-4777-a766-d3bf5175560d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:44.112444 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1393/2779] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:43 2022] POST /identity/v3/users => generated 289 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:15:44.113627 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06f11c-285b-41b4-8c86-777629b0b21c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:44.124241 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b06f11c-285b-41b4-8c86-777629b0b21c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:44.129123 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5058c0-89c7-437f-bad3-c683b3cc13fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:44.131551 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5058c0-89c7-437f-bad3-c683b3cc13fe admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:44.131834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5058c0-89c7-437f-bad3-c683b3cc13fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:44.132126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5058c0-89c7-437f-bad3-c683b3cc13fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:44.132769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5058c0-89c7-437f-bad3-c683b3cc13fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:44.134372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5058c0-89c7-437f-bad3-c683b3cc13fe admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:44.140497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1387/2780] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:43 2022] POST /identity/v3/users => generated 289 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:44.143336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a14a50-1281-4777-a766-d3bf5175560d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:44.152753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1394/2781] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:44.153981 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a14a50-1281-4777-a766-d3bf5175560d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:44.156654 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5058c0-89c7-437f-bad3-c683b3cc13fe admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:44.159336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716841ba-ccc5-430c-aff9-1b1b1993c008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:44.159988 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716841ba-ccc5-430c-aff9-1b1b1993c008 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:44.160276 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716841ba-ccc5-430c-aff9-1b1b1993c008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:44.160545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716841ba-ccc5-430c-aff9-1b1b1993c008 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:44.161555 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716841ba-ccc5-430c-aff9-1b1b1993c008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:44.167056 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716841ba-ccc5-430c-aff9-1b1b1993c008 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:44.173789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5058c0-89c7-437f-bad3-c683b3cc13fe admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:44.176812 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1388/2782] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:15:44.177311 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad05767-7223-466d-8982-3c04b88ca2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:44.177936 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05767-7223-466d-8982-3c04b88ca2bf admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:44.178282 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05767-7223-466d-8982-3c04b88ca2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:44.178557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad05767-7223-466d-8982-3c04b88ca2bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:44.179207 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad05767-7223-466d-8982-3c04b88ca2bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:44.180943 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad05767-7223-466d-8982-3c04b88ca2bf admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:44.184798 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716841ba-ccc5-430c-aff9-1b1b1993c008 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:44.193299 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1395/2783] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:44.196617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716841ba-ccc5-430c-aff9-1b1b1993c008 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:44.197654 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad05767-7223-466d-8982-3c04b88ca2bf admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:44.203939 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2dbea-a8df-40bb-b0fa-129df4435566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:44.208434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2dbea-a8df-40bb-b0fa-129df4435566 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:44.208434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2dbea-a8df-40bb-b0fa-129df4435566 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:44.208434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2dbea-a8df-40bb-b0fa-129df4435566 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:44.208434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2dbea-a8df-40bb-b0fa-129df4435566 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:44.208878 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad05767-7223-466d-8982-3c04b88ca2bf admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:44.209165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2dbea-a8df-40bb-b0fa-129df4435566 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:44.213576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a0361-2400-422d-8187-a9618f6739d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:44.214233 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0361-2400-422d-8187-a9618f6739d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:44.214515 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0361-2400-422d-8187-a9618f6739d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:44.214783 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0361-2400-422d-8187-a9618f6739d9 admin admin] PATH_INFO: `/v3/projects/6e36b5eaad664a638620b45bbf57ba74/users/d4b8fa0876f345abb4c84a57d79fccbb/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:44.227471 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1389/2784] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:15:44.228697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2dbea-a8df-40bb-b0fa-129df4435566 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:44.234304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a0361-2400-422d-8187-a9618f6739d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e36b5eaad664a638620b45bbf57ba74, user_id=d4b8fa0876f345abb4c84a57d79fccbb, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:44.237028 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a0361-2400-422d-8187-a9618f6739d9 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:44.241262 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2dbea-a8df-40bb-b0fa-129df4435566 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:44.255309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945a474-5c6c-44bc-b6a4-78118d4bc84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:44.255309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a474-5c6c-44bc-b6a4-78118d4bc84b admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:44.255309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a474-5c6c-44bc-b6a4-78118d4bc84b admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:44.255309 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945a474-5c6c-44bc-b6a4-78118d4bc84b admin admin] PATH_INFO: `/v3/projects/92922a52af3d479b8b7415a0fae8c9cd/users/574e2fe202e948f7b00826819ee7daf1/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:44.266690 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945a474-5c6c-44bc-b6a4-78118d4bc84b admin admin] RBAC: Authorizing `identity:create_grant(project_id=92922a52af3d479b8b7415a0fae8c9cd, user_id=574e2fe202e948f7b00826819ee7daf1, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:44.269721 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945a474-5c6c-44bc-b6a4-78118d4bc84b admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:44.384586 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1390/2785] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:44 2022] PUT /identity/v3/projects/92922a52af3d479b8b7415a0fae8c9cd/users/574e2fe202e948f7b00826819ee7daf1/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:44.396286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1396/2786] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:44 2022] PUT /identity/v3/projects/6e36b5eaad664a638620b45bbf57ba74/users/d4b8fa0876f345abb4c84a57d79fccbb/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:44.398148 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da62d6-3269-40fe-a718-480e93e402f6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:44.398448 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da62d6-3269-40fe-a718-480e93e402f6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:44.398750 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0088007-47a8-4e4d-92c9-64ec9c07d3b0 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:44.399490 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48da62d6-3269-40fe-a718-480e93e402f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:44.399677 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0088007-47a8-4e4d-92c9-64ec9c07d3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:44.399783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0088007-47a8-4e4d-92c9-64ec9c07d3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:44.421304 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-48da62d6-3269-40fe-a718-480e93e402f6 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:44.422749 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-48da62d6-3269-40fe-a718-480e93e402f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:44.434092 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a0088007-47a8-4e4d-92c9-64ec9c07d3b0 None None] MFA Rules not processed for user `574e2fe202e948f7b00826819ee7daf1`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:44.436062 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a0088007-47a8-4e4d-92c9-64ec9c07d3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:44.495884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1397/2787] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:44.505630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da62d6-3269-40fe-a718-480e93e402f6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:44.507248 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-48da62d6-3269-40fe-a718-480e93e402f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:44.521524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1391/2788] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:44.522570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0088007-47a8-4e4d-92c9-64ec9c07d3b0 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:44.534347 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0088007-47a8-4e4d-92c9-64ec9c07d3b0 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:44.540263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bac36e-4ec2-4105-9f07-0ac90e1434a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:44.540884 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bac36e-4ec2-4105-9f07-0ac90e1434a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:44.541159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bac36e-4ec2-4105-9f07-0ac90e1434a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:44.541430 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bac36e-4ec2-4105-9f07-0ac90e1434a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:44.542059 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bac36e-4ec2-4105-9f07-0ac90e1434a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:44.544263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bac36e-4ec2-4105-9f07-0ac90e1434a9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:44.573787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48da62d6-3269-40fe-a718-480e93e402f6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:44.578327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6307b0e-fb21-4023-b09f-55c7fe5dd902 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:44.578950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6307b0e-fb21-4023-b09f-55c7fe5dd902 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:44.579228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6307b0e-fb21-4023-b09f-55c7fe5dd902 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:44.579557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6307b0e-fb21-4023-b09f-55c7fe5dd902 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:44.592119 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6307b0e-fb21-4023-b09f-55c7fe5dd902 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:44.593755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6307b0e-fb21-4023-b09f-55c7fe5dd902 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:44.607031 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1398/2789] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 08:15:44.658713 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1392/2790] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:44 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:15:44.662802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6307b0e-fb21-4023-b09f-55c7fe5dd902 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:44.680329 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6307b0e-fb21-4023-b09f-55c7fe5dd902 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:44.738741 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf5d41-0ea5-4e95-aee6-d15ce2048366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:44.739348 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf5d41-0ea5-4e95-aee6-d15ce2048366 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:44.739622 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf5d41-0ea5-4e95-aee6-d15ce2048366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:44.739923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cf5d41-0ea5-4e95-aee6-d15ce2048366 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:44.740545 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf5d41-0ea5-4e95-aee6-d15ce2048366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:44.742632 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cf5d41-0ea5-4e95-aee6-d15ce2048366 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:44.920051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1399/2791] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:44 2022] POST /identity/v3/users => generated 288 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:44.924722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bac36e-4ec2-4105-9f07-0ac90e1434a9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:44.935718 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bac36e-4ec2-4105-9f07-0ac90e1434a9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:44.940620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69fd45-a267-4d12-b57c-076ad782e94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:44.941282 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69fd45-a267-4d12-b57c-076ad782e94d admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:44.941565 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69fd45-a267-4d12-b57c-076ad782e94d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:44.941841 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69fd45-a267-4d12-b57c-076ad782e94d admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:44.942520 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69fd45-a267-4d12-b57c-076ad782e94d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:44.944151 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c69fd45-a267-4d12-b57c-076ad782e94d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:44.954796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1393/2792] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:44.958861 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf5d41-0ea5-4e95-aee6-d15ce2048366 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:44.971157 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cf5d41-0ea5-4e95-aee6-d15ce2048366 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:44.975971 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e0b9f-c2b3-49f0-96c8-fa8809eb8f07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:44.976584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e0b9f-c2b3-49f0-96c8-fa8809eb8f07 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:44.976862 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e0b9f-c2b3-49f0-96c8-fa8809eb8f07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:44.977134 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e0b9f-c2b3-49f0-96c8-fa8809eb8f07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:44.977773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e0b9f-c2b3-49f0-96c8-fa8809eb8f07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:44.979462 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e0b9f-c2b3-49f0-96c8-fa8809eb8f07 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:45.006996 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1400/2793] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:45.007284 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69fd45-a267-4d12-b57c-076ad782e94d admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:45.009823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69fd45-a267-4d12-b57c-076ad782e94d admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:45.015186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cef1f-b9e0-48db-aeb7-80399ee6cbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:45.015899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cef1f-b9e0-48db-aeb7-80399ee6cbe7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:45.016156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cef1f-b9e0-48db-aeb7-80399ee6cbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:45.016437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5cef1f-b9e0-48db-aeb7-80399ee6cbe7 admin admin] PATH_INFO: `/v3/projects/f391c4350bc84c64ba711804c8f7a7c3/users/a73144b724744c699ad8def17cd1394a/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:45.035962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cef1f-b9e0-48db-aeb7-80399ee6cbe7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f391c4350bc84c64ba711804c8f7a7c3, user_id=a73144b724744c699ad8def17cd1394a, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:45.037618 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5cef1f-b9e0-48db-aeb7-80399ee6cbe7 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:45.194422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1394/2794] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:44 2022] PUT /identity/v3/projects/f391c4350bc84c64ba711804c8f7a7c3/users/a73144b724744c699ad8def17cd1394a/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:45.205659 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe9584-a633-4c67-88a5-80175fa445a2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:45.206209 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe9584-a633-4c67-88a5-80175fa445a2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:45.206502 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fe9584-a633-4c67-88a5-80175fa445a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:45.221093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:45.240832 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-00fe9584-a633-4c67-88a5-80175fa445a2 None None] MFA Rules not processed for user `a73144b724744c699ad8def17cd1394a`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:45.242236 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-00fe9584-a633-4c67-88a5-80175fa445a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:45.330399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1401/2795] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:45.335165 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cef1f-b9e0-48db-aeb7-80399ee6cbe7 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:45.423096 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5cef1f-b9e0-48db-aeb7-80399ee6cbe7 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:45.428671 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca347db-2c7c-498f-bc33-836734ffb819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:45.429323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca347db-2c7c-498f-bc33-836734ffb819 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:45.429630 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca347db-2c7c-498f-bc33-836734ffb819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:45.429989 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca347db-2c7c-498f-bc33-836734ffb819 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:45.430764 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca347db-2c7c-498f-bc33-836734ffb819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:45.433315 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca347db-2c7c-498f-bc33-836734ffb819 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:45.600432 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:45.607431 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1395/2796] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:15:45 2022] POST /identity/v3/projects => generated 375 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:45.612210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe9584-a633-4c67-88a5-80175fa445a2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:45.634557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fe9584-a633-4c67-88a5-80175fa445a2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:45.747288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955b7c4-b62f-4508-aa42-69264e561df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:45.748046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955b7c4-b62f-4508-aa42-69264e561df3 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:45.748869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955b7c4-b62f-4508-aa42-69264e561df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:45.749156 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5955b7c4-b62f-4508-aa42-69264e561df3 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:45.750124 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955b7c4-b62f-4508-aa42-69264e561df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:45.752163 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5955b7c4-b62f-4508-aa42-69264e561df3 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:45.864211 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1402/2797] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:15:45 2022] POST /identity/v3/users => generated 294 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:15:45.868429 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca347db-2c7c-498f-bc33-836734ffb819 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:45.883413 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca347db-2c7c-498f-bc33-836734ffb819 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:45.889164 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a87db-bcf0-4c5c-a48d-defdf07ea6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:45.890186 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a87db-bcf0-4c5c-a48d-defdf07ea6bd admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:45.890675 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a87db-bcf0-4c5c-a48d-defdf07ea6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:45.891076 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6a87db-bcf0-4c5c-a48d-defdf07ea6bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:45.894532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a87db-bcf0-4c5c-a48d-defdf07ea6bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:45.894532 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6a87db-bcf0-4c5c-a48d-defdf07ea6bd admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:45.911253 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1396/2798] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:45.916728 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955b7c4-b62f-4508-aa42-69264e561df3 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:45.931789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5955b7c4-b62f-4508-aa42-69264e561df3 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:45.940434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfe26a-143f-4667-89c8-5bcfab2e8ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:45.940434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfe26a-143f-4667-89c8-5bcfab2e8ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:45.940434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfe26a-143f-4667-89c8-5bcfab2e8ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:45.940434 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bfe26a-143f-4667-89c8-5bcfab2e8ed1 admin admin] PATH_INFO: `/v3/projects/e91ba5cb82c54ee9a650139c1453773a/users/e389bda7cd0945459b78acf00cd11774/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:45.959785 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bfe26a-143f-4667-89c8-5bcfab2e8ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91ba5cb82c54ee9a650139c1453773a, user_id=e389bda7cd0945459b78acf00cd11774, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:45.962788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bfe26a-143f-4667-89c8-5bcfab2e8ed1 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:46.083946 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1403/2799] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:45 2022] PUT /identity/v3/projects/e91ba5cb82c54ee9a650139c1453773a/users/e389bda7cd0945459b78acf00cd11774/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:46.089518 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a87db-bcf0-4c5c-a48d-defdf07ea6bd admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:46.105022 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6a87db-bcf0-4c5c-a48d-defdf07ea6bd admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:46.181746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de671004-65b7-4e1f-8978-fc1487f83cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:46.182885 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de671004-65b7-4e1f-8978-fc1487f83cac admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:46.183362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de671004-65b7-4e1f-8978-fc1487f83cac admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:46.183789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de671004-65b7-4e1f-8978-fc1487f83cac admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:46.184642 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de671004-65b7-4e1f-8978-fc1487f83cac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:46.186526 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de671004-65b7-4e1f-8978-fc1487f83cac admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:46.200961 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1397/2800] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:15:46.206262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfe26a-143f-4667-89c8-5bcfab2e8ed1 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:46.218767 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bfe26a-143f-4667-89c8-5bcfab2e8ed1 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:46.223778 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d32cd5-7457-4605-b48d-f48c03692239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:46.228768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32cd5-7457-4605-b48d-f48c03692239 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:46.228768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32cd5-7457-4605-b48d-f48c03692239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:46.228768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d32cd5-7457-4605-b48d-f48c03692239 admin admin] PATH_INFO: `/v3/projects/e91ba5cb82c54ee9a650139c1453773a/users/e389bda7cd0945459b78acf00cd11774/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:46.228768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d32cd5-7457-4605-b48d-f48c03692239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e91ba5cb82c54ee9a650139c1453773a, user_id=e389bda7cd0945459b78acf00cd11774, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:46.230235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d32cd5-7457-4605-b48d-f48c03692239 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:46.243279 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1404/2801] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:15:46 2022] PUT /identity/v3/projects/e91ba5cb82c54ee9a650139c1453773a/users/e389bda7cd0945459b78acf00cd11774/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:46.256958 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b6ba-3257-4e3b-b112-c62beaf4a434 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:46.274994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b6ba-3257-4e3b-b112-c62beaf4a434 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:46.274994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4b6ba-3257-4e3b-b112-c62beaf4a434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:46.295057 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-49f4b6ba-3257-4e3b-b112-c62beaf4a434 None None] MFA Rules not processed for user `e389bda7cd0945459b78acf00cd11774`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:46.296426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-49f4b6ba-3257-4e3b-b112-c62beaf4a434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:46.396019 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1398/2802] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:46.417879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d32cd5-7457-4605-b48d-f48c03692239 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:46.417879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-74d32cd5-7457-4605-b48d-f48c03692239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:46.497869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d32cd5-7457-4605-b48d-f48c03692239 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:46.501467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cb48b-c13e-4ad9-86f2-169385cc8b2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:46.502102 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cb48b-c13e-4ad9-86f2-169385cc8b2e service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:46.502440 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cb48b-c13e-4ad9-86f2-169385cc8b2e service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:46.502812 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cb48b-c13e-4ad9-86f2-169385cc8b2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:46.578517 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cb48b-c13e-4ad9-86f2-169385cc8b2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:46.580480 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cb48b-c13e-4ad9-86f2-169385cc8b2e service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:46.594742 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1405/2803] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:49.154299 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4b6ba-3257-4e3b-b112-c62beaf4a434 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:49.161285 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-49f4b6ba-3257-4e3b-b112-c62beaf4a434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:49.172269 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:49.185576 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4b6ba-3257-4e3b-b112-c62beaf4a434 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:49.189897 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d978be67-ec8b-4ea6-95b5-407899c546e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:49.193835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978be67-ec8b-4ea6-95b5-407899c546e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:49.193835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978be67-ec8b-4ea6-95b5-407899c546e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:49.193835 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d978be67-ec8b-4ea6-95b5-407899c546e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:49.292296 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978be67-ec8b-4ea6-95b5-407899c546e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:49.294202 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d978be67-ec8b-4ea6-95b5-407899c546e5 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:49.307834 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1399/2804] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:49.355584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:51.037180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:51.241667 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cb48b-c13e-4ad9-86f2-169385cc8b2e service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:51.250038 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:51.257183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cb48b-c13e-4ad9-86f2-169385cc8b2e service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:51.263538 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad50a6-73fb-4834-b883-adf295585aec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:51.264912 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad50a6-73fb-4834-b883-adf295585aec service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:51.265306 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad50a6-73fb-4834-b883-adf295585aec service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:51.265732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad50a6-73fb-4834-b883-adf295585aec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:51.284565 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad50a6-73fb-4834-b883-adf295585aec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:51.286375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad50a6-73fb-4834-b883-adf295585aec service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:51.312016 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1406/2805] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:51 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:51.535594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a22d7-7a7c-4e8c-a670-e856e1dfc6a5 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:51.536175 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a22d7-7a7c-4e8c-a670-e856e1dfc6a5 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:51.536559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a22d7-7a7c-4e8c-a670-e856e1dfc6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:51.574240 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c59a22d7-7a7c-4e8c-a670-e856e1dfc6a5 None None] MFA Rules not processed for user `d4b8fa0876f345abb4c84a57d79fccbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:51.575730 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c59a22d7-7a7c-4e8c-a670-e856e1dfc6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:51.714850 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1400/2806] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:51.732626 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad50a6-73fb-4834-b883-adf295585aec service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:51.734890 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-3aad50a6-73fb-4834-b883-adf295585aec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:51.825867 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad50a6-73fb-4834-b883-adf295585aec service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:51.832326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44343bd6-b533-4b5d-bef1-6bb7a16335bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:51.833010 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343bd6-b533-4b5d-bef1-6bb7a16335bb service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:51.833329 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343bd6-b533-4b5d-bef1-6bb7a16335bb service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:51.833755 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44343bd6-b533-4b5d-bef1-6bb7a16335bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:51.843890 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44343bd6-b533-4b5d-bef1-6bb7a16335bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:51.845506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44343bd6-b533-4b5d-bef1-6bb7a16335bb service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:51.857009 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1407/2807] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:53.144281 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:53.389655 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:55.146082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ce38d-f421-47c7-8e90-bdfdcc796391 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:55.146082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ce38d-f421-47c7-8e90-bdfdcc796391 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:55.146082 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64ce38d-f421-47c7-8e90-bdfdcc796391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:55.194326 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a64ce38d-f421-47c7-8e90-bdfdcc796391 None None] MFA Rules not processed for user `d4b8fa0876f345abb4c84a57d79fccbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:55.195942 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a64ce38d-f421-47c7-8e90-bdfdcc796391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:55.212175 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1401/2808] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:55.713835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44343bd6-b533-4b5d-bef1-6bb7a16335bb service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:55.791297 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44343bd6-b533-4b5d-bef1-6bb7a16335bb service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:55.795556 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd6e18-6084-4925-b865-93d9fa405e3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:55.796648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd6e18-6084-4925-b865-93d9fa405e3d service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:55.796853 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd6e18-6084-4925-b865-93d9fa405e3d service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:55.797229 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd6e18-6084-4925-b865-93d9fa405e3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:55.799555 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-14bd6e18-6084-4925-b865-93d9fa405e3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:55.815472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd6e18-6084-4925-b865-93d9fa405e3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:55.815472 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd6e18-6084-4925-b865-93d9fa405e3d service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:55.828107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1408/2809] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:56.571438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ce38d-f421-47c7-8e90-bdfdcc796391 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:56.695037 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64ce38d-f421-47c7-8e90-bdfdcc796391 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:56.701166 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0bcd97-b0f2-4c77-8d4b-1c50caf09bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:56.702858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bcd97-b0f2-4c77-8d4b-1c50caf09bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:56.702858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bcd97-b0f2-4c77-8d4b-1c50caf09bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:56.702858 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0bcd97-b0f2-4c77-8d4b-1c50caf09bcb admin admin] PATH_INFO: `/v3/users/574e2fe202e948f7b00826819ee7daf1` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:56.704222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0bcd97-b0f2-4c77-8d4b-1c50caf09bcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=574e2fe202e948f7b00826819ee7daf1)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:56.706236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0bcd97-b0f2-4c77-8d4b-1c50caf09bcb admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:57.046973 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2e0bcd97-b0f2-4c77-8d4b-1c50caf09bcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574e2fe202e948f7b00826819ee7daf1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:57.048531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2e0bcd97-b0f2-4c77-8d4b-1c50caf09bcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574e2fe202e948f7b00826819ee7daf1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:57.049445 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2e0bcd97-b0f2-4c77-8d4b-1c50caf09bcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574e2fe202e948f7b00826819ee7daf1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:57.061021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2e0bcd97-b0f2-4c77-8d4b-1c50caf09bcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574e2fe202e948f7b00826819ee7daf1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:57.079746 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-2e0bcd97-b0f2-4c77-8d4b-1c50caf09bcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574e2fe202e948f7b00826819ee7daf1'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:57.081899 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:57.162837 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d1e25-55c9-4f05-973f-06cba4c8c38d None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:57.163899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d1e25-55c9-4f05-973f-06cba4c8c38d None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:57.163899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d1e25-55c9-4f05-973f-06cba4c8c38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:57.186041 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-629d1e25-55c9-4f05-973f-06cba4c8c38d None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:57.187267 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-629d1e25-55c9-4f05-973f-06cba4c8c38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:57.221271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1402/2810] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:56 2022] DELETE /identity/v3/users/574e2fe202e948f7b00826819ee7daf1 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:15:57.225665 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cd6ce-0002-4dc4-af85-99afb1ec8090 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:57.226230 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cd6ce-0002-4dc4-af85-99afb1ec8090 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:57.227355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cd6ce-0002-4dc4-af85-99afb1ec8090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:57.255627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-c52cd6ce-0002-4dc4-af85-99afb1ec8090 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:15:57.256985 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:57.262184 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c52cd6ce-0002-4dc4-af85-99afb1ec8090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:57.281909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1409/2811] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:15:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:15:57.390852 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1403/2812] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:15:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:15:57.402946 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d1e25-55c9-4f05-973f-06cba4c8c38d None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:57.405056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-629d1e25-55c9-4f05-973f-06cba4c8c38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:57.423244 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d1e25-55c9-4f05-973f-06cba4c8c38d None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:57.479893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cd6ce-0002-4dc4-af85-99afb1ec8090 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:57.479893 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-c52cd6ce-0002-4dc4-af85-99afb1ec8090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:57.514262 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da7a88-f964-42a4-b6ae-e4ef11b5300f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:57.514890 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da7a88-f964-42a4-b6ae-e4ef11b5300f service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:57.516158 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da7a88-f964-42a4-b6ae-e4ef11b5300f service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:57.516436 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2da7a88-f964-42a4-b6ae-e4ef11b5300f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:57.526597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da7a88-f964-42a4-b6ae-e4ef11b5300f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:57.531401 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2da7a88-f964-42a4-b6ae-e4ef11b5300f service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:57.540088 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1410/2813] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:15:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:15:57.585392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cd6ce-0002-4dc4-af85-99afb1ec8090 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:57.594271 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a3a9d-47c6-4d1a-94ee-c238f53f9619 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:57.595633 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a3a9d-47c6-4d1a-94ee-c238f53f9619 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:57.597110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a3a9d-47c6-4d1a-94ee-c238f53f9619 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:57.597562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a3a9d-47c6-4d1a-94ee-c238f53f9619 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:57.686889 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a3a9d-47c6-4d1a-94ee-c238f53f9619 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:57.688524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a3a9d-47c6-4d1a-94ee-c238f53f9619 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:57.697435 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1404/2814] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:15:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:15:58.225464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da7a88-f964-42a4-b6ae-e4ef11b5300f service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:58.226927 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e2da7a88-f964-42a4-b6ae-e4ef11b5300f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:58.252825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2da7a88-f964-42a4-b6ae-e4ef11b5300f service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:58.267561 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:58.268326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:58.268788 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:58.269224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] PATH_INFO: `/v3/projects/92922a52af3d479b8b7415a0fae8c9cd` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:58.271268 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] RBAC: Authorizing `identity:delete_project(project_id=92922a52af3d479b8b7415a0fae8c9cd)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:58.273685 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:58.493698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92922a52af3d479b8b7415a0fae8c9cd', 'request_id': 'req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:58.512327 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92922a52af3d479b8b7415a0fae8c9cd', 'request_id': 'req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:58.530809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92922a52af3d479b8b7415a0fae8c9cd', 'request_id': 'req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:58.631255 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] The token cache is being invalidate because project 92922a52af3d479b8b7415a0fae8c9cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:15:58.632054 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:58.633834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:58.637554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1411/2815] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:58 2022] DELETE /identity/v3/projects/92922a52af3d479b8b7415a0fae8c9cd => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:58.642420 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a3a9d-47c6-4d1a-94ee-c238f53f9619 service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:58.664248 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a3a9d-47c6-4d1a-94ee-c238f53f9619 service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:15:58.761950 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:15:58.849314 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e400d3-b3c4-4985-a378-eca519d9cd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:15:58.850327 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e400d3-b3c4-4985-a378-eca519d9cd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:15:58.850775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e400d3-b3c4-4985-a378-eca519d9cd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:15:58.851208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e400d3-b3c4-4985-a378-eca519d9cd21 admin admin] PATH_INFO: `/v3/users/a73144b724744c699ad8def17cd1394a` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:15:58.853304 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e400d3-b3c4-4985-a378-eca519d9cd21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73144b724744c699ad8def17cd1394a)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:15:58.859488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e400d3-b3c4-4985-a378-eca519d9cd21 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:15:59.120331 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b0e400d3-b3c4-4985-a378-eca519d9cd21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73144b724744c699ad8def17cd1394a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:59.125617 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b0e400d3-b3c4-4985-a378-eca519d9cd21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73144b724744c699ad8def17cd1394a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:59.126946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b0e400d3-b3c4-4985-a378-eca519d9cd21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73144b724744c699ad8def17cd1394a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:59.148205 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b0e400d3-b3c4-4985-a378-eca519d9cd21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73144b724744c699ad8def17cd1394a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:59.174026 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b0e400d3-b3c4-4985-a378-eca519d9cd21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73144b724744c699ad8def17cd1394a'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:15:59.271048 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1405/2816] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:15:58 2022] DELETE /identity/v3/users/a73144b724744c699ad8def17cd1394a => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:15:59.962721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:15:59.964827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:15:59.993494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c8bba-e4f5-477b-96c1-7a7c32cb308a admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:16:00.119670 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:16:00.121579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:16:00.122714 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:16:00.123614 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] PATH_INFO: `/v3/projects/f391c4350bc84c64ba711804c8f7a7c3` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:16:00.125508 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f391c4350bc84c64ba711804c8f7a7c3)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:16:00.130208 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:16:00.158091 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:00.308511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f391c4350bc84c64ba711804c8f7a7c3', 'request_id': 'req-1bd07208-cc0d-4035-bc76-f43b6217ea3b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:00.320320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f391c4350bc84c64ba711804c8f7a7c3', 'request_id': 'req-1bd07208-cc0d-4035-bc76-f43b6217ea3b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:00.328554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f391c4350bc84c64ba711804c8f7a7c3', 'request_id': 'req-1bd07208-cc0d-4035-bc76-f43b6217ea3b'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:00.443914 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] The token cache is being invalidate because project f391c4350bc84c64ba711804c8f7a7c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:16:00.444218 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:00.444931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:00.448183 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1412/2817] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:15:59 2022] DELETE /identity/v3/projects/f391c4350bc84c64ba711804c8f7a7c3 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:16:00.454246 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e400d3-b3c4-4985-a378-eca519d9cd21 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:16:00.456497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b0e400d3-b3c4-4985-a378-eca519d9cd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:16:00.472921 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e400d3-b3c4-4985-a378-eca519d9cd21 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:16:00.580707 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599e3c7-cc54-4042-afbc-5fddbb6688ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:16:00.581426 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599e3c7-cc54-4042-afbc-5fddbb6688ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:16:00.581718 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599e3c7-cc54-4042-afbc-5fddbb6688ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:16:00.582354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599e3c7-cc54-4042-afbc-5fddbb6688ea admin admin] PATH_INFO: `/v3/users/e389bda7cd0945459b78acf00cd11774` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:16:00.585705 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599e3c7-cc54-4042-afbc-5fddbb6688ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=e389bda7cd0945459b78acf00cd11774)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:16:00.588354 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f599e3c7-cc54-4042-afbc-5fddbb6688ea admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:16:00.816375 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f599e3c7-cc54-4042-afbc-5fddbb6688ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e389bda7cd0945459b78acf00cd11774'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:00.817044 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f599e3c7-cc54-4042-afbc-5fddbb6688ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e389bda7cd0945459b78acf00cd11774'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:00.818439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f599e3c7-cc54-4042-afbc-5fddbb6688ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e389bda7cd0945459b78acf00cd11774'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:00.827385 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:00.831222 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f599e3c7-cc54-4042-afbc-5fddbb6688ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e389bda7cd0945459b78acf00cd11774'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:00.850691 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-f599e3c7-cc54-4042-afbc-5fddbb6688ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e389bda7cd0945459b78acf00cd11774'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:00.933006 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1406/2818] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:16:00 2022] DELETE /identity/v3/users/e389bda7cd0945459b78acf00cd11774 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:16:01.884586 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:16:01.886829 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:16:01.906019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd07208-cc0d-4035-bc76-f43b6217ea3b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:16:02.018787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:16:02.019430 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:16:02.019753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:16:02.020018 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] PATH_INFO: `/v3/projects/e91ba5cb82c54ee9a650139c1453773a` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:16:02.021186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e91ba5cb82c54ee9a650139c1453773a)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:16:02.025969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:16:02.199193 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e91ba5cb82c54ee9a650139c1453773a', 'request_id': 'req-f98aa7db-e58a-4075-b767-203b028028aa'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:02.208150 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e91ba5cb82c54ee9a650139c1453773a', 'request_id': 'req-f98aa7db-e58a-4075-b767-203b028028aa'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:02.216675 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e91ba5cb82c54ee9a650139c1453773a', 'request_id': 'req-f98aa7db-e58a-4075-b767-203b028028aa'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:02.392126 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] The token cache is being invalidate because project e91ba5cb82c54ee9a650139c1453773a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:16:02.392597 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:02.393445 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:02.395649 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1413/2819] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:16:01 2022] DELETE /identity/v3/projects/e91ba5cb82c54ee9a650139c1453773a => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:16:08.151095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de9f6a-11be-4709-8566-6d14b12b8b13 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:16:08.152292 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de9f6a-11be-4709-8566-6d14b12b8b13 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:16:08.152900 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de9f6a-11be-4709-8566-6d14b12b8b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:16:08.211054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a7de9f6a-11be-4709-8566-6d14b12b8b13 None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:16:08.212285 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a7de9f6a-11be-4709-8566-6d14b12b8b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:16:08.287674 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1407/2820] 10.222.0.62 () {58 vars in 967 bytes} [Wed Aug 24 08:16:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:16:08.324686 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:16:08.326787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:16:08.416579 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:08.461534 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aa7db-e58a-4075-b767-203b028028aa admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:16:08.472328 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23446fa4-ebd3-4be1-bdc5-3a2517bd7eeb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:16:08.473884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23446fa4-ebd3-4be1-bdc5-3a2517bd7eeb service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:16:08.473884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23446fa4-ebd3-4be1-bdc5-3a2517bd7eeb service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:16:08.473884 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23446fa4-ebd3-4be1-bdc5-3a2517bd7eeb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:16:08.483719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23446fa4-ebd3-4be1-bdc5-3a2517bd7eeb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:16:08.485227 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23446fa4-ebd3-4be1-bdc5-3a2517bd7eeb service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:16:08.494524 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1414/2821] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:16:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:16:18.279602 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=34,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:18.797475 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=16 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:19.799289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508cb79-0b18-4f31-8864-aa947696c162 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:16:19.799914 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508cb79-0b18-4f31-8864-aa947696c162 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:16:19.800583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508cb79-0b18-4f31-8864-aa947696c162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:16:19.831927 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a508cb79-0b18-4f31-8864-aa947696c162 None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:16:19.833291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a508cb79-0b18-4f31-8864-aa947696c162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:16:19.843195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1408/2822] 10.222.0.62 () {58 vars in 967 bytes} [Wed Aug 24 08:16:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:16:19.858812 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23446fa4-ebd3-4be1-bdc5-3a2517bd7eeb service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:16:19.870312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23446fa4-ebd3-4be1-bdc5-3a2517bd7eeb service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:16:19.877611 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2609cb6-f73a-4499-90be-2bd9764177bb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:16:19.880443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2609cb6-f73a-4499-90be-2bd9764177bb service swift] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:16:19.880443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2609cb6-f73a-4499-90be-2bd9764177bb service swift] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:16:19.880443 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2609cb6-f73a-4499-90be-2bd9764177bb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:16:19.888835 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2609cb6-f73a-4499-90be-2bd9764177bb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:16:19.890476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2609cb6-f73a-4499-90be-2bd9764177bb service swift] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:16:19.899917 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1415/2823] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:16:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:16:20.394329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508cb79-0b18-4f31-8864-aa947696c162 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:16:20.395789 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a508cb79-0b18-4f31-8864-aa947696c162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:16:20.483013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508cb79-0b18-4f31-8864-aa947696c162 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:16:20.489612 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71029d11-4eee-4be6-a5fd-ba4fee51e479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:16:20.490539 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71029d11-4eee-4be6-a5fd-ba4fee51e479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:16:20.490968 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71029d11-4eee-4be6-a5fd-ba4fee51e479 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:16:20.491379 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71029d11-4eee-4be6-a5fd-ba4fee51e479 admin admin] PATH_INFO: `/v3/users/3a971d4b3ffb435cb3227385d80277d3` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:16:20.493114 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71029d11-4eee-4be6-a5fd-ba4fee51e479 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a971d4b3ffb435cb3227385d80277d3)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:16:20.496289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71029d11-4eee-4be6-a5fd-ba4fee51e479 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:16:20.777135 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-71029d11-4eee-4be6-a5fd-ba4fee51e479 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a971d4b3ffb435cb3227385d80277d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:20.777833 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-71029d11-4eee-4be6-a5fd-ba4fee51e479 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a971d4b3ffb435cb3227385d80277d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:20.778583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-71029d11-4eee-4be6-a5fd-ba4fee51e479 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a971d4b3ffb435cb3227385d80277d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:20.791239 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-71029d11-4eee-4be6-a5fd-ba4fee51e479 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a971d4b3ffb435cb3227385d80277d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:20.806913 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-71029d11-4eee-4be6-a5fd-ba4fee51e479 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a971d4b3ffb435cb3227385d80277d3'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:20.917743 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1409/2824] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:16:20 2022] DELETE /identity/v3/users/3a971d4b3ffb435cb3227385d80277d3 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:16:21.194365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2609cb6-f73a-4499-90be-2bd9764177bb service swift] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:16:21.209650 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2609cb6-f73a-4499-90be-2bd9764177bb service swift] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:16:21.284540 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:16:21.285465 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:16:21.285880 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:16:21.286287 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] PATH_INFO: `/v3/projects/38c096f91e0c44a8b46c07e5aaf54b47` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:16:21.288149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38c096f91e0c44a8b46c07e5aaf54b47)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:16:21.291206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:16:21.464973 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38c096f91e0c44a8b46c07e5aaf54b47', 'request_id': 'req-8de63189-5016-49af-9c06-619851bb42f8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:21.472037 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38c096f91e0c44a8b46c07e5aaf54b47', 'request_id': 'req-8de63189-5016-49af-9c06-619851bb42f8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:21.479827 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38c096f91e0c44a8b46c07e5aaf54b47', 'request_id': 'req-8de63189-5016-49af-9c06-619851bb42f8'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:21.557141 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] The token cache is being invalidate because project 38c096f91e0c44a8b46c07e5aaf54b47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:16:21.557537 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:21.558628 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:21.560819 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1416/2825] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:16:21 2022] DELETE /identity/v3/projects/38c096f91e0c44a8b46c07e5aaf54b47 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:16:21.568236 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71029d11-4eee-4be6-a5fd-ba4fee51e479 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:16:21.569722 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-71029d11-4eee-4be6-a5fd-ba4fee51e479 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:16:21.590166 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71029d11-4eee-4be6-a5fd-ba4fee51e479 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:16:21.645818 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090aba7c-df9e-4108-9839-bab47b78a3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:16:21.646447 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aba7c-df9e-4108-9839-bab47b78a3f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:16:21.646733 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aba7c-df9e-4108-9839-bab47b78a3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:16:21.647143 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090aba7c-df9e-4108-9839-bab47b78a3f6 admin admin] PATH_INFO: `/v3/users/2e4b7284faaf4dee9f87bdccdd8b5c98` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:16:21.648392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090aba7c-df9e-4108-9839-bab47b78a3f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e4b7284faaf4dee9f87bdccdd8b5c98)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:16:21.650333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090aba7c-df9e-4108-9839-bab47b78a3f6 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:16:21.667704 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:21.847279 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-090aba7c-df9e-4108-9839-bab47b78a3f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e4b7284faaf4dee9f87bdccdd8b5c98'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:21.848052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-090aba7c-df9e-4108-9839-bab47b78a3f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e4b7284faaf4dee9f87bdccdd8b5c98'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:21.848685 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-090aba7c-df9e-4108-9839-bab47b78a3f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e4b7284faaf4dee9f87bdccdd8b5c98'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:21.856371 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-090aba7c-df9e-4108-9839-bab47b78a3f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e4b7284faaf4dee9f87bdccdd8b5c98'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:21.868651 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-090aba7c-df9e-4108-9839-bab47b78a3f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e4b7284faaf4dee9f87bdccdd8b5c98'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:21.961274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1410/2826] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:16:21 2022] DELETE /identity/v3/users/2e4b7284faaf4dee9f87bdccdd8b5c98 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:16:22.264875 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:16:22.266763 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:16:22.285508 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de63189-5016-49af-9c06-619851bb42f8 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:16:22.351022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:16:22.351594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:16:22.351925 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:16:22.352186 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] PATH_INFO: `/v3/projects/88d1532e25974dcdbb8b9386a923e872` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:16:22.358204 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=88d1532e25974dcdbb8b9386a923e872)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:16:22.358204 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:16:22.382536 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:22.502371 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88d1532e25974dcdbb8b9386a923e872', 'request_id': 'req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:22.509591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88d1532e25974dcdbb8b9386a923e872', 'request_id': 'req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:22.516062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88d1532e25974dcdbb8b9386a923e872', 'request_id': 'req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:22.627712 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] The token cache is being invalidate because project 88d1532e25974dcdbb8b9386a923e872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:16:22.628037 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:22.628681 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:22.630225 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1417/2827] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:16:22 2022] DELETE /identity/v3/projects/88d1532e25974dcdbb8b9386a923e872 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:16:23.400088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090aba7c-df9e-4108-9839-bab47b78a3f6 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:16:23.401574 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-090aba7c-df9e-4108-9839-bab47b78a3f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:16:23.415563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090aba7c-df9e-4108-9839-bab47b78a3f6 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:16:23.473208 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afff32-e933-4973-b259-0f8d6ad52baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:16:23.473837 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afff32-e933-4973-b259-0f8d6ad52baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:16:23.474113 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afff32-e933-4973-b259-0f8d6ad52baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:16:23.474380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13afff32-e933-4973-b259-0f8d6ad52baf admin admin] PATH_INFO: `/v3/users/f8551bbc736a479593785a2772ba10bd` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:16:23.475492 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afff32-e933-4973-b259-0f8d6ad52baf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8551bbc736a479593785a2772ba10bd)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:16:23.477494 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13afff32-e933-4973-b259-0f8d6ad52baf admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:16:23.727351 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-13afff32-e933-4973-b259-0f8d6ad52baf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8551bbc736a479593785a2772ba10bd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:23.727971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-13afff32-e933-4973-b259-0f8d6ad52baf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8551bbc736a479593785a2772ba10bd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:23.728569 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-13afff32-e933-4973-b259-0f8d6ad52baf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8551bbc736a479593785a2772ba10bd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:23.736554 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-13afff32-e933-4973-b259-0f8d6ad52baf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8551bbc736a479593785a2772ba10bd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:23.748484 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-13afff32-e933-4973-b259-0f8d6ad52baf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8551bbc736a479593785a2772ba10bd'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:23.871508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1411/2828] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:16:23 2022] DELETE /identity/v3/users/f8551bbc736a479593785a2772ba10bd => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:16:24.126372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:16:24.128046 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:16:24.142161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a521778-f3e7-4e05-9ac8-0c9091dbfa8c admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:16:24.202481 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:16:24.203149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:16:24.203451 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:16:24.203719 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] PATH_INFO: `/v3/projects/e2379f8ec3304ea3a226891498d0263c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:16:24.204898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2379f8ec3304ea3a226891498d0263c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:16:24.206819 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:16:24.352384 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2379f8ec3304ea3a226891498d0263c', 'request_id': 'req-44edf561-9e0a-4b40-a899-0f425231c440'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:24.359366 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2379f8ec3304ea3a226891498d0263c', 'request_id': 'req-44edf561-9e0a-4b40-a899-0f425231c440'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:24.364893 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2379f8ec3304ea3a226891498d0263c', 'request_id': 'req-44edf561-9e0a-4b40-a899-0f425231c440'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:24.465435 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] The token cache is being invalidate because project e2379f8ec3304ea3a226891498d0263c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:16:24.465727 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:24.467023 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:16:24.468723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1418/2829] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:16:24 2022] DELETE /identity/v3/projects/e2379f8ec3304ea3a226891498d0263c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:16:33.867962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=74,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:16:34.462179 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=67,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:17:36.497308 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afff32-e933-4973-b259-0f8d6ad52baf admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:17:36.499274 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-13afff32-e933-4973-b259-0f8d6ad52baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:17:36.649563 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13afff32-e933-4973-b259-0f8d6ad52baf admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:17:36.711486 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad009f3b-4668-4b40-98ba-4134dd056536 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213e29685f3402b804d4d8fbc88ba96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:17:36.712129 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad009f3b-4668-4b40-98ba-4134dd056536 service placement] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:17:36.712415 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad009f3b-4668-4b40-98ba-4134dd056536 service placement] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:17:36.712694 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad009f3b-4668-4b40-98ba-4134dd056536 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:17:36.714484 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ad009f3b-4668-4b40-98ba-4134dd056536 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:17:36.726481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad009f3b-4668-4b40-98ba-4134dd056536 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:17:36.728093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad009f3b-4668-4b40-98ba-4134dd056536 service placement] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:17:36.739161 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1412/2830] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:17:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:17:46.734803 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:18:34.010293 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:18:34.011781 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:18:34.098814 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44edf561-9e0a-4b40-a899-0f425231c440 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:18:34.105153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6c22b-8f01-42d2-9f27-c34c5792f6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:18:34.105772 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c22b-8f01-42d2-9f27-c34c5792f6fe service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:18:34.106053 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c22b-8f01-42d2-9f27-c34c5792f6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:18:34.106324 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6c22b-8f01-42d2-9f27-c34c5792f6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:18:34.108764 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-29f6c22b-8f01-42d2-9f27-c34c5792f6fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:18:34.202202 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6c22b-8f01-42d2-9f27-c34c5792f6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:18:34.203726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6c22b-8f01-42d2-9f27-c34c5792f6fe service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:18:34.226380 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1419/2831] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:18:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:18:35.414428 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad009f3b-4668-4b40-98ba-4134dd056536 service placement] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:18:35.415978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ad009f3b-4668-4b40-98ba-4134dd056536 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:18:35.430472 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad009f3b-4668-4b40-98ba-4134dd056536 service placement] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:18:35.436155 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b2208-0388-4bf5-9b5c-38c63714c0d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:18:35.436967 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b2208-0388-4bf5-9b5c-38c63714c0d5 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:18:35.437362 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b2208-0388-4bf5-9b5c-38c63714c0d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:18:35.437637 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b2208-0388-4bf5-9b5c-38c63714c0d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:18:35.439508 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-819b2208-0388-4bf5-9b5c-38c63714c0d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:18:35.454548 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b2208-0388-4bf5-9b5c-38c63714c0d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:18:35.455996 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b2208-0388-4bf5-9b5c-38c63714c0d5 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:18:35.480481 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1413/2832] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:18:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:18:43.334851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546186b9-f5d3-4c52-ab5f-cfb5c69e3604 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:18:43.335389 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546186b9-f5d3-4c52-ab5f-cfb5c69e3604 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:18:43.335511 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546186b9-f5d3-4c52-ab5f-cfb5c69e3604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:18:43.355744 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-546186b9-f5d3-4c52-ab5f-cfb5c69e3604 None None] MFA Rules not processed for user `d4b8fa0876f345abb4c84a57d79fccbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:18:43.357082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-546186b9-f5d3-4c52-ab5f-cfb5c69e3604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:18:43.404133 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=100 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:18:43.415131 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1420/2833] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:18:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:18:45.462645 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=6 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:18:53.432281 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=2 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:19:38.119500 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b2208-0388-4bf5-9b5c-38c63714c0d5 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:19:38.130113 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b2208-0388-4bf5-9b5c-38c63714c0d5 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:19:38.134491 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f14a5e-fc7a-4bee-a09e-725a391ee463 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:19:38.135109 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f14a5e-fc7a-4bee-a09e-725a391ee463 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:19:38.135389 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f14a5e-fc7a-4bee-a09e-725a391ee463 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:19:38.135670 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f14a5e-fc7a-4bee-a09e-725a391ee463 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:19:38.137584 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-37f14a5e-fc7a-4bee-a09e-725a391ee463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:19:38.149355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f14a5e-fc7a-4bee-a09e-725a391ee463 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:19:38.150796 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f14a5e-fc7a-4bee-a09e-725a391ee463 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:19:38.160221 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1414/2834] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:19:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:19:48.156159 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=6 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:19:57.129860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546186b9-f5d3-4c52-ab5f-cfb5c69e3604 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:19:57.131284 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-546186b9-f5d3-4c52-ab5f-cfb5c69e3604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:19:57.147957 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546186b9-f5d3-4c52-ab5f-cfb5c69e3604 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:19:57.160399 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714d097-149c-4730-a28a-86af368f0fba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:19:57.161040 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714d097-149c-4730-a28a-86af368f0fba service nova] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:19:57.161499 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714d097-149c-4730-a28a-86af368f0fba service nova] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:19:57.161779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714d097-149c-4730-a28a-86af368f0fba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:19:57.163668 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6714d097-149c-4730-a28a-86af368f0fba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:19:57.177378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714d097-149c-4730-a28a-86af368f0fba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:19:57.185950 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714d097-149c-4730-a28a-86af368f0fba service nova] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:19:57.192136 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1421/2835] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:19:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:20:07.186912 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=6 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:07.729021 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f14a5e-fc7a-4bee-a09e-725a391ee463 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:07.731585 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-37f14a5e-fc7a-4bee-a09e-725a391ee463 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:07.835878 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f14a5e-fc7a-4bee-a09e-725a391ee463 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:07.841410 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9f8d7a-8af9-4769-8968-bb942ebd7ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:07.842035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8d7a-8af9-4769-8968-bb942ebd7ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:07.842312 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8d7a-8af9-4769-8968-bb942ebd7ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:07.842589 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9f8d7a-8af9-4769-8968-bb942ebd7ba0 admin admin] PATH_INFO: `/v3/users/d4b8fa0876f345abb4c84a57d79fccbb` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:07.843724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f8d7a-8af9-4769-8968-bb942ebd7ba0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b8fa0876f345abb4c84a57d79fccbb)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:07.845683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9f8d7a-8af9-4769-8968-bb942ebd7ba0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:08.041547 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cb9f8d7a-8af9-4769-8968-bb942ebd7ba0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b8fa0876f345abb4c84a57d79fccbb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:08.042288 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cb9f8d7a-8af9-4769-8968-bb942ebd7ba0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b8fa0876f345abb4c84a57d79fccbb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:08.042912 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cb9f8d7a-8af9-4769-8968-bb942ebd7ba0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b8fa0876f345abb4c84a57d79fccbb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:08.049978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cb9f8d7a-8af9-4769-8968-bb942ebd7ba0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b8fa0876f345abb4c84a57d79fccbb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:08.062583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-cb9f8d7a-8af9-4769-8968-bb942ebd7ba0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b8fa0876f345abb4c84a57d79fccbb'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:08.152257 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1415/2836] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:20:07 2022] DELETE /identity/v3/users/d4b8fa0876f345abb4c84a57d79fccbb => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:20:08.438461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714d097-149c-4730-a28a-86af368f0fba service nova] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:08.453040 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714d097-149c-4730-a28a-86af368f0fba service nova] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:08.537142 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20674e3c-185e-41a4-8664-90de7e61f798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:08.537779 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20674e3c-185e-41a4-8664-90de7e61f798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:08.538055 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20674e3c-185e-41a4-8664-90de7e61f798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:08.538326 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20674e3c-185e-41a4-8664-90de7e61f798 admin admin] PATH_INFO: `/v3/projects/6e36b5eaad664a638620b45bbf57ba74` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:08.539476 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20674e3c-185e-41a4-8664-90de7e61f798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e36b5eaad664a638620b45bbf57ba74)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:08.542070 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20674e3c-185e-41a4-8664-90de7e61f798 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:08.642529 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-20674e3c-185e-41a4-8664-90de7e61f798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e36b5eaad664a638620b45bbf57ba74', 'request_id': 'req-20674e3c-185e-41a4-8664-90de7e61f798'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:08.653203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-20674e3c-185e-41a4-8664-90de7e61f798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e36b5eaad664a638620b45bbf57ba74', 'request_id': 'req-20674e3c-185e-41a4-8664-90de7e61f798'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:08.659221 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-20674e3c-185e-41a4-8664-90de7e61f798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e36b5eaad664a638620b45bbf57ba74', 'request_id': 'req-20674e3c-185e-41a4-8664-90de7e61f798'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:08.744594 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-20674e3c-185e-41a4-8664-90de7e61f798 admin admin] The token cache is being invalidate because project 6e36b5eaad664a638620b45bbf57ba74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:20:08.744838 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-20674e3c-185e-41a4-8664-90de7e61f798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:08.745812 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-20674e3c-185e-41a4-8664-90de7e61f798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:08.747800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1422/2837] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:20:08 2022] DELETE /identity/v3/projects/6e36b5eaad664a638620b45bbf57ba74 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:20:08.755401 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f2794-3555-43f2-813a-6bd8f5612b0a None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:08.756041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f2794-3555-43f2-813a-6bd8f5612b0a None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:08.756235 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f2794-3555-43f2-813a-6bd8f5612b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:08.820892 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-292f2794-3555-43f2-813a-6bd8f5612b0a None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:20:08.822447 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-292f2794-3555-43f2-813a-6bd8f5612b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:08.835701 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:08.895392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1416/2838] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:20:08.901516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a90cc-4618-4050-8927-b737805737bf None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:08.905516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a90cc-4618-4050-8927-b737805737bf None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:08.905516 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025a90cc-4618-4050-8927-b737805737bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:08.923308 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-025a90cc-4618-4050-8927-b737805737bf None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:20:08.925169 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-025a90cc-4618-4050-8927-b737805737bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:08.934039 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1423/2839] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:20:08.938457 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f2794-3555-43f2-813a-6bd8f5612b0a None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:08.952400 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f2794-3555-43f2-813a-6bd8f5612b0a None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:08.957162 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f45ec-9583-4d50-9d33-fbe8c0b9d47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:08.957777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f45ec-9583-4d50-9d33-fbe8c0b9d47e admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:08.958290 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f45ec-9583-4d50-9d33-fbe8c0b9d47e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:08.958571 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f45ec-9583-4d50-9d33-fbe8c0b9d47e admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:08.959261 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f45ec-9583-4d50-9d33-fbe8c0b9d47e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:20:08.959564 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f45ec-9583-4d50-9d33-fbe8c0b9d47e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:08.961263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217f45ec-9583-4d50-9d33-fbe8c0b9d47e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:08.976587 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1417/2840] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:20:08.980314 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a90cc-4618-4050-8927-b737805737bf None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:08.989754 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025a90cc-4618-4050-8927-b737805737bf None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:08.995073 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d477c60-1313-4661-bb00-7251d61ed400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:08.995621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d477c60-1313-4661-bb00-7251d61ed400 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:08.995930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d477c60-1313-4661-bb00-7251d61ed400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:08.996206 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d477c60-1313-4661-bb00-7251d61ed400 admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:08.996849 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d477c60-1313-4661-bb00-7251d61ed400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:08.998753 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d477c60-1313-4661-bb00-7251d61ed400 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:09.114302 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1424/2841] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:20:08 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:20:09.118729 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f45ec-9583-4d50-9d33-fbe8c0b9d47e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:09.129233 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217f45ec-9583-4d50-9d33-fbe8c0b9d47e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:09.188693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e6c12-94c1-449a-8b0a-efe8f24ea0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:09.189448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e6c12-94c1-449a-8b0a-efe8f24ea0e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:09.189778 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e6c12-94c1-449a-8b0a-efe8f24ea0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:09.190097 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e6c12-94c1-449a-8b0a-efe8f24ea0e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:09.190771 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e6c12-94c1-449a-8b0a-efe8f24ea0e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:09.192773 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e6c12-94c1-449a-8b0a-efe8f24ea0e4 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:09.283381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1418/2842] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:20:09 2022] POST /identity/v3/users => generated 291 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:20:09.287660 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d477c60-1313-4661-bb00-7251d61ed400 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:09.306591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d477c60-1313-4661-bb00-7251d61ed400 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:09.314065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a30c1d-da9e-44a7-90e7-a5033f92499b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:09.314684 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a30c1d-da9e-44a7-90e7-a5033f92499b admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:09.314965 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a30c1d-da9e-44a7-90e7-a5033f92499b admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:09.315239 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a30c1d-da9e-44a7-90e7-a5033f92499b admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:09.315909 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a30c1d-da9e-44a7-90e7-a5033f92499b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:09.317507 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a30c1d-da9e-44a7-90e7-a5033f92499b admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:09.329288 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1425/2843] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:20:09.333386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e6c12-94c1-449a-8b0a-efe8f24ea0e4 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:09.343874 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e6c12-94c1-449a-8b0a-efe8f24ea0e4 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:09.354217 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcfea2-58fc-4cbd-8612-a7ce12e66a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:09.354853 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcfea2-58fc-4cbd-8612-a7ce12e66a74 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:09.355125 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcfea2-58fc-4cbd-8612-a7ce12e66a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:09.355392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcfea2-58fc-4cbd-8612-a7ce12e66a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:09.356069 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcfea2-58fc-4cbd-8612-a7ce12e66a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:09.357655 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcfea2-58fc-4cbd-8612-a7ce12e66a74 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:09.369658 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1419/2844] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:20:09.373752 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a30c1d-da9e-44a7-90e7-a5033f92499b admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:09.385312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a30c1d-da9e-44a7-90e7-a5033f92499b admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:09.390033 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be2e8d-1848-400b-99b4-a1d4f980c5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:09.390696 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be2e8d-1848-400b-99b4-a1d4f980c5f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:09.390991 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be2e8d-1848-400b-99b4-a1d4f980c5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:09.391240 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9be2e8d-1848-400b-99b4-a1d4f980c5f7 admin admin] PATH_INFO: `/v3/projects/6171cded28e449658c868238bb7b86f5/users/35698a73ff2842c2a85b1698ac9a8363/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:09.407251 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be2e8d-1848-400b-99b4-a1d4f980c5f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6171cded28e449658c868238bb7b86f5, user_id=35698a73ff2842c2a85b1698ac9a8363, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:09.409899 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9be2e8d-1848-400b-99b4-a1d4f980c5f7 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:09.529932 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1426/2845] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:20:09 2022] PUT /identity/v3/projects/6171cded28e449658c868238bb7b86f5/users/35698a73ff2842c2a85b1698ac9a8363/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:20:09.550224 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5ca4f-bd97-4d18-b0cb-dd2578cb79f4 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:09.550453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5ca4f-bd97-4d18-b0cb-dd2578cb79f4 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:09.550877 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5ca4f-bd97-4d18-b0cb-dd2578cb79f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:09.578727 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-1ed5ca4f-bd97-4d18-b0cb-dd2578cb79f4 None None] MFA Rules not processed for user `35698a73ff2842c2a85b1698ac9a8363`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:20:09.579964 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-1ed5ca4f-bd97-4d18-b0cb-dd2578cb79f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:09.647339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1420/2846] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:20:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:20:09.652694 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be2e8d-1848-400b-99b4-a1d4f980c5f7 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:09.672557 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:09.716794 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9be2e8d-1848-400b-99b4-a1d4f980c5f7 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:09.721504 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba4045-ca66-4b05-b1fc-ac356c84634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:09.722104 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba4045-ca66-4b05-b1fc-ac356c84634d admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:09.722378 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba4045-ca66-4b05-b1fc-ac356c84634d admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:09.722647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba4045-ca66-4b05-b1fc-ac356c84634d admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:09.723372 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba4045-ca66-4b05-b1fc-ac356c84634d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:09.725294 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba4045-ca66-4b05-b1fc-ac356c84634d admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:09.793115 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1427/2847] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:20:09 2022] POST /identity/v3/projects => generated 383 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:20:09.797465 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5ca4f-bd97-4d18-b0cb-dd2578cb79f4 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:09.808919 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5ca4f-bd97-4d18-b0cb-dd2578cb79f4 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:09.821650 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:09.868946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192deffd-9269-46d8-94d6-998ff3dce9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:09.869568 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192deffd-9269-46d8-94d6-998ff3dce9f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:09.869847 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192deffd-9269-46d8-94d6-998ff3dce9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:09.870119 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192deffd-9269-46d8-94d6-998ff3dce9f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:09.870749 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192deffd-9269-46d8-94d6-998ff3dce9f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:09.872688 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192deffd-9269-46d8-94d6-998ff3dce9f3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:09.955497 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1421/2848] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:20:09 2022] POST /identity/v3/users => generated 298 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:20:09.959928 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba4045-ca66-4b05-b1fc-ac356c84634d admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:09.976676 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba4045-ca66-4b05-b1fc-ac356c84634d admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:09.981988 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da71555-0986-4582-8b45-c541141cdcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:09.982609 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da71555-0986-4582-8b45-c541141cdcee admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:09.982889 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da71555-0986-4582-8b45-c541141cdcee admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:09.983161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da71555-0986-4582-8b45-c541141cdcee admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:09.983810 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da71555-0986-4582-8b45-c541141cdcee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:09.985453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da71555-0986-4582-8b45-c541141cdcee admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:09.997492 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1428/2849] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 08:20:10.001973 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192deffd-9269-46d8-94d6-998ff3dce9f3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:10.013041 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192deffd-9269-46d8-94d6-998ff3dce9f3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:10.017792 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bd8f8-0f86-4945-a611-549f2514746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:10.018503 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bd8f8-0f86-4945-a611-549f2514746e admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:10.018784 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bd8f8-0f86-4945-a611-549f2514746e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:10.019058 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1bd8f8-0f86-4945-a611-549f2514746e admin admin] PATH_INFO: `/v3/projects/8ced3fa4bb11442583a30bc29479e0cc/users/5cbcbd57336740d0ab099544deaf7b3e/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:10.038017 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bd8f8-0f86-4945-a611-549f2514746e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ced3fa4bb11442583a30bc29479e0cc, user_id=5cbcbd57336740d0ab099544deaf7b3e, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:10.040980 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1bd8f8-0f86-4945-a611-549f2514746e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:10.095088 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1422/2850] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:20:10 2022] PUT /identity/v3/projects/8ced3fa4bb11442583a30bc29479e0cc/users/5cbcbd57336740d0ab099544deaf7b3e/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:20:10.099242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da71555-0986-4582-8b45-c541141cdcee admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:10.109648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da71555-0986-4582-8b45-c541141cdcee admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:10.168701 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4bfa90-78ac-45e7-be05-951b3b811087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:10.169321 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bfa90-78ac-45e7-be05-951b3b811087 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:10.169592 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bfa90-78ac-45e7-be05-951b3b811087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:10.169864 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4bfa90-78ac-45e7-be05-951b3b811087 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:10.170513 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bfa90-78ac-45e7-be05-951b3b811087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:10.172153 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4bfa90-78ac-45e7-be05-951b3b811087 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:10.183312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1429/2851] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:20:10.188644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bd8f8-0f86-4945-a611-549f2514746e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:10.198460 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1bd8f8-0f86-4945-a611-549f2514746e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:10.206095 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b97617-5d90-4cbf-96e3-ce7049e5f8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:10.207054 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97617-5d90-4cbf-96e3-ce7049e5f8ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:10.207452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97617-5d90-4cbf-96e3-ce7049e5f8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:10.207917 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b97617-5d90-4cbf-96e3-ce7049e5f8ba admin admin] PATH_INFO: `/v3/projects/8ced3fa4bb11442583a30bc29479e0cc/users/5cbcbd57336740d0ab099544deaf7b3e/roles/68b1888f7bb644a39938b8d41006a813` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:10.210560 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b97617-5d90-4cbf-96e3-ce7049e5f8ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ced3fa4bb11442583a30bc29479e0cc, user_id=5cbcbd57336740d0ab099544deaf7b3e, role_id=68b1888f7bb644a39938b8d41006a813)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:10.213932 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b97617-5d90-4cbf-96e3-ce7049e5f8ba admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:10.225342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1423/2852] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:20:10 2022] PUT /identity/v3/projects/8ced3fa4bb11442583a30bc29479e0cc/users/5cbcbd57336740d0ab099544deaf7b3e/roles/68b1888f7bb644a39938b8d41006a813 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 08:20:10.236844 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e08be6-f0fa-448b-8172-895dcd03853e None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:10.237122 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e08be6-f0fa-448b-8172-895dcd03853e None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:10.237420 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e08be6-f0fa-448b-8172-895dcd03853e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:10.268502 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-e0e08be6-f0fa-448b-8172-895dcd03853e None None] MFA Rules not processed for user `5cbcbd57336740d0ab099544deaf7b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:20:10.269851 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e0e08be6-f0fa-448b-8172-895dcd03853e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:10.354902 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1430/2853] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:20:10 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:20:10.365895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b97617-5d90-4cbf-96e3-ce7049e5f8ba admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:10.367574 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-85b97617-5d90-4cbf-96e3-ce7049e5f8ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:10.474926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b97617-5d90-4cbf-96e3-ce7049e5f8ba admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:10.479360 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2a7a1-2247-449b-9066-8644f208977f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:10.480005 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2a7a1-2247-449b-9066-8644f208977f service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:10.480289 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2a7a1-2247-449b-9066-8644f208977f service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:10.480559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2a7a1-2247-449b-9066-8644f208977f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:10.537250 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2a7a1-2247-449b-9066-8644f208977f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:10.538676 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2a7a1-2247-449b-9066-8644f208977f service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:10.548619 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1424/2854] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:20:10 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:20:15.891782 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e08be6-f0fa-448b-8172-895dcd03853e None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:15.893344 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-e0e08be6-f0fa-448b-8172-895dcd03853e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:15.907329 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e08be6-f0fa-448b-8172-895dcd03853e None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:15.910978 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b934e6-46a6-43fe-b541-ff5df6b82585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:15.911595 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b934e6-46a6-43fe-b541-ff5df6b82585 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:15.911895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b934e6-46a6-43fe-b541-ff5df6b82585 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:15.912171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b934e6-46a6-43fe-b541-ff5df6b82585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:15.922725 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b934e6-46a6-43fe-b541-ff5df6b82585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:15.924205 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b934e6-46a6-43fe-b541-ff5df6b82585 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:15.929609 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:15.935621 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1431/2855] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:20:15 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:20:20.544380 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=94,keystone:INSERT=5 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:22.091276 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2a7a1-2247-449b-9066-8644f208977f service cinder] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:22.153794 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2a7a1-2247-449b-9066-8644f208977f service cinder] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:22.158323 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa3b56-5ecf-4e3a-a27f-f2c622f6e843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:22.158959 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3b56-5ecf-4e3a-a27f-f2c622f6e843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:22.159234 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3b56-5ecf-4e3a-a27f-f2c622f6e843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:22.159511 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9aa3b56-5ecf-4e3a-a27f-f2c622f6e843 admin admin] PATH_INFO: `/v3/users/35698a73ff2842c2a85b1698ac9a8363` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:22.160677 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa3b56-5ecf-4e3a-a27f-f2c622f6e843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35698a73ff2842c2a85b1698ac9a8363)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:22.162598 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9aa3b56-5ecf-4e3a-a27f-f2c622f6e843 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:22.319352 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b9aa3b56-5ecf-4e3a-a27f-f2c622f6e843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35698a73ff2842c2a85b1698ac9a8363'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:22.319984 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b9aa3b56-5ecf-4e3a-a27f-f2c622f6e843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35698a73ff2842c2a85b1698ac9a8363'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:22.320607 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b9aa3b56-5ecf-4e3a-a27f-f2c622f6e843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35698a73ff2842c2a85b1698ac9a8363'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:22.328579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b9aa3b56-5ecf-4e3a-a27f-f2c622f6e843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35698a73ff2842c2a85b1698ac9a8363'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:22.340394 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-b9aa3b56-5ecf-4e3a-a27f-f2c622f6e843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35698a73ff2842c2a85b1698ac9a8363'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:22.440629 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1425/2856] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:20:22 2022] DELETE /identity/v3/users/35698a73ff2842c2a85b1698ac9a8363 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:20:22.445191 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5c5fe-8659-4604-be22-b87d17aed1a2 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:22.445723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5c5fe-8659-4604-be22-b87d17aed1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:22.445869 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5c5fe-8659-4604-be22-b87d17aed1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:22.467012 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-6af5c5fe-8659-4604-be22-b87d17aed1a2 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:20:22.468337 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6af5c5fe-8659-4604-be22-b87d17aed1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:22.527271 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1432/2857] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:20:22.537007 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa3b56-5ecf-4e3a-a27f-f2c622f6e843 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:22.538406 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-b9aa3b56-5ecf-4e3a-a27f-f2c622f6e843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:22.597329 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9aa3b56-5ecf-4e3a-a27f-f2c622f6e843 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:22.600857 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561364e-5fab-46b9-9e06-f1e2ecdf17c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:22.601458 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561364e-5fab-46b9-9e06-f1e2ecdf17c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:22.601731 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561364e-5fab-46b9-9e06-f1e2ecdf17c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:22.601994 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561364e-5fab-46b9-9e06-f1e2ecdf17c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:22.611412 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561364e-5fab-46b9-9e06-f1e2ecdf17c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:22.612972 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561364e-5fab-46b9-9e06-f1e2ecdf17c4 service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:22.622948 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1426/2858] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:20:23.055636 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5c5fe-8659-4604-be22-b87d17aed1a2 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:23.057145 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6af5c5fe-8659-4604-be22-b87d17aed1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:23.070271 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5c5fe-8659-4604-be22-b87d17aed1a2 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:23.075802 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:23.076506 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:23.076787 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:23.077059 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] PATH_INFO: `/v3/projects/6171cded28e449658c868238bb7b86f5` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:23.078242 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=6171cded28e449658c868238bb7b86f5)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:23.082044 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:23.207286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6171cded28e449658c868238bb7b86f5', 'request_id': 'req-492e9721-c89a-475e-a8e5-2cd55d7135ab'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:23.214001 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6171cded28e449658c868238bb7b86f5', 'request_id': 'req-492e9721-c89a-475e-a8e5-2cd55d7135ab'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:23.219522 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6171cded28e449658c868238bb7b86f5', 'request_id': 'req-492e9721-c89a-475e-a8e5-2cd55d7135ab'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:23.287825 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] The token cache is being invalidate because project 6171cded28e449658c868238bb7b86f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:20:23.288149 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:23.288771 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:23.290388 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1433/2859] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:20:23 2022] DELETE /identity/v3/projects/6171cded28e449658c868238bb7b86f5 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:20:23.294545 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561364e-5fab-46b9-9e06-f1e2ecdf17c4 service neutron] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:23.304234 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561364e-5fab-46b9-9e06-f1e2ecdf17c4 service neutron] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:23.323139 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:23.361488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7e211-bc9a-4b27-b4af-a89c13f7090c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:23.362115 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7e211-bc9a-4b27-b4af-a89c13f7090c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:23.362392 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7e211-bc9a-4b27-b4af-a89c13f7090c admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:23.362663 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7e211-bc9a-4b27-b4af-a89c13f7090c admin admin] PATH_INFO: `/v3/users/5cbcbd57336740d0ab099544deaf7b3e` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:23.363776 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7e211-bc9a-4b27-b4af-a89c13f7090c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cbcbd57336740d0ab099544deaf7b3e)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:23.365769 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7e211-bc9a-4b27-b4af-a89c13f7090c admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:23.551559 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-08c7e211-bc9a-4b27-b4af-a89c13f7090c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cbcbd57336740d0ab099544deaf7b3e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:23.552291 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-08c7e211-bc9a-4b27-b4af-a89c13f7090c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cbcbd57336740d0ab099544deaf7b3e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:23.552902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-08c7e211-bc9a-4b27-b4af-a89c13f7090c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cbcbd57336740d0ab099544deaf7b3e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:23.560777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-08c7e211-bc9a-4b27-b4af-a89c13f7090c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cbcbd57336740d0ab099544deaf7b3e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:23.573303 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-08c7e211-bc9a-4b27-b4af-a89c13f7090c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cbcbd57336740d0ab099544deaf7b3e'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:23.664724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1427/2860] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:20:23 2022] DELETE /identity/v3/users/5cbcbd57336740d0ab099544deaf7b3e => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:20:24.094075 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:24.096497 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:24.119101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9721-c89a-475e-a8e5-2cd55d7135ab admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:24.200809 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965a538c-261e-48c2-b4f5-e6a770a8c3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:24.201461 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a538c-261e-48c2-b4f5-e6a770a8c3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:24.201735 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a538c-261e-48c2-b4f5-e6a770a8c3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:24.202004 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965a538c-261e-48c2-b4f5-e6a770a8c3c6 admin admin] PATH_INFO: `/v3/projects/8ced3fa4bb11442583a30bc29479e0cc` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:24.203194 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a538c-261e-48c2-b4f5-e6a770a8c3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ced3fa4bb11442583a30bc29479e0cc)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:24.205195 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965a538c-261e-48c2-b4f5-e6a770a8c3c6 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:24.296791 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:24.316641 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-965a538c-261e-48c2-b4f5-e6a770a8c3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ced3fa4bb11442583a30bc29479e0cc', 'request_id': 'req-965a538c-261e-48c2-b4f5-e6a770a8c3c6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:24.323999 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-965a538c-261e-48c2-b4f5-e6a770a8c3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ced3fa4bb11442583a30bc29479e0cc', 'request_id': 'req-965a538c-261e-48c2-b4f5-e6a770a8c3c6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:24.330065 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-965a538c-261e-48c2-b4f5-e6a770a8c3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ced3fa4bb11442583a30bc29479e0cc', 'request_id': 'req-965a538c-261e-48c2-b4f5-e6a770a8c3c6'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:24.403406 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-965a538c-261e-48c2-b4f5-e6a770a8c3c6 admin admin] The token cache is being invalidate because project 8ced3fa4bb11442583a30bc29479e0cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:20:24.406273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-965a538c-261e-48c2-b4f5-e6a770a8c3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:24.406273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-965a538c-261e-48c2-b4f5-e6a770a8c3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:24.406273 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1434/2861] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:20:24 2022] DELETE /identity/v3/projects/8ced3fa4bb11442583a30bc29479e0cc => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:20:24.413404 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac8bee-7aa9-450f-883b-05a46c9edef1 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:24.413974 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac8bee-7aa9-450f-883b-05a46c9edef1 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:24.413974 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac8bee-7aa9-450f-883b-05a46c9edef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:24.445748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-81ac8bee-7aa9-450f-883b-05a46c9edef1 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:20:24.448330 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-81ac8bee-7aa9-450f-883b-05a46c9edef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:24.525036 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1428/2862] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:20:24.534421 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5212-b741-4cb0-bf94-ee694233acbd None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:24.534723 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5212-b741-4cb0-bf94-ee694233acbd None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:24.534984 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2e5212-b741-4cb0-bf94-ee694233acbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:24.560313 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-fe2e5212-b741-4cb0-bf94-ee694233acbd None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:20:24.561630 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-fe2e5212-b741-4cb0-bf94-ee694233acbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:24.570860 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1435/2863] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:20:24.576348 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac8bee-7aa9-450f-883b-05a46c9edef1 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:24.591149 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ac8bee-7aa9-450f-883b-05a46c9edef1 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:24.598641 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fe93f-0df2-4205-a737-fe9933a09c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:24.599680 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fe93f-0df2-4205-a737-fe9933a09c40 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:24.600195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fe93f-0df2-4205-a737-fe9933a09c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:24.600677 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fe93f-0df2-4205-a737-fe9933a09c40 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:24.601779 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fe93f-0df2-4205-a737-fe9933a09c40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:20:24.602971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fe93f-0df2-4205-a737-fe9933a09c40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:24.606086 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5fe93f-0df2-4205-a737-fe9933a09c40 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:24.623592 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1429/2864] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:20:24.628438 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5212-b741-4cb0-bf94-ee694233acbd None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:24.638935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2e5212-b741-4cb0-bf94-ee694233acbd None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:24.644045 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d55f65-f05d-4bcc-8a0f-0eac385f531f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:24.644658 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d55f65-f05d-4bcc-8a0f-0eac385f531f admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:24.644934 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d55f65-f05d-4bcc-8a0f-0eac385f531f admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:24.645201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d55f65-f05d-4bcc-8a0f-0eac385f531f admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:24.645843 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d55f65-f05d-4bcc-8a0f-0eac385f531f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:24.647751 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d55f65-f05d-4bcc-8a0f-0eac385f531f admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:24.737310 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1436/2865] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:20:24 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:20:24.741644 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fe93f-0df2-4205-a737-fe9933a09c40 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:24.752659 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fe93f-0df2-4205-a737-fe9933a09c40 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:24.785066 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:24.818138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50512b3a-f74c-45a8-b642-29d9bcea9061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:24.818906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50512b3a-f74c-45a8-b642-29d9bcea9061 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:24.819263 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50512b3a-f74c-45a8-b642-29d9bcea9061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:24.819594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50512b3a-f74c-45a8-b642-29d9bcea9061 admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:24.820342 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50512b3a-f74c-45a8-b642-29d9bcea9061 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:24.823116 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50512b3a-f74c-45a8-b642-29d9bcea9061 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:24.910298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1430/2866] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:20:24 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:20:24.911424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d55f65-f05d-4bcc-8a0f-0eac385f531f admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:24.922975 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d55f65-f05d-4bcc-8a0f-0eac385f531f admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:24.928063 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cac82-534b-4faa-aad6-1b7e4346b583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:24.928666 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cac82-534b-4faa-aad6-1b7e4346b583 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:24.928941 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cac82-534b-4faa-aad6-1b7e4346b583 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:24.929210 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823cac82-534b-4faa-aad6-1b7e4346b583 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:24.929898 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823cac82-534b-4faa-aad6-1b7e4346b583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:24.931635 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823cac82-534b-4faa-aad6-1b7e4346b583 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:24.943698 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1437/2867] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:20:24.948498 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50512b3a-f74c-45a8-b642-29d9bcea9061 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:24.958860 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50512b3a-f74c-45a8-b642-29d9bcea9061 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:24.965198 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a071d7d-3c7f-41db-973f-f04b4959833a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:24.965822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071d7d-3c7f-41db-973f-f04b4959833a admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:24.966104 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071d7d-3c7f-41db-973f-f04b4959833a admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:24.966377 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a071d7d-3c7f-41db-973f-f04b4959833a admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:24.967028 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a071d7d-3c7f-41db-973f-f04b4959833a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:24.968657 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a071d7d-3c7f-41db-973f-f04b4959833a admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:24.981439 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1431/2868] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:20:24.985447 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cac82-534b-4faa-aad6-1b7e4346b583 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:24.996492 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823cac82-534b-4faa-aad6-1b7e4346b583 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:25.001220 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6398dc-1bd8-41e2-818b-e9693879ccfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:25.001889 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6398dc-1bd8-41e2-818b-e9693879ccfa admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:25.002161 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6398dc-1bd8-41e2-818b-e9693879ccfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:25.002436 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6398dc-1bd8-41e2-818b-e9693879ccfa admin admin] PATH_INFO: `/v3/projects/3754869849e24d7c9121f1b49a20e41f/users/7fded346d51d4ecfa9f029b547c45297/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:25.018290 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6398dc-1bd8-41e2-818b-e9693879ccfa admin admin] RBAC: Authorizing `identity:create_grant(project_id=3754869849e24d7c9121f1b49a20e41f, user_id=7fded346d51d4ecfa9f029b547c45297, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:25.021185 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6398dc-1bd8-41e2-818b-e9693879ccfa admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:25.089283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1438/2869] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:20:24 2022] PUT /identity/v3/projects/3754869849e24d7c9121f1b49a20e41f/users/7fded346d51d4ecfa9f029b547c45297/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:20:25.102035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6c930-774c-49e0-bc8b-08bf95c4fcf6 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:25.102434 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6c930-774c-49e0-bc8b-08bf95c4fcf6 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:25.102819 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6c930-774c-49e0-bc8b-08bf95c4fcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:25.138000 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-bfb6c930-774c-49e0-bc8b-08bf95c4fcf6 None None] MFA Rules not processed for user `7fded346d51d4ecfa9f029b547c45297`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:20:25.139748 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-bfb6c930-774c-49e0-bc8b-08bf95c4fcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:25.221098 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1432/2870] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:20:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:20:25.234201 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6398dc-1bd8-41e2-818b-e9693879ccfa admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:25.235955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6e6398dc-1bd8-41e2-818b-e9693879ccfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:25.332537 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6398dc-1bd8-41e2-818b-e9693879ccfa admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:25.336354 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380ce24-9a4a-4750-a323-9bddc8722202 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c83e30a9fd04385b44ee3a3b72e5099', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:25.337553 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380ce24-9a4a-4750-a323-9bddc8722202 service glance] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:25.337831 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380ce24-9a4a-4750-a323-9bddc8722202 service glance] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:25.338101 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380ce24-9a4a-4750-a323-9bddc8722202 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:25.347458 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380ce24-9a4a-4750-a323-9bddc8722202 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:25.348944 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380ce24-9a4a-4750-a323-9bddc8722202 service glance] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:25.358980 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1439/2871] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:20:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:20:35.218028 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:35.354596 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:DELETE=6,keystone:SELECT=76,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:53.409459 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6c930-774c-49e0-bc8b-08bf95c4fcf6 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:53.475301 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6c930-774c-49e0-bc8b-08bf95c4fcf6 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:53.480627 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16f764-1121-49a4-933c-19924b4574f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:53.481272 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f764-1121-49a4-933c-19924b4574f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:53.481613 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f764-1121-49a4-933c-19924b4574f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:53.481895 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a16f764-1121-49a4-933c-19924b4574f3 admin admin] PATH_INFO: `/v3/users/7fded346d51d4ecfa9f029b547c45297` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:53.483035 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16f764-1121-49a4-933c-19924b4574f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fded346d51d4ecfa9f029b547c45297)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:53.485029 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a16f764-1121-49a4-933c-19924b4574f3 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:53.656757 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8a16f764-1121-49a4-933c-19924b4574f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fded346d51d4ecfa9f029b547c45297'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:53.657358 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8a16f764-1121-49a4-933c-19924b4574f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fded346d51d4ecfa9f029b547c45297'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:53.658085 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8a16f764-1121-49a4-933c-19924b4574f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fded346d51d4ecfa9f029b547c45297'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:53.666197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8a16f764-1121-49a4-933c-19924b4574f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fded346d51d4ecfa9f029b547c45297'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:53.678437 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-8a16f764-1121-49a4-933c-19924b4574f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fded346d51d4ecfa9f029b547c45297'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:53.751052 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1433/2872] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:20:53 2022] DELETE /identity/v3/users/7fded346d51d4ecfa9f029b547c45297 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:20:53.755804 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440084ab-70ca-46f0-b1be-f803a7f01c90 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:53.756453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440084ab-70ca-46f0-b1be-f803a7f01c90 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:53.756453 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440084ab-70ca-46f0-b1be-f803a7f01c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:53.776533 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-440084ab-70ca-46f0-b1be-f803a7f01c90 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:20:53.777789 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-440084ab-70ca-46f0-b1be-f803a7f01c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:53.841389 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1440/2873] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:20:53.850902 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16f764-1121-49a4-933c-19924b4574f3 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:53.852760 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8a16f764-1121-49a4-933c-19924b4574f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:53.911534 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a16f764-1121-49a4-933c-19924b4574f3 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:53.915970 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cd4b9b-d8c2-46be-b17f-65d82efffa4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:53.916582 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd4b9b-d8c2-46be-b17f-65d82efffa4f service neutron] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:53.916862 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd4b9b-d8c2-46be-b17f-65d82efffa4f service neutron] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:53.917136 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cd4b9b-d8c2-46be-b17f-65d82efffa4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:53.926919 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd4b9b-d8c2-46be-b17f-65d82efffa4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:53.928408 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cd4b9b-d8c2-46be-b17f-65d82efffa4f service neutron] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:53.939522 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1434/2874] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:20:54.396726 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440084ab-70ca-46f0-b1be-f803a7f01c90 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:54.398955 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-440084ab-70ca-46f0-b1be-f803a7f01c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:54.415681 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440084ab-70ca-46f0-b1be-f803a7f01c90 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:54.420657 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b5dc9-9a89-43de-b5b5-40c9fa00438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:54.421365 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b5dc9-9a89-43de-b5b5-40c9fa00438a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:54.421587 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b5dc9-9a89-43de-b5b5-40c9fa00438a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:54.421861 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b5dc9-9a89-43de-b5b5-40c9fa00438a admin admin] PATH_INFO: `/v3/projects/3754869849e24d7c9121f1b49a20e41f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:54.423127 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b5dc9-9a89-43de-b5b5-40c9fa00438a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3754869849e24d7c9121f1b49a20e41f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:54.425292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b5dc9-9a89-43de-b5b5-40c9fa00438a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:54.556235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-078b5dc9-9a89-43de-b5b5-40c9fa00438a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3754869849e24d7c9121f1b49a20e41f', 'request_id': 'req-078b5dc9-9a89-43de-b5b5-40c9fa00438a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:54.562895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-078b5dc9-9a89-43de-b5b5-40c9fa00438a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3754869849e24d7c9121f1b49a20e41f', 'request_id': 'req-078b5dc9-9a89-43de-b5b5-40c9fa00438a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:54.568530 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-078b5dc9-9a89-43de-b5b5-40c9fa00438a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3754869849e24d7c9121f1b49a20e41f', 'request_id': 'req-078b5dc9-9a89-43de-b5b5-40c9fa00438a'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:54.640082 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-078b5dc9-9a89-43de-b5b5-40c9fa00438a admin admin] The token cache is being invalidate because project 3754869849e24d7c9121f1b49a20e41f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81602) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:20:54.640370 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-078b5dc9-9a89-43de-b5b5-40c9fa00438a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:54.641019 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-078b5dc9-9a89-43de-b5b5-40c9fa00438a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:20:54.642591 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1441/2875] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:20:54 2022] DELETE /identity/v3/projects/3754869849e24d7c9121f1b49a20e41f => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:20:54.650089 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fd726-1fa3-405a-a565-531c08711b46 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:54.650679 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fd726-1fa3-405a-a565-531c08711b46 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:54.650679 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8fd726-1fa3-405a-a565-531c08711b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:54.672657 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-ca8fd726-1fa3-405a-a565-531c08711b46 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:20:54.673775 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-ca8fd726-1fa3-405a-a565-531c08711b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:54.692452 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:54.746100 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1435/2876] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:20:54.754198 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae018f0e-20cb-4495-a744-b8f00431e082 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:54.754484 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae018f0e-20cb-4495-a744-b8f00431e082 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:54.754757 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae018f0e-20cb-4495-a744-b8f00431e082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:54.775656 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-ae018f0e-20cb-4495-a744-b8f00431e082 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:20:54.776930 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-ae018f0e-20cb-4495-a744-b8f00431e082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:54.785105 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1442/2877] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:20:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:20:54.790477 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fd726-1fa3-405a-a565-531c08711b46 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:54.800456 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8fd726-1fa3-405a-a565-531c08711b46 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:54.805944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3779d6-c805-4497-8e0d-a7d723a52929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:54.806562 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3779d6-c805-4497-8e0d-a7d723a52929 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:54.806840 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3779d6-c805-4497-8e0d-a7d723a52929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:54.807366 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3779d6-c805-4497-8e0d-a7d723a52929 admin admin] PATH_INFO: `/v3/domains` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:54.808057 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3779d6-c805-4497-8e0d-a7d723a52929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81603) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:20:54.808363 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3779d6-c805-4497-8e0d-a7d723a52929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:54.809971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3779d6-c805-4497-8e0d-a7d723a52929 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:54.823213 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1436/2878] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:20:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:20:54.827873 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae018f0e-20cb-4495-a744-b8f00431e082 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:54.838747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae018f0e-20cb-4495-a744-b8f00431e082 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:54.843984 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55788a-c829-44a6-995b-67137d75cd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:54.844601 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55788a-c829-44a6-995b-67137d75cd4e admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:54.844876 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55788a-c829-44a6-995b-67137d75cd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:54.845171 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55788a-c829-44a6-995b-67137d75cd4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:54.845800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55788a-c829-44a6-995b-67137d75cd4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:54.847733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f55788a-c829-44a6-995b-67137d75cd4e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:54.971647 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1443/2879] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:20:54 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:20:54.976023 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3779d6-c805-4497-8e0d-a7d723a52929 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:54.987716 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3779d6-c805-4497-8e0d-a7d723a52929 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:55.051316 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc71e7-f411-40e9-bf4b-05aa088e8a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:55.051980 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc71e7-f411-40e9-bf4b-05aa088e8a2e admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:55.052260 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc71e7-f411-40e9-bf4b-05aa088e8a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:55.052533 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbc71e7-f411-40e9-bf4b-05aa088e8a2e admin admin] PATH_INFO: `/v3/users` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:55.053181 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc71e7-f411-40e9-bf4b-05aa088e8a2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:55.055906 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbc71e7-f411-40e9-bf4b-05aa088e8a2e admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:55.173686 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1437/2880] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:20:54 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:20:55.177939 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55788a-c829-44a6-995b-67137d75cd4e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:55.189553 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55788a-c829-44a6-995b-67137d75cd4e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:55.197027 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544a3b0-6412-4103-b92f-c8f0cf682995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:55.197982 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544a3b0-6412-4103-b92f-c8f0cf682995 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:55.198464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544a3b0-6412-4103-b92f-c8f0cf682995 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:55.198911 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b544a3b0-6412-4103-b92f-c8f0cf682995 admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:55.200079 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544a3b0-6412-4103-b92f-c8f0cf682995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:55.202953 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b544a3b0-6412-4103-b92f-c8f0cf682995 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:55.214099 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1444/2881] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:20:55.218370 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc71e7-f411-40e9-bf4b-05aa088e8a2e admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:55.230386 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbc71e7-f411-40e9-bf4b-05aa088e8a2e admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:55.235120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a6501-8f0c-419f-9562-402d06995708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:55.235734 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6501-8f0c-419f-9562-402d06995708 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:55.236046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6501-8f0c-419f-9562-402d06995708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:55.236319 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a6501-8f0c-419f-9562-402d06995708 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:55.236971 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a6501-8f0c-419f-9562-402d06995708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:55.238634 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a6501-8f0c-419f-9562-402d06995708 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:55.250620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1438/2882] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:20:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:20:55.254964 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544a3b0-6412-4103-b92f-c8f0cf682995 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:55.266107 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b544a3b0-6412-4103-b92f-c8f0cf682995 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:55.270715 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08002514-311c-4f52-8a13-e5aa17e6db08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:55.271369 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002514-311c-4f52-8a13-e5aa17e6db08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:55.271648 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002514-311c-4f52-8a13-e5aa17e6db08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:55.271940 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08002514-311c-4f52-8a13-e5aa17e6db08 admin admin] PATH_INFO: `/v3/projects/944370c5b7fc40899bb0133f000c5f66/users/9188387fdbdc4d0982331ff753971da7/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:55.287312 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08002514-311c-4f52-8a13-e5aa17e6db08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944370c5b7fc40899bb0133f000c5f66, user_id=9188387fdbdc4d0982331ff753971da7, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:55.290051 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08002514-311c-4f52-8a13-e5aa17e6db08 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:55.379980 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1445/2883] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:20:55 2022] PUT /identity/v3/projects/944370c5b7fc40899bb0133f000c5f66/users/9188387fdbdc4d0982331ff753971da7/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:20:55.392044 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e1a5-df2a-44c5-a1a2-33e5fa6966aa None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:55.392324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e1a5-df2a-44c5-a1a2-33e5fa6966aa None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:55.392596 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab8e1a5-df2a-44c5-a1a2-33e5fa6966aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:55.421966 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-8ab8e1a5-df2a-44c5-a1a2-33e5fa6966aa None None] MFA Rules not processed for user `9188387fdbdc4d0982331ff753971da7`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:20:55.423207 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-8ab8e1a5-df2a-44c5-a1a2-33e5fa6966aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:55.494570 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1439/2884] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:20:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:20:55.506074 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08002514-311c-4f52-8a13-e5aa17e6db08 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:55.507818 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-08002514-311c-4f52-8a13-e5aa17e6db08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:55.534103 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:20:55.575007 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08002514-311c-4f52-8a13-e5aa17e6db08 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:55.578891 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a520d-0574-4e5a-8777-825df11cb321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:55.585340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a520d-0574-4e5a-8777-825df11cb321 service cinder] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:55.585340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a520d-0574-4e5a-8777-825df11cb321 service cinder] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:55.585340 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a520d-0574-4e5a-8777-825df11cb321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:55.589494 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a520d-0574-4e5a-8777-825df11cb321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:55.590926 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a520d-0574-4e5a-8777-825df11cb321 service cinder] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:55.600931 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1446/2885] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:20:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:20:57.300333 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69295a48-4606-43e4-b595-b663c083a9ba None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:57.301018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69295a48-4606-43e4-b595-b663c083a9ba None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:57.301018 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69295a48-4606-43e4-b595-b663c083a9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:57.321195 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-69295a48-4606-43e4-b595-b663c083a9ba None None] MFA Rules not processed for user `9188387fdbdc4d0982331ff753971da7`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:20:57.322505 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-69295a48-4606-43e4-b595-b663c083a9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:57.329683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1440/2886] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:20:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:20:57.928666 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a520d-0574-4e5a-8777-825df11cb321 service cinder] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:20:57.930768 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-272a520d-0574-4e5a-8777-825df11cb321 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:58.011643 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a520d-0574-4e5a-8777-825df11cb321 service cinder] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:20:58.017138 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce5eac-91a3-4d68-9360-6033ae518c5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213e29685f3402b804d4d8fbc88ba96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:20:58.017800 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce5eac-91a3-4d68-9360-6033ae518c5c service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:20:58.020024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce5eac-91a3-4d68-9360-6033ae518c5c service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:20:58.020024 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce5eac-91a3-4d68-9360-6033ae518c5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:20:58.020235 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-54ce5eac-91a3-4d68-9360-6033ae518c5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:20:58.033219 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce5eac-91a3-4d68-9360-6033ae518c5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:20:58.034811 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce5eac-91a3-4d68-9360-6033ae518c5c service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:20:58.045733 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1447/2887] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:20:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:21:07.315946 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=92,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:21:08.041035 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=49 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:21:08.220978 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69295a48-4606-43e4-b595-b663c083a9ba None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:08.224488 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-69295a48-4606-43e4-b595-b663c083a9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:08.301723 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69295a48-4606-43e4-b595-b663c083a9ba None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:08.308364 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6a01e-9c35-4542-915f-aaabc7f8dde9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b99cff7a5f549adadee002f8ab1f5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:08.311469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6a01e-9c35-4542-915f-aaabc7f8dde9 service nova] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:08.311469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6a01e-9c35-4542-915f-aaabc7f8dde9 service nova] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:08.311469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d6a01e-9c35-4542-915f-aaabc7f8dde9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:08.311469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-60d6a01e-9c35-4542-915f-aaabc7f8dde9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:08.325336 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6a01e-9c35-4542-915f-aaabc7f8dde9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:08.326951 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d6a01e-9c35-4542-915f-aaabc7f8dde9 service nova] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:08.340962 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1441/2888] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:21:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:21:15.289045 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dadc2-c614-4fd0-a065-2764dbeac981 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:15.289769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dadc2-c614-4fd0-a065-2764dbeac981 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:15.289769 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dadc2-c614-4fd0-a065-2764dbeac981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:15.352895 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-2b6dadc2-c614-4fd0-a065-2764dbeac981 None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:21:15.354131 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-2b6dadc2-c614-4fd0-a065-2764dbeac981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:15.427509 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1448/2889] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:21:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:21:15.629697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6a01e-9c35-4542-915f-aaabc7f8dde9 service nova] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:15.631120 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-60d6a01e-9c35-4542-915f-aaabc7f8dde9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:15.725697 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d6a01e-9c35-4542-915f-aaabc7f8dde9 service nova] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:15.731017 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a08c68-722d-47ff-87be-4e4720131974 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:15.731620 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a08c68-722d-47ff-87be-4e4720131974 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:15.731926 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a08c68-722d-47ff-87be-4e4720131974 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:15.732197 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a08c68-722d-47ff-87be-4e4720131974 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:15.740599 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a08c68-722d-47ff-87be-4e4720131974 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:15.742180 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a08c68-722d-47ff-87be-4e4720131974 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:15.750924 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1442/2890] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:21:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:21:16.636286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f96a-fd26-4ee1-a738-4ecbc5ffde13 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:16.636286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f96a-fd26-4ee1-a738-4ecbc5ffde13 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:16.636286 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9f96a-fd26-4ee1-a738-4ecbc5ffde13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:16.654928 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-11e9f96a-fd26-4ee1-a738-4ecbc5ffde13 None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:21:16.656189 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-11e9f96a-fd26-4ee1-a738-4ecbc5ffde13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:16.664495 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1449/2891] 10.222.0.62 () {58 vars in 967 bytes} [Wed Aug 24 08:21:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 08:21:16.677724 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a08c68-722d-47ff-87be-4e4720131974 service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:16.690106 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a08c68-722d-47ff-87be-4e4720131974 service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:16.695704 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7f6c3-598f-4dcc-8d5a-6f6d90bd0a79 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:16.696298 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7f6c3-598f-4dcc-8d5a-6f6d90bd0a79 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:16.696579 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7f6c3-598f-4dcc-8d5a-6f6d90bd0a79 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:16.696852 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd7f6c3-598f-4dcc-8d5a-6f6d90bd0a79 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:16.705979 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7f6c3-598f-4dcc-8d5a-6f6d90bd0a79 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:16.707557 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd7f6c3-598f-4dcc-8d5a-6f6d90bd0a79 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:16.716692 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1443/2892] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:21:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:21:17.431258 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e21255-fb5a-45f5-8e27-e9ba4f3cabbe None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:17.431673 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e21255-fb5a-45f5-8e27-e9ba4f3cabbe None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:17.432375 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e21255-fb5a-45f5-8e27-e9ba4f3cabbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:17.453320 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-24e21255-fb5a-45f5-8e27-e9ba4f3cabbe None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:21:17.454554 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-24e21255-fb5a-45f5-8e27-e9ba4f3cabbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:17.462552 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1450/2893] 10.222.0.62 () {58 vars in 1009 bytes} [Wed Aug 24 08:21:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:21:17.474807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7f6c3-598f-4dcc-8d5a-6f6d90bd0a79 service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:17.486122 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd7f6c3-598f-4dcc-8d5a-6f6d90bd0a79 service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:17.492344 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fc87a-529a-4fe1-ac5c-0d66193a7174 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:17.492977 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fc87a-529a-4fe1-ac5c-0d66193a7174 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:17.493255 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fc87a-529a-4fe1-ac5c-0d66193a7174 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:17.493524 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fc87a-529a-4fe1-ac5c-0d66193a7174 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:17.502664 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fc87a-529a-4fe1-ac5c-0d66193a7174 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:17.504453 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fc87a-529a-4fe1-ac5c-0d66193a7174 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:17.514502 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1444/2894] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:21:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:21:18.240678 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033c707-4cd3-4e68-b4e6-0452b8e6ef00 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:18.241228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033c707-4cd3-4e68-b4e6-0452b8e6ef00 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:18.241228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7033c707-4cd3-4e68-b4e6-0452b8e6ef00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:18.261354 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-7033c707-4cd3-4e68-b4e6-0452b8e6ef00 None None] MFA Rules not processed for user `2627d6e89afa4774b0897bb0c619cd01`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:21:18.262502 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-7033c707-4cd3-4e68-b4e6-0452b8e6ef00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:18.269888 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1451/2895] 10.222.0.62 () {58 vars in 967 bytes} [Wed Aug 24 08:21:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:21:18.282687 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fc87a-529a-4fe1-ac5c-0d66193a7174 service swift] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:18.295515 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fc87a-529a-4fe1-ac5c-0d66193a7174 service swift] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:18.300807 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51676c2-c4cb-442a-a616-bf62f69da145 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8255043f01fd46e4a8a5fde8e81c2bed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:18.301416 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51676c2-c4cb-442a-a616-bf62f69da145 service swift] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:18.301693 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51676c2-c4cb-442a-a616-bf62f69da145 service swift] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:18.301963 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51676c2-c4cb-442a-a616-bf62f69da145 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:18.311489 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51676c2-c4cb-442a-a616-bf62f69da145 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:18.313103 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51676c2-c4cb-442a-a616-bf62f69da145 service swift] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:18.322385 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1445/2896] 10.222.0.62 () {60 vars in 1384 bytes} [Wed Aug 24 08:21:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 08:21:21.142125 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033c707-4cd3-4e68-b4e6-0452b8e6ef00 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:21.214120 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7033c707-4cd3-4e68-b4e6-0452b8e6ef00 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:21.218661 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516e244-49f1-44ee-9263-6e1910179007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:21.219291 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516e244-49f1-44ee-9263-6e1910179007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:21.219572 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516e244-49f1-44ee-9263-6e1910179007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:21.219856 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6516e244-49f1-44ee-9263-6e1910179007 admin admin] PATH_INFO: `/v3/users/9188387fdbdc4d0982331ff753971da7` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:21.221022 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516e244-49f1-44ee-9263-6e1910179007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9188387fdbdc4d0982331ff753971da7)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:21.222947 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6516e244-49f1-44ee-9263-6e1910179007 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:21.435761 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:21:21.437355 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6516e244-49f1-44ee-9263-6e1910179007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9188387fdbdc4d0982331ff753971da7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:21.450258 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6516e244-49f1-44ee-9263-6e1910179007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9188387fdbdc4d0982331ff753971da7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:21.450996 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6516e244-49f1-44ee-9263-6e1910179007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9188387fdbdc4d0982331ff753971da7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:21.451624 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6516e244-49f1-44ee-9263-6e1910179007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9188387fdbdc4d0982331ff753971da7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:21.458686 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-6516e244-49f1-44ee-9263-6e1910179007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9188387fdbdc4d0982331ff753971da7'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:21.536974 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1452/2897] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:21:21 2022] DELETE /identity/v3/users/9188387fdbdc4d0982331ff753971da7 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:21:21.542381 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1921e8f-b73c-48d0-b5e7-b5aab2464dcc None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:21.542920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1921e8f-b73c-48d0-b5e7-b5aab2464dcc None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:21.542920 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1921e8f-b73c-48d0-b5e7-b5aab2464dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:21.563355 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-a1921e8f-b73c-48d0-b5e7-b5aab2464dcc None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:21:21.564668 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a1921e8f-b73c-48d0-b5e7-b5aab2464dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:21.574785 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=100 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:21:21.632529 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1446/2898] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:21:21.642298 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516e244-49f1-44ee-9263-6e1910179007 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:21.643765 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-6516e244-49f1-44ee-9263-6e1910179007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:21.705160 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6516e244-49f1-44ee-9263-6e1910179007 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:21.708969 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7487992-c221-46e6-bfa2-c27d7399d274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:21.709584 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7487992-c221-46e6-bfa2-c27d7399d274 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:21.709863 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7487992-c221-46e6-bfa2-c27d7399d274 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:21.710137 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7487992-c221-46e6-bfa2-c27d7399d274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:21.720729 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7487992-c221-46e6-bfa2-c27d7399d274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:21.722155 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7487992-c221-46e6-bfa2-c27d7399d274 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:21.732652 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1453/2899] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:21:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:21:21.992318 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1921e8f-b73c-48d0-b5e7-b5aab2464dcc None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:21.998324 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-a1921e8f-b73c-48d0-b5e7-b5aab2464dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:22.005754 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1921e8f-b73c-48d0-b5e7-b5aab2464dcc None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:22.011654 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:22.013317 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:22.013768 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:22.014046 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d admin admin] PATH_INFO: `/v3/projects/944370c5b7fc40899bb0133f000c5f66` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:22.015498 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=944370c5b7fc40899bb0133f000c5f66)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:22.017742 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:22.118583 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944370c5b7fc40899bb0133f000c5f66', 'request_id': 'req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:22.125040 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944370c5b7fc40899bb0133f000c5f66', 'request_id': 'req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:22.194144 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944370c5b7fc40899bb0133f000c5f66', 'request_id': 'req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:22.206339 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d admin admin] The token cache is being invalidate because project 944370c5b7fc40899bb0133f000c5f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:21:22.206624 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:22.207293 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-d085d6b7-aa95-42bb-a8f0-f70b75dc9a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:22.208838 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1447/2900] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:21:21 2022] DELETE /identity/v3/projects/944370c5b7fc40899bb0133f000c5f66 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:21:22.215739 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a637ae-3aaf-4f8b-8e4d-661779e5a569 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:22.216322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a637ae-3aaf-4f8b-8e4d-661779e5a569 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:22.216732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a637ae-3aaf-4f8b-8e4d-661779e5a569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:22.242997 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-80a637ae-3aaf-4f8b-8e4d-661779e5a569 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:21:22.242997 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-80a637ae-3aaf-4f8b-8e4d-661779e5a569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:22.306395 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1454/2901] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:21:22.372238 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff37e0e-b037-4f8d-b2eb-58b749c5bcd8 None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:22.372578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff37e0e-b037-4f8d-b2eb-58b749c5bcd8 None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:22.372762 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff37e0e-b037-4f8d-b2eb-58b749c5bcd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:22.393201 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-5ff37e0e-b037-4f8d-b2eb-58b749c5bcd8 None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:21:22.394422 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-5ff37e0e-b037-4f8d-b2eb-58b749c5bcd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:22.403226 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1448/2902] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:21:22.407580 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a637ae-3aaf-4f8b-8e4d-661779e5a569 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:22.418792 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a637ae-3aaf-4f8b-8e4d-661779e5a569 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:22.423616 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1704a8-f72c-4ffe-8a4e-bc63f68dfd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:22.424303 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1704a8-f72c-4ffe-8a4e-bc63f68dfd07 admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:22.424582 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1704a8-f72c-4ffe-8a4e-bc63f68dfd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:22.424890 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1704a8-f72c-4ffe-8a4e-bc63f68dfd07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:22.425576 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1704a8-f72c-4ffe-8a4e-bc63f68dfd07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81602) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 08:21:22.425879 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1704a8-f72c-4ffe-8a4e-bc63f68dfd07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:22.427482 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1704a8-f72c-4ffe-8a4e-bc63f68dfd07 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:22.440379 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1455/2903] 10.222.0.62 () {58 vars in 1153 bytes} [Wed Aug 24 08:21:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 08:21:22.446174 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff37e0e-b037-4f8d-b2eb-58b749c5bcd8 None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:22.455683 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff37e0e-b037-4f8d-b2eb-58b749c5bcd8 None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:22.461013 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4813e-e7f5-46b9-b217-2c392321eef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:22.461626 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4813e-e7f5-46b9-b217-2c392321eef0 admin admin] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:22.461891 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4813e-e7f5-46b9-b217-2c392321eef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:22.462156 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4813e-e7f5-46b9-b217-2c392321eef0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:22.462777 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4813e-e7f5-46b9-b217-2c392321eef0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:22.464709 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4813e-e7f5-46b9-b217-2c392321eef0 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:22.584328 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1449/2904] 10.222.0.62 () {60 vars in 1153 bytes} [Wed Aug 24 08:21:22 2022] POST /identity/v3/projects => generated 391 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 08:21:22.589527 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1704a8-f72c-4ffe-8a4e-bc63f68dfd07 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:22.600345 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1704a8-f72c-4ffe-8a4e-bc63f68dfd07 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:22.655203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:21:22.664203 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2236caa-3d79-4650-991e-4bffcd4e0641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:22.664834 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2236caa-3d79-4650-991e-4bffcd4e0641 admin admin] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:22.665109 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2236caa-3d79-4650-991e-4bffcd4e0641 admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:22.665377 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2236caa-3d79-4650-991e-4bffcd4e0641 admin admin] PATH_INFO: `/v3/users` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:22.665996 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2236caa-3d79-4650-991e-4bffcd4e0641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:22.667923 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2236caa-3d79-4650-991e-4bffcd4e0641 admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:22.796381 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1456/2905] 10.222.0.62 () {60 vars in 1144 bytes} [Wed Aug 24 08:21:22 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 08:21:22.802145 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4813e-e7f5-46b9-b217-2c392321eef0 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:22.813551 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4813e-e7f5-46b9-b217-2c392321eef0 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:22.819364 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7214d-e3b8-4449-ba7d-fe584890bec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:22.828622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7214d-e3b8-4449-ba7d-fe584890bec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:22.828622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7214d-e3b8-4449-ba7d-fe584890bec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:22.828622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef7214d-e3b8-4449-ba7d-fe584890bec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:22.828622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7214d-e3b8-4449-ba7d-fe584890bec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:22.828622 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef7214d-e3b8-4449-ba7d-fe584890bec9 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:22.835009 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1450/2906] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:21:22.839299 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2236caa-3d79-4650-991e-4bffcd4e0641 admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:22.850292 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2236caa-3d79-4650-991e-4bffcd4e0641 admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:22.857470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bedd3-51be-4ea3-bb9d-36fdc85e995a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:22.857470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bedd3-51be-4ea3-bb9d-36fdc85e995a admin admin] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:22.857470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bedd3-51be-4ea3-bb9d-36fdc85e995a admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:22.857470 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bedd3-51be-4ea3-bb9d-36fdc85e995a admin admin] PATH_INFO: `/v3/roles` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:22.858071 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bedd3-51be-4ea3-bb9d-36fdc85e995a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:22.859224 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bedd3-51be-4ea3-bb9d-36fdc85e995a admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:22.871747 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1457/2907] 10.222.0.62 () {58 vars in 1122 bytes} [Wed Aug 24 08:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 08:21:22.876093 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7214d-e3b8-4449-ba7d-fe584890bec9 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:22.887446 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef7214d-e3b8-4449-ba7d-fe584890bec9 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:22.892511 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe2b15-82dc-4396-9e13-2b4239a0a670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:22.893188 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe2b15-82dc-4396-9e13-2b4239a0a670 admin admin] REQUEST_METHOD: `PUT` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:22.893469 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe2b15-82dc-4396-9e13-2b4239a0a670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:22.893774 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe2b15-82dc-4396-9e13-2b4239a0a670 admin admin] PATH_INFO: `/v3/projects/e95517a7a8634c6b8d75bd915bd53960/users/4d7552e8141548dfa0421276392ce74f/roles/75d9054a423c4c66b163c72c8ae7989c` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:22.909823 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe2b15-82dc-4396-9e13-2b4239a0a670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95517a7a8634c6b8d75bd915bd53960, user_id=4d7552e8141548dfa0421276392ce74f, role_id=75d9054a423c4c66b163c72c8ae7989c)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:22.912530 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe2b15-82dc-4396-9e13-2b4239a0a670 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:23.001911 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1451/2908] 10.222.0.62 () {60 vars in 1483 bytes} [Wed Aug 24 08:21:22 2022] PUT /identity/v3/projects/e95517a7a8634c6b8d75bd915bd53960/users/4d7552e8141548dfa0421276392ce74f/roles/75d9054a423c4c66b163c72c8ae7989c => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:21:23.012798 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1508e-ac70-419d-b717-a416c09be5c6 None None] REQUEST_METHOD: `POST` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:23.013083 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1508e-ac70-419d-b717-a416c09be5c6 None None] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:23.013356 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1508e-ac70-419d-b717-a416c09be5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:23.042213 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.auth.core [None req-38a1508e-ac70-419d-b717-a416c09be5c6 None None] MFA Rules not processed for user `4d7552e8141548dfa0421276392ce74f`. Rule list: `[]` (Enabled: `True`). {{(pid=81602) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:21:23.043464 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-38a1508e-ac70-419d-b717-a416c09be5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:23.116071 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1458/2909] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:21:23 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:21:23.127531 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe2b15-82dc-4396-9e13-2b4239a0a670 admin admin] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:23.129322 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-d4fe2b15-82dc-4396-9e13-2b4239a0a670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:23.170944 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:21:23.190109 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe2b15-82dc-4396-9e13-2b4239a0a670 admin admin] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:23.193844 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f26be4-7570-46fa-84dd-ed8f1c9afa59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33f1237eb614223a062bafb7a49eac6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:23.194474 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f26be4-7570-46fa-84dd-ed8f1c9afa59 service cinder] REQUEST_METHOD: `GET` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:23.194791 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f26be4-7570-46fa-84dd-ed8f1c9afa59 service cinder] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:23.195157 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f26be4-7570-46fa-84dd-ed8f1c9afa59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:23.204945 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f26be4-7570-46fa-84dd-ed8f1c9afa59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:23.206395 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f26be4-7570-46fa-84dd-ed8f1c9afa59 service cinder] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:23.216594 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1452/2910] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:21:23 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:21:33.112607 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=42,keystone:INSERT=3 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:21:33.269451 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=10 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:21:35.036732 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1508e-ac70-419d-b717-a416c09be5c6 None None] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:35.114179 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1508e-ac70-419d-b717-a416c09be5c6 None None] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:35.119705 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac6e88-cc59-483c-af0d-d63ff98ecd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:35.120414 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac6e88-cc59-483c-af0d-d63ff98ecd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:35.120697 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac6e88-cc59-483c-af0d-d63ff98ecd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:35.120972 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ac6e88-cc59-483c-af0d-d63ff98ecd4e admin admin] PATH_INFO: `/v3/users/4d7552e8141548dfa0421276392ce74f` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:35.122143 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac6e88-cc59-483c-af0d-d63ff98ecd4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d7552e8141548dfa0421276392ce74f)` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:35.124228 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ac6e88-cc59-483c-af0d-d63ff98ecd4e admin admin] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:35.302062 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-13ac6e88-cc59-483c-af0d-d63ff98ecd4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d7552e8141548dfa0421276392ce74f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:35.316721 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-13ac6e88-cc59-483c-af0d-d63ff98ecd4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d7552e8141548dfa0421276392ce74f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:35.317570 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-13ac6e88-cc59-483c-af0d-d63ff98ecd4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d7552e8141548dfa0421276392ce74f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:35.318182 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-13ac6e88-cc59-483c-af0d-d63ff98ecd4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d7552e8141548dfa0421276392ce74f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:35.328283 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.notifications [None req-13ac6e88-cc59-483c-af0d-d63ff98ecd4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d7552e8141548dfa0421276392ce74f'} {{(pid=81602) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:35.402409 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1459/2911] 10.222.0.62 () {58 vars in 1224 bytes} [Wed Aug 24 08:21:35 2022] DELETE /identity/v3/users/4d7552e8141548dfa0421276392ce74f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:21:35.407056 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c021c-b1b5-4ad2-ad27-1cae5fcedeff None None] REQUEST_METHOD: `POST` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:35.407638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c021c-b1b5-4ad2-ad27-1cae5fcedeff None None] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:35.407638 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097c021c-b1b5-4ad2-ad27-1cae5fcedeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:35.427770 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.auth.core [None req-097c021c-b1b5-4ad2-ad27-1cae5fcedeff None None] MFA Rules not processed for user `5ed7209395664f8f80ff40e9951b896e`. Rule list: `[]` (Enabled: `True`). {{(pid=81603) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 08:21:35.429110 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-097c021c-b1b5-4ad2-ad27-1cae5fcedeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:35.494229 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1453/2912] 10.222.0.62 () {58 vars in 958 bytes} [Wed Aug 24 08:21:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 08:21:35.504000 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac6e88-cc59-483c-af0d-d63ff98ecd4e admin admin] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:35.505518 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-13ac6e88-cc59-483c-af0d-d63ff98ecd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:35.569280 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ac6e88-cc59-483c-af0d-d63ff98ecd4e admin admin] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:35.573299 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e688180-7845-4b0f-80a8-a0601abb41c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f49116f202774e4da0c96875ffa08288', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:35.573935 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e688180-7845-4b0f-80a8-a0601abb41c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:35.574216 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e688180-7845-4b0f-80a8-a0601abb41c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:35.574489 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e688180-7845-4b0f-80a8-a0601abb41c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:35.584845 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e688180-7845-4b0f-80a8-a0601abb41c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:35.587467 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e688180-7845-4b0f-80a8-a0601abb41c0 service neutron] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:35.598661 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1460/2913] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:21:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:21:36.049464 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c021c-b1b5-4ad2-ad27-1cae5fcedeff None None] Authenticating user token {{(pid=81603) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:21:36.051448 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.fernet_utils [None req-097c021c-b1b5-4ad2-ad27-1cae5fcedeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81603) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:21:36.068270 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097c021c-b1b5-4ad2-ad27-1cae5fcedeff None None] Validating token access rules against request {{(pid=81603) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:21:36.073578 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8778a2-4aa0-444c-9965-cc26170ef764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5ed7209395664f8f80ff40e9951b896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '853a156fb9564ec38e1fef2222e14a94', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81603) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:21:36.074235 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8778a2-4aa0-444c-9965-cc26170ef764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:21:36.086783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8778a2-4aa0-444c-9965-cc26170ef764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:21:36.086783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8778a2-4aa0-444c-9965-cc26170ef764 admin admin] PATH_INFO: `/v3/projects/e95517a7a8634c6b8d75bd915bd53960` {{(pid=81603) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:21:36.086783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8778a2-4aa0-444c-9965-cc26170ef764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95517a7a8634c6b8d75bd915bd53960)` {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:21:36.086783 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8778a2-4aa0-444c-9965-cc26170ef764 admin admin] RBAC: Authorization granted {{(pid=81603) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:21:36.205822 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7c8778a2-4aa0-444c-9965-cc26170ef764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95517a7a8634c6b8d75bd915bd53960', 'request_id': 'req-7c8778a2-4aa0-444c-9965-cc26170ef764'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:36.213572 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7c8778a2-4aa0-444c-9965-cc26170ef764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95517a7a8634c6b8d75bd915bd53960', 'request_id': 'req-7c8778a2-4aa0-444c-9965-cc26170ef764'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:36.296438 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7c8778a2-4aa0-444c-9965-cc26170ef764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95517a7a8634c6b8d75bd915bd53960', 'request_id': 'req-7c8778a2-4aa0-444c-9965-cc26170ef764'} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:36.315172 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7c8778a2-4aa0-444c-9965-cc26170ef764 admin admin] The token cache is being invalidate because project e95517a7a8634c6b8d75bd915bd53960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81603) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 08:21:36.319572 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7c8778a2-4aa0-444c-9965-cc26170ef764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:36.319572 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG keystone.notifications [None req-7c8778a2-4aa0-444c-9965-cc26170ef764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81603) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 08:21:36.319572 dv-cinder-852211-5-smb devstack@keystone.service[81603]: [pid: 81603|app: 0|req: 1454/2914] 10.222.0.62 () {58 vars in 1233 bytes} [Wed Aug 24 08:21:36 2022] DELETE /identity/v3/projects/e95517a7a8634c6b8d75bd915bd53960 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 08:21:45.593563 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:21:46.306138 dv-cinder-852211-5-smb devstack@keystone.service[81603]: DEBUG dbcounter [-] [81603] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81603) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 08:22:40.444111 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e688180-7845-4b0f-80a8-a0601abb41c0 service neutron] Authenticating user token {{(pid=81602) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 08:22:40.445530 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-9e688180-7845-4b0f-80a8-a0601abb41c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:22:40.515056 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e688180-7845-4b0f-80a8-a0601abb41c0 service neutron] Validating token access rules against request {{(pid=81602) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 08:22:40.575773 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c34b6-7789-4ac2-bf67-aa618771365a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd213e29685f3402b804d4d8fbc88ba96', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c1074e261454981a85d02b4b0f75ec5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81602) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 08:22:40.576424 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c34b6-7789-4ac2-bf67-aa618771365a service placement] REQUEST_METHOD: `GET` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 08:22:40.576790 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c34b6-7789-4ac2-bf67-aa618771365a service placement] SCRIPT_NAME: `/identity` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 08:22:40.577586 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c34b6-7789-4ac2-bf67-aa618771365a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81602) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 08:22:40.581220 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.fernet_utils [None req-c05c34b6-7789-4ac2-bf67-aa618771365a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81602) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 08:22:40.592677 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c34b6-7789-4ac2-bf67-aa618771365a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 08:22:40.594232 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c34b6-7789-4ac2-bf67-aa618771365a service placement] RBAC: Authorization granted {{(pid=81602) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 08:22:40.604322 dv-cinder-852211-5-smb devstack@keystone.service[81602]: [pid: 81602|app: 0|req: 1461/2915] 10.222.0.62 () {60 vars in 1365 bytes} [Wed Aug 24 08:22:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 08:22:50.599937 dv-cinder-852211-5-smb devstack@keystone.service[81602]: DEBUG dbcounter [-] [81602] Writing DB stats keystone:SELECT=58 {{(pid=81602) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}